Modeling a pipeline
A pipeline consists of a flow of activities that you place and connect in the pipeline modeler canvas.
The activities are grouped into categories in the Activity Catalog in this way:
- Subscription:
- Data Object
- Transformation:
- Select Properties
- Mapping
- Delivery:
- Table
When you create a pipeline, the Data Object and Table activities are automatically added to the modeler canvas.
These pipeline activities are placed on the canvas by default:
- Subscription: Data Object
Used for subscribing to incoming events for an object name from the Data Catalog.
- Table
Used for selecting the database table and the load behavior type.
With these activities configured correctly, you can run the pipeline to start processing incoming events.
You can optionally add these activities to the canvas:
- Select Properties
Used to select object properties to stream to the destination table.
- Mapping
Used to map object properties to the destination table columns.