Select Properties activity

In stream pipeline modeling, the Select Properties activity enables users to define which data object properties are streamed. This helps avoid unnecessary column and data streaming, which can cause inefficiencies, increased use of resource, and higher costs.

The Select Properties activity enables precise control over which data object properties are processed by a pipeline. This ensures that only relevant data is transferred, which streamlines the data flow and enhances performance and clarity. Selecting only the required properties allows customization of table structures to meet specific requirements.

The Select Properties activity also supports the management of object schema changes by preventing automatic streaming of newly added properties. This allows users to control when and if to include such properties.

Without the Select Properties activity, all fields that are defined in the source application tables are streamed to the destination. Consequently, each column in the source table is replicated in the destination table.

You can add the Select Properties activity to the model by dragging the Transformation category from the activity bar or by selecting a position in the model. When you click an empty activity position on the canvas, the Activity Catalog is displayed and you can select the needed activity.

To configure the Select Properties activity, perform these steps:

  1. Click the Select Properties activity to expand the right panel.
  2. On the panel, select the check boxes of the properties to stream.
    Note: When you add the Select Properties activity to the model, all property check boxes are selected by default. If you add new properties to the object schema, they are not selected by default in the existing Select properties activity and must be selected manually.

    To find the needed properties, you can search for them in the columns and use the column sorting and filtering options.

    To select or clear all check boxes, click the three-dot icon and select Select all or Deselect all, respectively.
  3. To close the panel, click Close.
  4. Click Save.