Specifying a new action for Consuming (reading)

  1. On the Documents tab, click Add.
  2. Select the scenario Read.
  3. Select the Document from the Data Catalog .
  4. You can set the Message Settings Topic and Partition manually or use the Select Topic button.

    Click Select Topic to validate Topic and Partition(s) captured or to select from available options.

    • After you select a Topic, the Partitions list becomes available
    • You can select multiple partitions in a Read Scenario
  5. Click Test if you want to test the Topic and Partition values submitted.
  6. Specify the schedule. This time interval determines how often the statement is invoked to retrieve documents from Kafka.
  7. You can enable or disable incremental data read under the Settings section. By default, the incremental data read is enabled.

You can either specify a basic schedule where the trigger is every x seconds / minutes / hours / days, or specify and advanced schedule based on a CRON expression.