Data Lake activities

Use Data Lake activities to ingest, retrieve, and query data in the Data Lake.
  • Ingest to Data Lake activity: Ingest all incoming documents into the Data Lake. This activity requires no configuration.
  • Retrieve from Data Lake activity: Retrieve documents incrementally from the Data Lake.
  • Data Lake Query activity: Retrieve a specified subset of data from the Data Lake for use in a data flow.

Data Lake Query activity

Use the Data Lake Query activity to retrieve data from the Data Lake in a read-only manner for use in a data flow.

The Data Lake Query activity retrieves data that has been published to the Data Lake and returns the results for use by subsequent activities.

Use this activity to:

  • Retrieve historical or operational data stored in the Data Lake
  • Retrieve data from one or more objects through a single query
  • Supply data to downstream activities in a data flow
  • Support reporting, reconciliation, or analytical scenarios

Data Lake query editor mode

Use query editor mode to write a custom SELECT query for the Data Lake Query activity. Use this mode when you require complex filtering, aggregations, or nested query logic.

When you use query editor mode:

  • Write or update a SELECT query to retrieve data stored in the Data Lake for use in a data flow.
  • Switching from the visual modeler to query editor mode is one-way for that query definition.
  • Use the preview in the query authoring experience to validate the result set before you save the query.

For more information about query syntax and supported functionality, see Infor Data Fabric User Library and select Data Fabric > Querying the Data Lake > Query functionality and syntax.

Data Lake Query activity inputs, outputs, and limitations

Inputs

Define the data to retrieve and optional filtering criteria.

Outputs

The activity returns a structured result set for use by subsequent activities in the data flow.

Limitations

The Data Lake Query activity provides read-only access to Data Lake data.