Import Data Lake

Import Data Lake imports the Data Lake data using Compass Query. Import Data Lake is now updated to use Compass V2 API and support both identity and compressed format. In Compass V2 API, you can get up to 100,000 rows or 10 MB, which results in a compressed format. See Infor Data Fabric User Guide for more details about using Compass Queries.

This feature is configured in Data Administration > DB Settings > Subsystem ID then select 44 - DataLake. This will enable or disable the new and old behavior of Import Data Lake. The default configuration settings is set to CompassV2. See DB Settings.

You can also run the data from Data Lake through Workflows, see Creating a workflow.

You can save the output as a CSV file or a database table on the selected version.

Import Data Lake can support compressed and uncompressed payloads.

Before importing, verify that these tasks are met:

  • From the menu, select Setup > Settings > Data, ensure that Activate Import/Export is selected.
  • From the menu, select Setup > Settings > Data > M3 Interface > REST and click Activate Import Data Lake. See Defining REST M3 Interface Settings.

You can also refer to the Infor ION Development Guide - Cloud Edition documentation for the full details on where to find information and get more details on specific functionalities.

Follow these steps to import the Data Lake data.

  1. From the menu, select Version > Import > Import Data Lake or Actions > Import Data Lake.
    The Import Data Lake dialog box is displayed.
    Note: You can only access Import Data Lake from the Actions menu in Version Control.
  2. On the Configuration section, specify the configuration name.
  3. On the Options section, select a list separator option from the list.
  4. On the Output section, specify this information:
    Type
    Select an output type from the list. You can select Database Table or CSV file output.
    Folder/File Name
    Specify the folder or file name for the output.
    Reset Table
    Optionally, select the check box to create a new database table regardless if it is existing. If cleared, it will add the data.
  5. On the Input section, click Test to test the data lake consumption.
    A list of at least ten data lake data is displayed.