Exporting Data Lake

You can use the Export Data Lake feature to integrate DMP with several other services. The previous solution is to send a file to Data Lake with scripts that you run in DMP. You must specify the file information to export data to Data Lake and the Data Lake object or table to send the data.

You can access Export Data Lake in Menu > Version > Export. You can also access the feature through Actions when the version control or the workbench is active. The Export Data Lake form is used to define the configurations for the Export Data Lake. You can trigger the execution of the Export Data Lake process in workflows.

This process supports these two file types:

  • CSV/DSV files
  • NDJSON files

You can also refer to the Infor ION Development Guide - Cloud Edition documentation for the full details on where to find information and get more details on specific functionalities.

Before exporting, verify that these tasks are met:

  1. From the menu, select Setup > Settings > Data.
  2. Select Activate Import/Export.
  3. Click M3 Interface > REST, and click Activate Export Data Lake.

    See Defining REST M3 Interface Settings.

Follow these steps to export data to Data Lake.

  1. From the menu, select Version > Export > Export Data Lake or Actions > Export Data Lake.
    The Export Data Lake dialog box is displayed.
  2. On Configuration, specify this information:
    Name
    Specify the name of the file to export.
    Input Type
    Select an option from the list. You can select CSV/DSV or NDJSON. The option in the Input section change based on the selection you make.
  3. On Data Lake, specify this information:
    Data Lake Table
    Specify the Data Lake object or table where the file is going to be uploaded. You must define the target schema externally by another application or ION.
    Check Schema
    Select this to start Data Lake to get the table information and validate it exists.
  4. If you selected CSV/DSV in Input Type, specify this information:
    File Name
    Specify the path of the file where you can send to Data Lake. Specify the complete path including the file name unless the file is located inside the Data Path folder, where you can use the relative path.
    List Separator
    Specify the separator used in the CSV/DSV file that is exported to Data Lake.
    Enclosing Character
    Specify the enclosing character used for the values in the CSV/DSV file that is exported to Data Lake.
  5. If you selected NDJSON in Input Type, specify this information:
    File Name
    Specify the path of the file where you can send to Data Lake. Specify the complete path including the file name unless the file is located inside the Data Path folder, where you can use the relative path.
  6. Click the ellipsis button beside Name on Configuration.
  7. From the menu, select Data > Workflows. See Creating a workflow.
  8. Select Export Data Lake for the action.
  9. Select your saved configuration in the parameter.
  10. Click Run.