Export Data Lake

Export Data Lake is a feature that you can use to integrate DMP with several other services. The previous solution is to send a file to Data Lake by using scripts that you can execute in DMP. You can define the information of the file that you want to export to Data Lake and the Data Lake object or table where you want to send the data.

You can access Export Data Lake in Version > Export. You can also access the feature through Actions when Version Control or Workbench is currently active. The Export Data Lake form is only used to define the configurations for the Export Data Lake. You can trigger the execution of the Export Data Lake process using the Workflow dialog box. These two file types are supported with this process:

  • CSV/DSV files
  • Newline Delimited JSON or NDJSON files

You can also refer to the Infor ION Development Guide - Cloud Edition documentation for the full details on where to find information and get more details on specific functionalities.

Before exporting, verify that these tasks are met:

  • From the menu, select Setup > Settings > Data, ensure that Activate Import/Export is selected.
  • From the menu, select Setup > Settings > Data > M3 Interface > REST, and click Activate Export Data Lake. See Defining REST M3 Interface Settings.

Follow these steps to export to Data Lake.

  1. From the menu, select Version > Export > Export Data Lake or Actions > Export Data Lake.
    The Export Data Lake dialog box is displayed.
  2. On Configuration, specify this information:
    Name
    Specify the name of the file you want to export.
    Input Type
    Select CSV/DSV or NDJSON. The option in the Input section changes depending on your selection.
  3. On Data Lake, specify this information:
    Data Lake Table
    Specify the Data Lake object or table where the file is going to be uploaded. You must define the target schema externally by another application or ION Desk.
    Check Schema
    Click this button to call Data Lake to get the table information and validate it exists.
  4. If you selected CSV/DSV in Input Type, specify this information:
    File Name
    Specify the path of the file that you want to send to Data Lake. Specify the complete path including the file name unless the file is located inside the Data Path folder, where you can use the relative path.
    List Separator
    Specify the separator used in the CSV/DSV file that is exported to Data Lake.
    Enclosing Character
    Specify the enclosing character used for the values in the CSV/DSV file that is exported to Data Lake.
  5. If you selected NDJSON in Input Type, specify this information:
    File Name
    Specify the path of the file that you want to send to Data Lake. Specify the complete path including the file name unless the file is located inside the Data Path folder, where you can use the relative path.
  6. Save the configuration.
  7. From the menu, select Data > Workflows. See Creating a workflow.
  8. Select Export Data Lake for the action.
  9. Select your saved configuration in the parameter.
  10. Click Run.