Importing data from Infor Data Lake

You can upload delimited files from Data Lake. These are the supported file formats:

  • csv: comma-separated values
  • dsv: delimiter-separated values, using a custom delimiter
  • NDJSON: newline delimited JSON

See the Infor ION Development Guide - Cloud Edition for information on Data Lake APIs, Data Catalog, and the JDBC driver.

To import data from Data Lake:

  1. On the Overview page, click Create new.
  2. Select Infor Data Lake.
  3. Specify a name for the dataset. These are the valid characters: A-Za-z0-9@#$&:[]-`.+, "s_
  4. Optionally, specify a description.
  5. Select the data import method:
    • Filter: choose and upload by document name from Data Lake repository. Specify a date range.
    • SQL Query: Load data from Data Lake by specifying a query and mocking the execution of a query.
  6. Click Preview to display the first 100 rows of the selected dataset.
  7. Go to the Metadata section to view the columns of the file.
    The header and data type are automatically defined based on the definitions in the data catalog. You cannot edit the metadata in this section.
    You can edit the metadata when you are building the quest. To edit the metadata, select the Edit Metadata activity from the Prepare Data catalog.
  8. Click Save.
  9. Click Load Data.
    The data is converted into a usable format for further processing.
  10. Select Statistics to view statistics for the loaded dataset.