Using the batch ingestion API
This service enables applications to write data objects directly to storage. It allows applications to produce larger payload sizes that can otherwise exceed throughput limitations in ION.
When using the API, you must include the name of the data object and the logical ID of the by the source application
Logical ID is the unique identifier of the source that is using the Ingestion API to ingest data in When using the API, you must include the name of the data object and the logical ID of the source application sending the data. Data Lake. The Logical ID is used to identify the data objects source in Atlas and to filter by source when extracting data with the data object retrieval API. To define batch ingestion API in Infor ION API and to set up Logical ID:
- Use the <provider>.<part2>.<part3> format
- Logical ID is self-explanatory, you can specify a logical way for your organization to
understand where the data came from. For example:
- Specify the company name in the <provider> field.
- Specify the name of the source application or product in the <part2> field. And,
- Use the <part3> field to further describe the source. For example it can contain an identifier of an applications instance.
Do not use Infor in the provider field or in other parts of Logical ID. It is reserved for Infor applications only.
For statistics or troubleshooting, we recommend that you include this information:
- The decompressed size of the file
- The instance count – the number of records in the file
- The source publication date – the date and time of when the data object was published by the source application
For sending archived data to Data Lake you must provide that the archived property is set to true. All the records included in archived object must be archived too.
This table shows the batch Ingestion API with the quota policy implemented per tenant:
Method | Calls |
---|---|
POST/dataobjects | Up to 200 per minute |
How to use the API, see the Swagger documentation for the endpoint in the ION API suite for Infor Data Fabric.
The source publication date – the date and time of when the data object was publishedHow to use ION APIs and how to interact with Swagger documentation for the API methods, see Infor ION API Administration Guide.