ION content provisioning for Data Lake

In single-tenant deployments of Workforce Management, the Data Replication task sets up the Data Lake data flow and the schema objects automatically.

The Data Lake data flow is listed in Maintenance > System Administration > ION > IMS Document Flow Configuration with a Document Flow Type of DATALAKE_FLOW. You can enable or disable this data flow by editing the flow and selecting or clearing the Document Flow Enabled field.

Note: The Data Lake data flow should not be modified, renamed, deleted, or deactivated in ION Desk. If the data flow is updated, the Data Replication task will fail and the flow must be resolved manually.

The replication documents are listed in Maintenance > System Administration > ION > IMS Document Name Configuration with a Document Type of DATA REPLICATION.

When the Data Replication task is run for the first time, all the object schemas are registered with the data catalog, all replication documents in the IMS Document Name Configuration maintenance form are added to the connection point, and the Data Lake data flow is registered with ION.

If new replication documents are added, when the task runs after the Job Scheduler is restarted, the object schemas for the new documents are registered in the data catalog, the new documents are added to the connection point, and the Data Lake data flow is updated.

If the JSON of a replicated document has changed, when the task runs, the metadata for that document in the data catalog is overridden.

If registering a replication document fails, the task fails with an actionable error.

Note: Currently, you cannot configure which replication documents in the IMS Document Name Configuration maintenance form are added to the connection point. All replication documents are added or none of them are added.