Performing initial load

  1. Select Administration Tools > Data Lake Publisher.
  2. Open the Initial Load:
    1. Click the Initial Load tab to open the Select tables subtab. Available table groups are displayed in the Select Tables for Initial Load section, including the defined table groups and the default table group.
      Note: If new table groups or tables are required, you must click the Refresh icon after modifying the table group structure on the Tables tab.
    2. Click + to expand the table group and view its tables. You can filter on both table group names and table names.
    3. To show the table row count for all companies and divisions in the M3 database in the Total Row Count column, select the check box for the table.
    4. To show the initial load history on the History subtab, click the History icon for the table.
    5. Continue selecting tables by clicking the Select Tables subtab.
  3. Select tables:
    1. On the Select Tables subtab, select table groups or individual tables.
      Note: If a table is defined in several table groups, all occurrences are selected. Initial load is done per table instead of table group.
      The current row count in the M3 database is retrieved and displayed after selection.
    2. Clear the check boxes for tables within groups as necessary.
    3. Click the History icon to view the initial load history for each table.
  4. Set conditions:
    1. On the Select Tables subtab, specify this information in the Conditions for selected tables section:
      Company
      Specify the company number.
      Note: Although there is no validation for this field, the initial load job for the table fails if an invalid company number is specified.
      Division
      Optionally, specify the division number. You can use this field when a company number is specified and at least one of the selected tables has the division column in the primary key. You can then filter on division for all selected tables having this column. If some of the selected tables do not support division, an alert symbol is displayed. You can see which selected tables do not support division by hovering over the alert symbol. There is no condition on division for these tables, even if you give a condition in this field.
      Note: Although there is no validation for this field, records are not loaded for selected tables supporting division if an invalid division is specified.
      From Date
      Use this field if all selected tables have the timestamp column (LMTS).
      If some of the selected tables do not support timestamp, an alert symbol is displayed. You can see which selected tables do not support timestamp by hovering over the alert symbol.
      To Date
      Use this field if you select a value in the From Date field.
  5. Start the Initial Load:
    1. On the Select Tables subtab, click Start Initial Load to start initial load jobs for all selected tables.
      Note: To enable this button, specify at least the company number.
    2. To see the real-time status for all queued and running initial load jobs, click the Progress subtab.
    3. To continue selecting and starting initial load jobs for initial load of additional tables, click the Select Tables subtab.
  6. Monitor progress and results:
    1. Click the Progress subtab.
      This subtab is automatically refreshed to show real-time information about ongoing initial load jobs.
    2. View this information:
      Submitted
      The time when the Start Initial Load is clicked.
      Table
      Table name and description.
      Status
      These statuses are available:
      • Waiting: The job is not yet submitted to EVS002MI.
        Note: There is a maximum of five concurrent jobs. If there already are five running jobs, the status is Waiting until a new job is started.
      • Queued: The job is already submitted to EVS002MI, but the batch job is not started yet.
      • Running: The job is running. When the job is either completed or failed, it is removed from this subtab. Click the History subtab to see the result of the job.
      Cancel
      Click this button to cancel jobs containing status Waiting or Queued.
      Note: If you cancel a queued job, the job can still finish but it is not monitored here.
      Company
      The company number specified on the Select Tables subtab.
      Division
      The condition on division, if specified on the Select Tables subtab.
      Note: If the table does not support division, the column is blank.
      From Date
      The given condition on from date, if specified on the Select Tables subtab.
      To Date
      The given condition on to date, if specified on the Select Tables subtab.
    3. To cancel all currently waiting jobs, click Cancel Waiting Jobs.
  7. Review history:
    1. Click the History subtab.
      This subtab shows all finished initial load jobs. This information helps to identify what was loaded into Data Fabric and stored in Data Lake.
      Note: A maximum of 10 history records are stored per table.
    2. View this information:
      End Time
      The time when the initial load job ended.
      Duration
      This value shows how long the initial load job took.
      Table
      Table name and description.
      Row Count
      Number of rows loaded. Row count is normally not shown for failed jobs. If the '?' icon is displayed, the row count is unknown.
      Status
      These statuses are available:
      • Completed: The job is successfully completed.
      • Failed: The job has failed. Hover over the status to see the error message from EVS002MI.
      Restart
      Click the icon to restart jobs containing status Failed. A new job is created, having the same conditions for company, division, from date, and to date. There is a separate history record for the restarted job.
      Company
      The company number specified on the Select Tables subtab.
      Division
      The given condition on division, if specified on the Select Tables subtab.
      Note: The column is blank if the table does not support division.
      From Date
      The given condition on from date, if specified on the Select Tables subtab.
      To Date
      The given condition on to date, if specified on the Select Tables subtab.