Incremental extraction

In an incremental extraction only data that has changed since the previous extraction is extracted from the ERP application. This extraction significantly reduces extraction time and extracts changes that have occurred in the data for a specified date range.

Incremental extraction is supported for the following Insights:

• Process Insight for Lawson 10.x.
• Inventory Insight for Lawson 10.x
• Process Insight for SAP, Oracle and PeopleSoft
• Process Insight for Infor Applications
• Payroll Insight for Lawson 10.x
• Authorizations Insight for SAP
  Note:  For the incremental extraction of SAP Authorizations Insight,

  • the first extraction is always a full extraction. However, if the first extraction is not completed successfully, the subsequent extractions will continue to be full extractions till the extractions are completed successfully.
  • if the first extraction is successful but one of the incremental extraction fails, the subsequent incremental extraction will pull out all the missing data since the last successful incremental extraction. In this scenario , few objects may undergo full extraction.

Provide information on the following panels to schedule an incremental extraction:

• General Information

  Provide the following information on this panel:

  1. Provide a task name to identify the extraction schedule on the Tasks and Schedules pages.

  2. Provide a description for this task.
• Scope
  1. Select a connection from the Connections drop-down list. If connections are secured, users signed into Infor Risk & Compliance will be able to view only those connections that they have access to.
  2. Select the online extraction option. The incremental extraction option will be displayed only if you select the online extraction option.
  3. From the Insight drop-down list select the required Insight.
  4. To enhance extraction performance, Infor Risk & Compliance enables you to select the objects that you want extracted. When you select specific objects, the object count is displayed in the Select Objects field. Click the Browse icon to select specific objects.
     Note:  For Process Insight for Infor, the objects RECEIVE_DLVRY_SUPP_INV_SUMMARY and SHIPMENT_BILLING_SUMMARY are not selected by default, as they belong to the internal processing tables used by the Insight. Even if you select these two objects , there will be no impact on extraction. Data would still get populated in the respective tables accordingly.
     Note:  If objects are excluded from extraction, any rules which refer to these objects will not produce any violations. Any reports that refer to these objects will also be impacted.
  5. For Authorization Insight for SAP and Process Insight for SAP, you can select filters to scope your extraction. Few filters are selected by default. You can modify the default filters.
  6. For Configuration Insight for SAP, select the check box Use two-step extraction process.
  7. Select the Incremental option.
     Note: If date fields have values older than 1/1/1900, then on offline data upload or online extraction into Infor Risk & Compliance, the values are represented as 1/1/1900.
  8. If you have selected Authorizations Insight for SAP in the Insight drop-down list, specify the number of minutes by which the extraction should be incremented.
  9. If you have selected Insights other than the Authorizations Insight for SAP in the Insight drop-down list, specify the date range for the initial extraction. The initial extraction is always a full extraction. To select a date range, click the Calendar icon in the Start and End fields.
  10. In the field Increment subsequent extractions by, specify the number of days by which extraction should be incremented. When you provide a value in this field, the Start and End fields are automatically populated.

  For example, the range for the initial or full extraction is from 12/18/2009 to 12/19/2009. Thereafter, data will be incrementally extracted every 5 days, beginning from 12/20/2009 as follows:

  • Any changes made to the data extracted from 12/18/2009 to 12/19/2009 will be updated. At the same time, a full extraction will be done for the dates 12/20/2009 - 12/24/2009.
  • During the next iteration, changes to the entire data extracted from 12/18/2009 to 12/24/2009 will be updated and a full extraction will be performed for the next 5 days.
  Note: For every iteration, the last extraction for each object is checked. If the last extraction for a particular object has failed, the current iteration will extract data for the last period as well as the current period. For example, in the above case, if the extraction for the period 12/20/2009 12/24/2009 has failed for a particular object, the next iteration for the period 12/25/2009 - 12/29/2009 will extract data for that object for the entire period 12/20/2009 - 12/29/2009.
• Schedule:

  Create a schedule for extraction as follows:

  1. On the Schedule panel, click the Calendar icon to select the Start Date and click the Clock icon to select Start Time to start the extraction schedule.
  2. From the Recurrence drop-down list, select one of the extraction recurrence options. If you select Never , the task will not recur. If you select any of the options such as Daily , Weekly , or Monthly , then you need to provide the specific day, or the week day or the specific days of the month respectively for the extraction to recur. Also set the end date of the extraction on the Set End Date panel
  3. Click Save and Close .

  The date and time selected on this page is according to the time zone defined on the Preferences page.