Setting an earliest data inclusion date and backfilling data

Use this procedure to use the Earliest change date to include field and the Backfill data action. This example assumes the use of both the Earliest change date to include field and the Backfill data action.

  1. In the Administration Console, select Replication.
  2. In the Replication Sets pane on the Maintain tab, click Create.
  3. Specify a name for the replication set, select the export format and output destinations, and select or specify values for any optional fields. Click Save.
  4. Add one or more business classes to the replication set.

    See Creating replication sets.

    For this example process, set the Earliest change date to include field to a past date. How far back this date goes depends on how far back you want to replicate data and on how much data the business class contains. If the business class contains an extremely large amount of data, then the date should be closer to the present.

  5. Save your changes and register the replication set schema.
  6. On the Replication Sets form, select the replication set to schedule and click Replicate.
    See Starting and scheduling data replication.
  7. After the replication is complete, select the replication set again. On the Replication Sets form, click the Business Classes tab and select the business class to run the Backfill data action.
    The Backfill data action is on a business class by business class basis requiring you to select each business class individually for data backfilling.
  8. For the selected business class, click the Ellipsis button and select Backfill data.
  9. On the Backfill Data form, specify a value in only one of the two fields:
    Backfill From
    Use this field to set a date that is earlier than the currently stored value for the Earliest change date to include field. That value is displayed in a Backfill Through on the Backfill Data form. When the Backfill data action runs, the data for the business class that was modified or created in between the two dates are replicated. After the Backfill data action is complete, the backfill from date is stored as the value for a Backfill Through field that replaces the Earliest change date to include field on the business class form. This backfill option is suited for backfilling data for only one or a few time periods or maintaining a careful control of the backfilling for a business class. In this case, you must schedule the action to run only once.
    Offset Days
    The number of days before the currently stored value for the Backfill Through field to replicate data for. After the Backfill data action is complete, the Backfill Through field's value is modified to be earlier by the offset number of days. This option is suited for repeatedly running the Backfill data option for a business class, such as backfilling repeatedly for 30-day offsets until you have replicated the earliest data records. In this case, you must schedule the action to run at regular intervals. After the earliest data has been replicated in this scenario, you must disable the action request.
  10. Click Ok to run the action or click Schedule to schedule the action to run.