Step 1 Table input

  1. On a new transformation, drag and drop a Table Input stage, from the Design - Stage menu.
  2. Link these stages by pressing SHIFT and clicking the Table Input step. Draw a line towards the Data Lake Input stage. See this diagram:

    Ensure that the first time the transformation is created, the link between “Table Input” and “Data Lake Input” stage is NOT active or is DISABLED. This is to avoid that the operation ends up in an SQL error at the Staging Upsert level.

    ../images/image3.png
  3. Within the Table Input stage, specify this SQL statement:
    Select CASE WHEN MAX(dlDocumentDate) IS NULL THEN ' 1900-01-01T00:00:00.000Z ' ELSE MAX(dlDocumentDate) END as queryDlDocumentDate FROM <table name>