Workflow log

Running the Extract and Process workflow creates entries in the Workflow Log fact table. These entries can be analyzed in Birst reports.

Regularly inspect these entries to see the workflow status and duration and to analyze trends.

This table shows the measures that are available:

Measure Description
Failed 0 means False, 1 means True. If 1, the domain has failed during extraction or processing data.
In Progress 0 means False, 1 means True. If 1, extraction or processing data is in progress for the domain.
Successful 0 means False, 1 means True. If 1, the domain has been extracted and processed successfully.

This table shows the attributes that are available:

Attribute Description Note
Content Version The LN Analytics version used when running the extract and process workflow.
Domain Filled with variable LN_usr_ExtractDomain, which has values ‘Conformed Dimensions’, ‘Foundation’, ‘Program Cost Ledger’, or ‘Quality Management’.
End Date Time Datetime when the extraction and processing of a domain in the workflow completed successfully. The date time is stored in the Processing Time Zone of the space (UTC+00:00) Monrovia, Reykjavik. When the extraction or processing failed, the value is empty.
Extract From UTC Date Time The starting datetime in UTC time zone used in the extraction. 1
Extract From UTC Date Time ISO 8601 The Extract From UTC Date Time converted into ISO 8601 format. This format is used in the extraction query to the Data Lake. 1
Extract Full Load 0 means False, 1 means True. If the value is 1, the Extract From Date Time of the extraction query is always set to variable.

LN_usr_ExtractIncrementalLoadStartUTCDateTime for incremental loads.

Extract Manual Date Times 0 means False, 1 means True. If the value is 1, the incremental loading logic was not used. Instead, the extraction period specified by the user was used.
Extract Manual From UTC Date Time The starting datetime in UTC time zone of the extraction period if incremental loading was not used.
Extract Manual To UTC Date Time The end datetime in UTC time zone of the extraction period when the incremental loading was not used.
Extract To UTC Date Time The end datetime in UTC time zone used in the extraction. 2
Extract To UTC Date Time ISO 8601 The Extract To UTC Date Time converted to ISO 8601 format. This format is used in the extraction query to the Data Lake. 2
Run Time Duration HH:mm End Date Time - Start Date Time.
Run Time Duration Minutes End Date Time - Start Date in minutes. This is not a measure as, for example, the Run Time Duration of Job Shop also contains the duration of Conformed.
Sequence Number Unique identifier.
Start Date Time Datetime when the extraction and processing of a domain in the workflow started. The date time is stored in the Processing Time Zone of the space (UTC+00:00) Monrovia, Reykjavik.
Status Unknown, In Progress, Successful, Failed.
Status Flag 0, 1, 2, 3.
Type

Initial, Incremental, Manual.

Relates to Extract Full Load and Extract Manual Date Times.

Workflow Filled with variable LN_usr_ExtractWorkflow.

  • (1) If the extraction was performed in incremental mode, the Extract From UTC Date Time is the Extract To UTC Date Time of the previous successful run (of that domain) minus three minutes for safety reasons. If the extraction was performed in manual mode, the Extract From UTC Date Time is the value of the LN_usr_ExtractManualFromUTCDateTime variable.
  • (2) If the extraction was performed in incremental mode, the Extract To UTC Date Time is the current UTC time when the extraction started. If the extraction was performed in manual mode, the Extract To UTC Date Time is the value of the LN_usr_ExtractManualToUTCDateTime variable. There is no correction if the variable value is in the future.