WHERE

Use a WHERE clause to specify filter conditions on which to base the results. Most Compass queries should include a WHERE clause to limit the query results.

Queries executed through the Data Lake Compass API endpoint do not limit query results. Therefore, a query, by default, returns all data.

Data Lake can be used as a source of data to populate a data warehouse or a data store. It is common to use initial load and incremental load logic. The initial load retrieves all data from Data Lake. Subsequent queries retrieve incremental data, or data loaded since the last extract. You can use the lastmodified timestamp on the WHERE clause of queries to retrieve incremental data.

See Queries for incremental data loads.