WHERE
Use a WHERE clause to specify filter conditions on which to base the
results. Most Compass queries should include a
WHERE clause to limit the query results.
Queries executed through the Data Lake Compass API endpoint do not limit query results. Therefore, a query, by default, returns all data.
You can use Data Lake as a source of data to populate a data
warehouse or a data store. It is common to use initial load and incremental load logic. The
initial load retrieves all data from Data Lake. Subsequent
queries retrieve incremental data, or data loaded since the last extract. You can use the
lastmodified timestamp on the WHERE clause of queries
to retrieve incremental data.
See Queries for incremental data loads.