Object metadata best practices for queryable data

It is to be expected that Data Catalog object definitions change over time. Use these best practice guidelines to ensure that object definitions are in sync with Compass data storage and query functionality.

  • Add new properties to the metadata as required.
  • Add a new property to replace an existing property, leave the deprecated property in the metadata definition.
  • Loosen constraints of existing properties, such as extending string lengths or increasing the scale and precision of decimal values. Do not tighten constraints.
  • Do not remove or rename properties.
  • Do not change the data type of an existing property. This makes old and new data incompatible. Instead, add a new property.
  • Use the identifier paths, variation path and delete indicator properties for variation handling.

See Variation handling.