DataTranslator Set Record Limit error

M3 DataTranslator is cached through the IEC database to enable fetching of records consistently between DataTranslation changes.

Data translations are always bi-directional in IEC. The default limit for data translations is set to 20,000 records.

If you have defined more than the allowed limit in M3, then an error is logged in the IEC log during the reload process.

Because the data translation reload is not disruptive to message processing, any messages are not blocked from processing.

Note: Not all of the data is fetched if the records from the DataTranslation in BE is greater than the limit value. Translation messages fail because not all of the data is in the cache.
These properties control the record limits:
  • DataTranslator.SetLstMaxRec: Controls how many records are loaded from M3 into the in-memory cache during reload. This applies in both Basic and Flexible Cache modes. The default value is 20,000.
  • DataTranslator.SetLstMaxRec.Upper.Limit: Applies when Flexible Cache is enabled. Controls how many records are fetched from M3 and persisted to the IEC database. On a cache miss, records not loaded into memory are looked up from the IEC database on demand. The default value is 100,000.

If M3 contains more records than the active fetch limit, fetching stops and a warning is logged. When Flexible Cache is disabled, this warning is also displayed on the DataTranslator administration page.

Records beyond the limit are not fetched and not available for translation at runtime.