Processing records

Property record separator

Use the property Record Separator to define a character sequence that constitutes the record separator. You must give a record separator. You can use escape sequences for string literals in the same way as when you hard code a string in Java. To define carriage return line feed, more commonly called newline, as the record separator you can specify the value \r\n.

See String literals.

Property max record length

Use the property Max Record Length to define the maximum number of characters a record can contain, including the record separator. This is also the buffer size when reading the input file. You must not set this to a low value. However, a high value works but there may be a somewhat higher memory consumption for large files.

The record sent to the Strip/Replacement steps includes the record separator at the end. If the record separator is not found all currently red characters are assumed to constitute the last record in the file, without a record separator. This record is also processed by the Strip/Replacement steps. If there are additional characters in the input file they are not read, and not written to the output file.

A warning log message that the file is truncated is given in this case. To avoid this error, it is important to set the correct record separator and max record length.