Creating a delimited data format

To create a new data format for a delimited file:

  1. Open Format Designer.
  2. Click Create new data format.
  3. Complete this general information:
    Format Type
    Select Delimited.
    Name
    Specify a unique name for the new data format.
    Description
    Optionally, specify a description for the new data format.
  4. Click the TML Details tab.
  5. Complete this configuration information:
    Initial lines to ignore
    The number of lines to ignore at the start of the external file. The default is 0.
    Field Separator
    The character used to separate fields in the delimited file. Select from:
    • Comma
    • Space
    • Tab
    • Windows New Line
    • Unix New Line
    • Other

      Use to identify a specific character as the field separator, for example, ';' semi-colon.

    The default value is comma.

    Record Separator
    The type of separator used at the end of each record in the external file. Select from:
    • Windows New Line
    • Unix New Line
    • Other

      Specify a parameter as the record separator, for example, \t for tab.

    The default separator is Windows New Line. It is displayed in the script as record-sep="\r\n". That is, carriage return and new line.

    Field Separator required at end
    Select if the end of the line is identified by a specific character.
    File contains column headings
    Select if the first line in the external file contains column headings (or field names). This is counted after the number of lines to be ignored.
    Note: All files being imported must be in UTF-8 format.
  6. Specify the fields included in the format:
    1. Click the Upload a File browse button to import existing field names from an example file. The field names are extracted and inserted into the rows, replacing any field names you have already defined.
    2. Click the '+' button to add a new field. The default value is New item. Overwrite with your specified field name.
      Note: These must conform to XML syntax. For example, field names must not start with numeric characters. Field names must also be unique within the field set.
    3. Click the edit button to rename an existing field.
    4. Click the up and down arrows to change field positions. Or, you can click and drag a field to the desired position.
    5. Click the delete button to remove an existing field.
  7. Optionally, click the Script tab to create or edit a format in text view.
    Note: The script must form valid XML.
  8. Click Save Format.
Parent topic: Transformations in Transformation language (TML)