Configuring multi-threading for exporting large CSV files

Very large CSV files can be configured to run through multiple threads for an export.

System administrators who are familiar with the concept of multi-threading can can perform the configuration described in this section. If an administrative user has been given the ability to configure multi-threading for exporting very large CSV files, they will do so from the Advanced tab of the Export to CSV action.

This topic describes only the multi-threading feature of Export to CSV. Complete details about using the action are in Exporting a list to CSV.

Enabling the Multi-thread Export to CSV configurable feature for a user role

The Advanced tab displays on the Export to CSV actions for users who been assigned a role that has the "Multithreaded Export to CSV" configurable feature. (This feature is on the Data column of the Configurable Features page.) For information about how to enable a configurable feature, see Update security roles for Configurable Features.

Configuring multi-threading for exporting large CSV files

Multi-threading is a type of record processing that enables very large files to be processed much more quickly than they normally would be. This is because records in each "thread," or group, are processed simultaneoulsy.

There is a downside to multi-threading. Records cannot be sorted in the export file even if they had been sorted in the application database. You can use a tool like Excel to sort the records after they have been exported.

Configuration for exporting a CSV file through multi-threading is performed on the Advanced tab. Export to CSV Advanced tab options

Based on the list you have selected for exporting, Landmark suggests a field to be used as the Multi-Thread field and also suggests a number of threads.

In the example:
  • The list, Achivement Roles, is selected for export.
  • Unique ID is the report field suggested by Landmark to be the Multi-Thread field. If more than one field is suggested, it will be available from a drop-down list. You are not required to select one of the suggested fields. You can search for and any field from the list.
  • "2" is the number of threads Landmark has suggested in this example. You can increase the number.