Performance tips and hints
To get the best performance from the Data Loader use as many of these tips as possible.
- Clear the Update Submission Status check box if it is not needed. This could potentially save a lot network traffic and time. This can be done by deselecting the Update Submission Status check box in the Data Loader or by setting the third parameter in SetOptions to zero in the sample script.
- Use the
#All_Checks=offoption in the configuration file to avoid unnecessary data checks. For more information, see "All_Checks". - Specify the
Commit_Bufferoption in the configuration file to match your relational database product's rollback segment size. For more information, seeCommit_Buffer. - Although the relational database management system might allow you to specify an option to grow the rollback segment on demand, excessive disk activities on the relational database management system will slow down the loading. The default value for this option is 10000, which should work for the default setting for your relational database management system under normal condition. If you increase your relational database management system rollback segment size, you can increase this setting, as well.
- Set the
Loading_Modeoption in the configuration file as appropriate. For more information, see Loading_Mode.- Use
#Loading_Mode=Insert_Only_Arrayif you use Microsoft SQL and you are inserting new records into your fact table. Do not use this option if you are not sure that the records are new. - Use
#Loading_Mode=Insert_Onlyif you are inserting new records into your fact table and you are unsure if the records are valid.
- Use