Maximize other tools when extracting from a database to a file
Using an IPA process to extract records from a database to a file is very common. Most designer processes would use a SQL query node, then a Message Builder node, then a File Access node. This configuration is acceptable however, you can use other tools to maximize the performance of IPA.
For example, you can use the source application's built-in export tools that export to a CSV or XML file, which is much faster than making web call. You can also use SQL tools such as stored procedures and SQL Command (SQLCMD) as other options to export data in bulk very quickly. Another example would be to use SQL language techniques to extract full rows of data as one record, which can be stored as one variable (instead of several) in IPA.