Configuring Data Loader

Data Loader is a preview feature. Preview features are early releases for new functionality, where the solution may not be complete for all business cases. This feature is not visible by default. To switch the preview feature on, select Configuration > ION Service > Preview features.

You can use the feature in a production environment if the provided functionality is sufficient for your situation or try it out on a development or test tenant.

  1. In ION, select Connect > Data Loader.
  2. Click Add.
    The new data loader is created and the Model tab and Connection tab are shown.
  3. Specify this information:
    Name
    Specify a name for the Data Loader run. The Name field is disabled if at least one data loader run was triggered. The Data Loader cannot be renamed after that.
    Description
    Add a description. This field is optional.
  4. Select the Connection Point.
    Database connection points of Data Loader type are listed only.
    1. To view the details of the selected Connection Point, click Details.
    2. To create a new Connection Point, click New.
  5. Define Parallel Connections in a range of 1-5.
    The field controls the (maximum) number of database connections that the data loader uses simultaneously.
  6. Select the Continue processing other documents if one fails check box.
    If this check box is selected, when the process fails for some documents, then the processing of subsequent documents still continues.

    If this check box is cleared, when the process fails for some documents, then the whole run is stopped and fails.

  7. Specify the Maximum Retry Time of Connection Fails (Minutes).

    This field controls how many minutes to keep retrying in case the connection, to the database, between location and Cloud or to Data Lake, fails. After the maximum retry time the run is stopped and fails.

    During the time when connection is not available, the run status is changed to Retrying.

  8. Click the Documents tab.

    The page for document selection is shown. In the list of Available documents, the documents with defined data source in object schema are only shown.

    For more information about data sources, see Metadata Crawler wizard.

  9. Select the Hide documents derived from other connection point check box.

    If this check box is selected, then a list of available documents is filtered. It shows documents with the “data source” field matching the name of a connection point that is selected in the Connection tab.

    If this check box is cleared, then no additional filtering is applied.

  10. Use the search and filter capabilities to find the item, or set of items, you are looking for. Click an item to select it.

    To move items over to the Selected Tables and Views list, perform one of these actions:

    • Double-click an item in the list.
    • Drag one or more selected items from one list to the other by hovering over the drag icon of a selected item.
    • Click the right-facing arrow at the top of the list to move all selected items.

    To select or clear all items in the list, press Ctrl + a on your keyboard.

    To select a range of items, click the first item to select. Hold down the Shift key and select the last item you want to select. Those two items, plus all items in between, are now selected.

  11. All documents in the Selected Documents column are ready to use by Data Loader.
  12. Click Save.
    Validations are executed. Relevant errors or warnings are shown in the Notifications section.