Extracting Data from Marketo

Prior to extracting data from Marketo objects using the Marketo Connector, see the overview information at Marketo Connector.

To extract data from Marketo

On the Home page select a space or create a new one. This is the space to which the data will be uploaded.

  1. Go to Admin - Define Sources - Application Connectors. Alternatively, click the Use Extractors link on the Admin Navigation page.
  2. Click New in the Connections panel.
  3. In Connection Details name the connection.
  4. Select Marketo as the Connector Type.
  5. Set the Connector API Version.
    • For a REST Connection: Select REST. The Infor Team recommends REST.
    • For a SOAP Connection:
      • For new spaces, select the latest SOAP API version (highest version number). 
      • For existing spaces, test the latest API version before changing from the default API version to the latest API version.
        Birst determines which version is the default. If the selected API version is no longer available in Birst, the default API version will be automatically assigned. If the default API version is selected, when Birst changes to a new API version as the default, existing spaces will be automatically upgraded to the new default API version.
  6. Enter your Marketo access and login information.
    • For a REST Connection: Enter the Endpoint, Client ID, and Client Secret.
      • To find the Endpoint, log in to Marketo as the REST API user and select Admin - Web Services - Integration. Copy the URL, without the /rest at the end, to Birst.
      • To find the Client ID and Secret, log in to Marketo as the REST API user and select Admin - Integration - Launch Point.
    • For a SOAP Connection: Enter the User ID, Encryption Key, and SOAP Endpoint.
      To find your User ID, Encryption Key, and SOAP Endpoint, log in to Marketo and select Admin - Integration - SOAP API. The information will be displayed on this page. For SOAP Endpoint, copy only the first part of the URL ending in .com. For example, if the SOAP Endpoint is https://074-UIN-407.mktoapi.com/soap/mktows/2_1, only copy and paste this part into Birst: https://074-UIN-407.mktoapi.com.
  7. Enter a Source File Prefix. This is used to avoid conflicts with other sources that have the same name. For example, if you extract an object called Lead from Salesforce and want to extract an object called Lead from Marketo as well, you could add the prefix MKT in this field. The source will be named MKT_Lead in Manage Sources to distinguish it from the Lead source from Salesforce.
  8. Click Test Connection to confirm the connection between Birst and the Marketo account.
  9. Click Save Connection.
  10. Add an object.
    • For a REST Connection:  
    1. In the Data Sources panel click Add Object.
    2. Enter the Object Name from Marketo or select one from the menu.
    3. Enter the Object Label to use in Birst. Do not use the same name as an existing saved object or an object in the catalog.
      If you edit an object and change the object label, a new object will be created with this name.
    4. Click Get Columns to populate the Columns and Mapping fields.
      The Columns field contains each of the columns in the source separated by commas, and uses the "technical name" from Marketo. The Mapping field contains the name of each column in the source, an equal sign, then the name it will be mapped to in Birst. By default the Mapping field is the "friendly name" from Marketo.


      Edit the Columns field to specify only the columns you need for reporting by deleting ones you don't need.  
    5. Edit the Mapping field list so that it contains only the mappings for the columns in the Columns field.
    6. Optionally, change the name of the column in Birst by changing the name after the equal sign.  
      Important: Do not modify the =true or =false texts.
      Tip: Once you change a column name in the Mapping field, and Birst extracts the column and lists it in the Columns tab of the Manage Sources page, you cannot change it again. If you change the column name in the Mapping field again, then extract again, the column name in Birst will not be changed. You can change the Mapping field column name in the Columns tab of Manage Sources, if necessary.
    7. Enter the Selection Criteria that will filter the result set. Selection Criteria are case-sensitive.
      The following table lists the supported objects and their Selection Criteria. Some objects require a specific Selection Criteria and others do not, as noted in the table.
    8. Marketo ObjectSelection Criteria OptionsExample Syntax
      Activity

      activityStartDate

      This criteria is required for the Activity object.

      See the Marketo documentation for valid date formats.

      		activityStartDate=2014-10-06T13:22:17-08:00
       

      listId

      Only one listID is supported.

      		listId=1
       

      activityEndDate

      See the Marketo documentation for valid date formats.

      When you select activityEndDate, the connector also always gets the activityDate column.

      		activityEndDate=2014-10-09T10:00:10-08:00
       multiple criteria must be separated with the And operator (&)listId=1 & activityStartDate=2014-10-06T13:22:17-08:00 & activityEndDate=2014-10-09T10:00:10-08:00
      Campaign

      id

      See the Marketo documentation Get Multiple Campaigns.

      		id=1,2,3,15
       name 
       programNameprogramName=Email
       workspaceName 
      Email

      status

      Valid values are either "approved" or "draft".

      See the Marketo documentation Get Emails.

      		status=approved
      Lead

      Filter Type

      See the Marketo documentation Get Multiple Leads by Filter Type.

      		id=1,2,3,4
       

      LeadID

      Tip: If the column list is large and the URL size becomes larger than 8kb, the request does not succeed and Marketo API returns a -1 response code.

      See the Marketo documentation Get Lead by Id.

      		LeadID=1,2
       

      ListID or ListIDs

      See the Marketo documentation Get Multiple Leads by List Id.

      		ListID=1001,1003,1110
       

      ProgramID

      See the Marketo documentation Get Multiple Leads by Program Id.

      		ProgramID=1001,10,12,360
      Program

      status

      Valid values are either "on", "off", or "unlocked".

      See the Marketo documentation Browse Programs.

      		status=on
    1. Click Validate to validate the syntax. 
    2. Click Save. Birst adds it to the list of objects to be extracted in the Data Sources table, ready for extraction. 
  • For a SOAP Connection: A list of available Marketo data objects displays in the Data Sources panel. If you have imported objects before, the objects you selected last time will be displayed.
    1. In the Data Sources panel click Add Object.
    2. Follow the instructions at Adding a Source Based on a Marketo Object.
  1. Optionally, in the Data Sources panel Extract Groups field, enter the name of one or more existing extract groups, separated by commas. See Creating Extract Groups if you need to create new extract groups. Create an extract group for each object so that specific objects can be extracted and processed separately from others. Click the Save button after adding extract groups.
    Tip: To remove an object from the extraction list, click the icon in the Remove column on the right.
  2. Click Extract to upload the selected objects to Birst. If you have extract groups defined, you will be prompted to select the extract group(s) to use.
    Selecting All in the Extract Group dialog box will extract all selected objects, even those that do not belong to extract groups.
  3. Depending on the size of the data objects, the extraction may take a few minutes. You can safely log out of Birst while the extraction takes place and log back in later.
    Tip: To cancel the extraction, click the Cancel Extract link under the progress bar.
  4. When the extraction is finished, in the Show Selected Objects view, the objects you extracted will be displayed in the Data Sources table with an updated date and time under Last Updated.
    Tip: Click the Last Extract Log link to view the logs from the data extraction and check for errors.
  5. Use the Manage Sources page to view the columns and raw data from the extracted objects.
    Tip: Some Marketo Activity columns have attributes. These attributes are added as columns in Birst. For this reason, extra columns will be displayed in the Columns tab on the Manage Sources page for some Activity sources which are not displayed in the Columns field of the New Object dialog box when the columns are retrieved by clicking Get Columns.

Note: A Marketo column label containing a character such as a comma (,) or equal sign (=) may cause the extract object validation to fail. The recommended approach is to change the label by replacing these characters before saving.

Next Steps

When you are ready to process the extracted data, go to the Process New Data page under the Process Data tab.

See Adding a Source Based on a Marketo Object to provide selection criteria for an incremental extract using a specific date or a Birst variable.

To schedule extractions from Marketo, use the Schedule Data Processing page under the Process Data tab.

See Also
Adding a Source Based on a Marketo Object
Scheduling Extraction and Data Processing for Cloud Applications
Setting up Incremental Extracts from Marketo
Processing Data