Amazon S3 Connector

The Amazon S3 Connector supports connecting to Amazon and extracting data files from S3 buckets. See Amazon S3.

The connector supports the following file types:

  • .accdb
  • .csv
  • .mdb
  • .txt
  • .xls or .xlsx
  • .zip or .zip64 files containing the above

Tip: You can also use Birst Connect to import S3 files, however the S3 Connector provides a more direct cloud-to-cloud connection. In addition the S3 Connector supports file concatenation.

Prerequisites

  • An Amazon AWS account and its Access Key and Secret Access Key.
  • The AWS account requires permission to get the location of the bucket, and permission to download the files in the bucket. See the AWS documentation.

Implementation and Usage Notes

  • The connector uses AWS Signature V4 authentication.
  • Get Files return the first 1000 files in the bucket matching the search criteria, in ascending alphabetical order, starting with files at the top level and then any directories.
  • Birst's Amazon S3 connector displays only 1000 files at a time but if more than 1000 files exist that match the user's search criteria, Amazon S3 extracts all the files.
  • Files uploaded using client-side encryption are not supported.
  • The plus (+) and asterisk (*) symbols do not work as wildcards in the Contains Text field for Amazon S3 Connector objects created via Auto Append

Next Steps

Extracting Data Using Amazon S3