Amazon Simple Storage Service (Amazon S3), provides scalable cloud storage services. Fivetran supports syncing files from your S3 bucket to your destination.
Featureslink
| Feature Name | Supported | Notes |
|---|---|---|
| Capture deletes | ||
| Custom data | check | All tables and fields |
| Data blocking | check | Column level |
| Column hashing | check | |
| Re-sync | check | Connector level |
| History | ||
| API configurable | check | |
| Priority-first sync | ||
| Private networking | check | AWS PrivateLink |
| Fivetran data models |
Setup guidelink
Follow our step-by-step AWS S3 setup guide to connect AWS S3 with your destination using Fivetran connectors.
Sync notelink
We will search a small subset of your bucket, and, if no matches are found, will expand its search to the entire bucket. This can take up to several minutes.
Syncing empty columnslink
The AWS S3 connector doesn’t support the creation of empty columns in your destination.
We create a column in the destination table only if the column in your source file is not empty.
Configuration optionslink
Fivetran offers a number of configuration options in our setup form. Using these configuration options, you can select subsets of your folders, certain types of files, and more to sync only the files you need in your destination. Setting up multiple S3 connectors targeted at the same bucket, but with different options, can allow you to slice and dice a bucket any way you’d like. For more on configuration options, see our setup guide.
You can use a custom external_id parameter for authentication when creating a new AWS S3 connector with the Fivetran REST API. We use the connector’s group_id if you don’t specify the external_id parameter.
Use the List All Groups endpoint to find the connector’s group_id.
NOTE: We don’t support custom
external_idvalues for connectors created in the Fivetran dashboard. By default, we use the connector’sgroup_id.