Fivetran allows you to upload a spreadsheet, in CSV format, to your destination. You can upload it directly through your browser on Fivetran’s Dashboard.
NOTE: This feature is only available for accounts created before April 9, 2021.
|Custom Data||check||All tables and fields|
Supported file formatslink
We currently only support uploading CSV files.
We support the following encodings for uploaded files:
- UTF-16 (big and little endian)
- UTF-32 (big and little endian)
If there is an important type that we are missing that you need, please reach out to support.
We recommend using our CSV uploader for more ad hoc file uploading directly into your destination from your browser.
File upload connections occur at the table level. Each different connection that is created within Fivetran (shown below in the blue connection icon circle) creates an upload path within your Fivetran account. Any CSVs posted to that path will be added to a single destination table inside of whichever schema you specify in the UI at time of connection. You can add multiple tables to a single schema. All Fivetran uploads are push integrations (you are manually uploading each file).
All internally created CSVs are deleted after 24 hours. All of our import S3 buckets have expiration action with a lifecycle of 24 hours, at which point Amazon permanently removes them. Fivetran follows Amazon’s Object Expiration system.
Follow our step-by-step Browser Upload setup guide upload CSVs to Fivetran.
You can decide the name of a schema in the initial stages of the setup in Fivetran’s dashboard. When filling in the name section, you have two options:
- Create a new schema - If you want to create a new schema, please fill in a schema name which you have not used for any other integration.
- Add the file to an existing schema - If you want to add the file to an existing schema, simply fill in the name of the schema you’d like to add it to.
Type transformations and mappinglink
Regardless of your column’s data type, Fivetran gives you the option to change it to the following data types:
- check mark symbol is a boolean of type true/ false
- Tt symbol is a variable data type
- # symbol is a numeric data type
- $ symbol denotes a numeric data type column appended with a $ sign. If you select $ symbol for a column, then we will remove the $ sign from the incoming column with $. The resulting column in your destination will be a numeric data type. However if your incoming data has $ in its values and you select the column type to be # then it will result in an error.
Excluding source datalink
Once you upload a file you cannot limit destination access to specific rows and columns. If you wish to limit access to any rows and columns, please delete them before uploading the file to the Dashboard.
You can, however, exclude footer rows after uploading a file to the browser, so you can only exclude rows from the end of the table.
If you upload an updated version of a previously uploaded CSV and want the same changes to appear in your destination, make sure to specify the same table name and the same primary key column. Then we will perform a merge operation on the CSVs to add the new data to the existing table.
Note that if you don’t designate any primary key columns, Fivetran will automatically create two primary key columns
_file will be the name of the CSV file you are uploading and
_line will be the line number of each row in the CSV file starting with 0.
Deleting rows from the CSV and re-uploading it will not remove those rows from your destination; Fivetran’s integration method is always net-additive; we will never remove data from your destination unless we are updating a row. In order to delete rows from your destination, you must manually delete them.
For example, assume you upload a CSV ‘abc’ with 10 rows to a schema. If you decide to delete 9 rows in the CSV on your computer and then re-upload ‘abc’, your new table will still have 10 rows. If, however, you edit a row on your computer and upload the same file, we will edit the row in the table in your destination.