Connector Improvement: prevent Fivetran from automatically changing Schema in Destination Table
We have an issue with Amazon S3 connector, we have a file in the S3 bucket that is updated everyday manually and it's pulled to BigQuery Table via S3 Connector, in the file we have a field named date if someone enters date in m/d/y format the connector loads data into table as string datatype, whereas if it's in yyyy-mm-dd format it loads as Date.
Is there a way to prevent Fivetran from automatically changing Schema in Destination Table, we expect the sync to fail if there is any change to schema of existing fields.
-
Official comment
Hi Raghuprasanth,
Thank you for sharing this feature request and the detailed description of the problem. Its not just going to be simple to resolve as the automatic data type detection that will need to be modified for this is a core and valuable offering on Fivetran in most cases. We will start to think about ways we can solve this problem while avoiding the need to define every columns' data type.
Best Regards
Alison
Please sign in to leave a comment.
Comments
1 comment