Connector Improvement: Better handling of text case in flat file column headers
We ingest data from a variety of source systems, place them in S3 buckets, and sync those data into a warehouse using FiveTran. In one instance we download reports from Alexa Developer Console and can't control the names of columns in the downloaded .csv file. In this example, we have columns named 'TurnOn' and 'turnOn' to indicate commands a user makes to their Alexa device. Each of these columns contain values we want to retain, but Fivetran won't sync both due to the way it handles the case of the text - it sees them as duplicates. There are more instances like these where we want to ingest unadulterated data from sources that we don't have the power to change. Any enhancement that retains the case of the column header or the flexibility to choose how we want to handle this would be welcome!
-
Official comment
Hi Ben,
Thank you so much for using Fivetran and for submitting this request. Our column naming conversions are hugely valuable in many, if not most situations, although I completely understand that in this case they are causing two columns to be treaded a duplicates of each other which is bad.
Thank you for drawing our attention to the issue, I will start to investigate options to see if there is a way we can address this.
Best regards
Alison
Please sign in to leave a comment.
Comments
1 comment