Connector Improvement: GDrive - Merge Mode - With Table Schema Insensitive Case
AnsweredThe Tables Schema in most of the connectors or if not others but CSV or flat files, should have option to declare the schema/column name sensitivity.
Recently while making GDrive Merge Mode CSV connector we observed it created 2 columns for same column ex. Customer ID and CUSTOMER ID.
These both pertain to the same column as the name suggest but varies in the naming sensitivity but would cause problems in downstream pipelines it created new columns and ingest data in new columns.
-
Official comment
Hi Lalchand,
Thank you for raising the request. Are the columns Customer ID and CUSTOMER ID, in the same file or are they in 2 separate files being ingested to the same table?
Thank you,
Parmeet -
Hi Parmeet,
It would be different files and ingesting to the same table.
Thank you!
Lal
Please sign in to leave a comment.
Comments
2 comments