Connector Improvement: SFTP Connector support support Header renames
Answered
I have another dumb vendor who put "" as a name in the Header line of a file. That "" column shows up in Fivetran Schema but does not show up in Databricks at all.
One option is to randomize a column name for "" headers, the second more sophisticated option is to allow me to rename headers in Schema tab.
-
Official comment
Hi Tim,
Thank you for filing this request! Column renaming is currently in development and, once released, will allow you to rename headers directly in the Schema tab. While we don’t have an exact release date yet, we’ll keep this thread updated as we make progress.
In the meantime, would a workaround of ingesting the file as "headerless" and then removing the extra header row in a downstream transformation work for you?
Best,
Parmeet -
Sadly the file has hundreds of columns so it would be onerous to manage in that way. Any ETA? Is it weeks or months?
Please sign in to leave a comment.
Comments
2 comments