Connector Improvement: Databricks Unity Catalog Metadata
Not plannedHello Fivetran team,
I would like to submit an Enhancement request for the Databricks connector to move system-level metadata (table definitions, column comments, tags) from Delta tables in addition to the data already being moved.
In our use-case, we're utilizing Fivetran as a bridge between our Databricks Catalog and Snowflake instance. Having matching metadata would allow us to write once and disseminate everywhere
-
Official comment
Hi Sohan,
Thank you for submitting this enhancement request.
This feature—moving system-level metadata such as table definitions, column comments, and tags from Databricks Delta tables—is not currently on our roadmap. We use customer feedback and upvotes on requests like this to gauge demand and prioritize future development. Each upvote helps to build the case for considering this improvement further. However, our Fivetran Platform Connector provides information about table definition, you can find more information here: https://fivetran.com/docs/logs/fivetran-platformTo better understand how this feature would benefit your workflow, could you share additional details about your use case, especially around how matching metadata between Databricks and Snowflake impacts your processes?
Thanks,
Egidio
Please sign in to leave a comment.
Comments
1 comment