Destination Improvement: Sync Column Comments to Databricks
Answered
We have a couple MySQL and Oracle SQL Databases connected.
The columns are commented in the source system and Databricks also supports comments. It would be great to get these comments synced as well.
Currently we have a small script fetching the comments from the source system and altering the table periodically, it would be great if that happens automatically.
-
Official comment
Hello Casimir,
Thank you for taking the time to share your request to sync column comments to Databricks as part of our destination improvements. We appreciate your feedback—this is a valuable idea that could help enhance data context and usability in Databricks environments.
I’ve added your suggestion to our feature improvements backlog for the team to review and prioritize. To help us better understand your needs, could you share a bit more about your use case and the problem you are trying to solve by syncing column comments? For example, are there specific workflows or downstream processes that rely on having column descriptions in Databricks?
We’ll keep you and the community updated on this thread as we make progress. Thank you again for helping us improve Fivetran!
Best regards,
Egidio Terra -
We have a couple source systems where the comments are crucial metadata we need in downstream applications / analytics, as the column names aren't always self-explanatory.
At the moment, we have to build a separate pipeline to extract the comments from the source and apply them to the target.
Please sign in to leave a comment.
Comments
2 comments