Destination Improvement: Databricks. Enable CDF by default or by selection
AnsweredDear Fivetran team,
My company use Fivetran to ingest data on Databricks. We would like to include the possibility to have by default, or by activating it in the setup or schema areas of the Databricks destination, the option to activate delta.enableChangeDataFeed.
Documentation: Use Delta Lake change data feed on Databricks | Databricks on AWS
Seems to be not a difficult implementation and we would like to see it in your development pipeline as soon as possible.
Please, don't hesitate to reach us back for any test or preview that you would like to enable on our side.
Best
-
Official comment
Hi Miguel,
Thank you for reaching out and for putting this request together. While enabling this feature is straightforward, it can interfere with certain Databricks functionalities — for example, schema changes.
Our recommendation is for customers to enable or disable it based on the specific features they’re using, to ensure optimal compatibility and performance.
Best regards,
Please sign in to leave a comment.
Comments
1 comment