Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Destination Improvement: Databricks tables need to be created with CDF enabled

Answered
Rajiv Kilaparti User

Fivetran SAAS Connector for Databricks destination, doesn't create the Staging tables with CDF enabled. CDF is a pre-requisite for our workflows.

We are also using HVR LDP, which creates the Staging tables with CDF enabled, so it is only Fivetran SAAS connector that is the exception and so we want this to be fixed / made consistent.

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Egidio Terra Fivetranner

    Hi Rajiv,

    Your goal to have Databricks staging tables created with CDF enabled is clear. Currently, the Fivetran SaaS connector does not activating CDF during table creation. However, you can achieve a similar outcome by creating the staging tables with CDF enabled manually in Databricks.

    General steps for this approach:

    1. Create the target tables in your Databricks workspace and enable CDF on these tables.

    2. Configure your Fivetran connector to use these pre-existing CDF-enabled tables as the staging area.

    More detailed instructions are available in our Help Center.

    Thanks,
    Egidio