Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Implement Liquid Clustering for Databricks Delta Tables

Completed
Clayton Holderfield User

Databricks announced the Liquid Clustering feature in June 2023.  Liquid Clustering promises better query performance against delta tables than optimizing with z-order.  Liquid Clustering must be enabled at the time of table creation, so to take advantage of this feature, the Fivetran Databricks connector would have to enable this feature.

Are there any plans to implement Liquid Clustering for the Fivetran Databricks connector?

Announcing Delta Lake 3.0 with New Universal Format and Liquid Clustering | Databricks Blog

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Egidio Terra Fivetranner

    Hi Clayton and Michael,

    I’m pleased to announce that Liquid Clustering is now available with Fivetran. You can enable it by setting the cluster keys directly in Databricks.

    Best,
    Egidio

  • Michael Romero User

    This is quite huge for us as well. Considering it's the future of delta table organization, we'll drop fivetran and write our own connectors.