Destination Improvement: Support for partitions in the delta tables landed.
AnsweredTables generated by Fivetran in databricks destination lack partitioning when the data is dumped.
Due to which the query performance to tables will degrade as the size of table increases.
Support for partitions on some fields like day would help alleviate this performance degradation.
-
Official comment
Hi Aaditya,
Thank you so much for taking the time to share your suggestion to support partitions in the delta tables landed Managed Data Lake Service. We greatly appreciate your input—this is a valuable idea that could potentially improve performance and manageability for many of our users.
I've added your request to our feature improvements backlog for review and prioritization.
We’ll keep the community updated on this thread with any progress or news regarding this feature.
Thank you again for your contribution!
Best regards,
Casey Karst
Please sign in to leave a comment.
Comments
1 comment