Destination Improvement: Databricks - Add optional configuration to replicate primary keys.
PlannedDatabricks supports primary key constraints (Primary Key and Foreign Key constraints are GA and now enable faster queries | Databricks Blog). We would benefit from being able to automatically identify the primary key column in our landed tables from our SQL Server instance.
The key constraints in Databricks are not enforced, but from our source system, we know they would be.
This would require a compute with a Databricks Runtime >= 15.2.
-
Official comment
Hi Sam,
We’re actively working on propagating keys from the source into Databricks, and the feature will be available shortly.
Best regards,
Egidio Terra
Product Manager
Please sign in to leave a comment.
Comments
1 comment