Destination Improvement: HVR: Configure Primary Key Columns for BigQuery Target Location
AnsweredWhile Primary Keys are not enforced in BigQuery, they do offer performance improvements: https://cloud.google.com/blog/products/data-analytics/join-optimizations-with-bigquery-primary-and-foreign-keys
HVR does not set Primary Keys on BigQuery tables when a BigQuery location is the Target. This should be supported.
-
Oh this is such a good idea,
would love to see this implemented!! -
We are currently going through exactly same pain!
Looking forward to see this feature added in HVR. -
I don't know any of you guys, but I agree that this is only makes sense.
-
Hi Prakhar,
Thank you for raising this request and for sharing the Google article highlighting the performance benefits of primary keys in BigQuery.
We understand that while primary keys are not enforced in BigQuery, they can still improve performance, especially when data is joined with other tables. While it's currently possible to define primary keys manually in BigQuery, we recognize that this can add significant operational overhead.
At the moment, HVR does not set primary keys on BigQuery targets, but we are actively reviewing the feasibility and impact of supporting this functionality in a future release.
Best regards,
Edwin
Please sign in to leave a comment.
Comments
4 comments