Destination Improvement: Ability to create partitioned table in BigQuery via custom connector
Currently the ability create partitioned tables is not supported. Say, if the data size in a non partitioned table becomes a few GBs, read performance might be impacted which may hinder any BI tools' capacity to build visualizations on top of BigQuery, thus defeating the purpose of an ETL pipeline. Partitioned table on the basis of a specific column is a basic necessity which will make custom connector more friendly.
-
We would also appreciate this feature to be developed. At the scale used at our company, this would be definitively be a cost-saving feature.
Please sign in to leave a comment.
Comments
1 comment