Destination Improvement: Big Query: partition table on creation
Not plannedIt would be great if we can chose a column from the source schema to be used as the partition field when Fivetran creates a table in BigQuery.
Or being able to select a default for all tables like ingestion time or the fivetran synced at timestamp.
-
Official comment
Hi Liam,
Your goal to partition BigQuery tables on creation using a specific source column or a default like ingestion time is understood. Fivetran focuses on reliable data replication, while table administration—including partitioning strategies—is typically best handled directly in BigQuery. This approach gives you full flexibility and ensures the partitioning aligns perfectly with your analytic and performance needs.
Some alternatives:
Create the destination table in BigQuery with your preferred partitioning strategy and have Fivetran load into it.
Or, land the data with Fivetran in a raw table, then use a scheduled query or transformation to copy it into a partitioned table tailored to your requirements.
Best regards
Please sign in to leave a comment.
Comments
1 comment