Destination Improvement: Ability to add a label to BigQuery destination.
AnsweredFivetran incurs costs on Bigquery when loading data. To be able to track this in an efficient way it would be really helpful if you define a label that would be sent with the BigQuery job.
That way you could easily track the costs associated with Fivetran in your Google billing data.
https://cloud.google.com/bigquery/docs/adding-labels#adding_a_label_to_a_job
-
Official comment
Hi Ola,
Thanks for your feedback on this! I agree this would be a useful way to label load jobs into BigQuery and fulfill a use case like this. I will share this information with our data writer team and discuss priorities, we do not currently have a plan for this type of improvement.
I am curious how you are currently accomplishing cost tracking w/ BigQuery - what is your current workflow?
-
Additional to adding the label to a job, it would also be nice to be able to add labels to the tables that FT creates.
https://cloud.google.com/bigquery/docs/adding-labels#adding_a_label_to_a_table_or_view
-
Hello this is indeed a great idea, we have some challenges tracking cost that we're enduring from Fivetran. Mainly the issue is that we're having exploding costs on BigQuery side coming from our main GCP project where BigQuery datasets are hosted. It's difficult to assemble overall picture split by connector. So Addin custom labels to bigquery sync queries would be much appreciated feature for us too - https://cloud.google.com/bigquery/docs/adding-labels#adding-label-to-sessionĀ
Please sign in to leave a comment.
Comments
3 comments