Destination Improvement: BigQuery: Run jobs in BATCH priority
BigQuery offers some configurations regarding priority by way of INTERACTIVE and BATCH where the former are prioritised ahead of the latter. I want to use these to ensure my human users and time-critical tasks are run with INTERACTIVE priority and my background system/service tasks are run with BATCH priority.
At the moment Fivetran's tasks are all executed as interactive but the majority of these workloads for me. For BigQuery destinations, I'd like to be able to set a default priority configuration for the Fivetran jobs, and override this on a connector level basis.
Please sign in to leave a comment.
Comments
0 comments