Transformations: Trigger dbt Job After All Upstream Fivetran Connectors Complete
Hi Team,
We have a requirement to trigger a dbt Cloud job only after all upstream Fivetran connectors have completed their sync successfully.
We have a requirement to trigger a dbt Cloud job only after all upstream Fivetran connectors have completed their sync successfully.
We would like to request a feature that allows a dbt job to be triggered only after all upstream connectors (having different run schedule) finished syncing.
Currently, our dbt job is triggered after each connector completes its sync. In this case as well, we would like to have a feature that indicates which connector triggered the transformation, either through logs or within the Fivetran UI.
Thanks,
Atul
Thanks,
Atul
-
Hey Atul,
We've talked about the idea of waiting for all upstream connectors to have triggered at least once before triggering a job, I appreciate you writing in! I'll add this to our backlog regarding the feature request.
In re: to indicating which connector triggered a job, I like this idea. We'll evaluate this internally and I'll update the ticket when we have something for you.
Jimmy
Please sign in to leave a comment.
Comments
1 comment