Transformations: dbt Cloud Integrated Scheduling Improvements
Answered
Hello,
I was hoping trigger a daily dbt Cloud job off of a particular refresh of a connector (e.g. the 12:00am refresh) using the Integrated schedule type, but it looks like the only option is to trigger the job off of every refresh. I like the idea of having a particular data source's refresh being tied to a dbt Cloud job but right now the Integrated configuration feels too inflexible, and there's not much point in choosing the alternative Run Frequency option to trigger the job at a certain time every day from Fivetran when I could just do that within the dbt Cloud UI itself.
-Dustin
-
Official comment
Hey Dustin,
That makes sense! Would it be helpful if we allowed the schedule to be connector-aware? Ie you could select a time that aligned with a nightly refresh, but if a connection sync was occuring it would wait?
Jimmy
-
Hi Jimmy, thanks for your response; what you mentioned sounds more like "trigger this dbt Cloud job at 12:00am, but not if this Fivetran connector is running," which if that's the case is not what we're looking for. Instead, we're looking for "trigger this dbt Cloud job after the 12:00am run of this Fivetran connector." Let me know if that makes sense, thanks.
Please sign in to leave a comment.
Comments
2 comments