Transformations: Scheduler should be at Project Level
We have a dbt project with 19 transformations. I would like to run all these transformations once a day at the same time.
Today, I would have to create 19 schedulers for this. If I have 50 I would have to create 50 schedulers which would make it very hard to use?
Dbt Cloud would allow to run all the models in a project using one trigger command "dbt run". This is something Fivetran is missing. We aren't moving some of our models to Fivetran for the same reason.
To support the need to run a select few models, tags should also be supported if this is a conflicting requirement from different customers.
-
@Ramakanth do you have 19 models in your dbt project, or 19 output models (childless nodes) in your graph? We designed Fivetran Transformations so you only need to schedule the output models, and we will execute everything upstream on every run.
Please sign in to leave a comment.
Comments
1 comment