Transformations: Change dbt command 'run' to 'build'
Currently Fivetran is limited to only executing 'dbt run' commands for dbt transformations.
When executing a 'dbt run' command, anyone who's data models have seed or snapshot dependancies, or requires tests to be included on each run, must add those separate commands in addition to 'dbt run'.
The 'dbt build' command solves the issue of needing to always execute these different commands. From to the dbt docs:
The
dbt build
command will:
- run models
- test tests
- snapshot snapshots
- seed seeds
In DAG order, for selected resources or an entire project.
One of Fivetran's selling points for us was 'integrated scheduling', specifically the ability to orchestrate model updates in dbt in sync with Fivetran tasks. But we need to be able to execute our model updates with snapshots, seeds, and tests. Without being able to customize the commands, or not being able to at least just execute 'dbt build', then the integrated scheduling feature will not be useful for our team.
-
Official comment
Hey All,
We're working on a solution to this. Stay tuned!
Jimmy
-
On our roadmap! We will be working on this as a feature improvement task once we've deprecated dbt Core versions <1.0.0, which should happen at the end of this month. ETA for dbt build is Q3 this year.
-
This feature would be very useful. Could I also request that the
--indirect-selection=<cautious|eager|buildable> flag is made configurable? -
was this ever deployed? the transformations i have currently configured still seem to be using dbt run
Please sign in to leave a comment.
Comments
4 comments