Transformations: running a shell scripts rather than a command for dbt transformations
As a data engineer I have a use case to run dbt commands in a loop but right now this feature is not supported in the Fivetran. for example I want to run something like this:
d=20221209
while [ "$d" != 20221212 ]; do
echo $d
dbt run --select my_model --vars '{"start_date":"'$d'" }'
d=$(date -j -v +1d -f "%Y%m%d" $d +%Y%m%d)
done
-
Looking for similar feature for use case in our org
Please sign in to leave a comment.
Comments
1 comment