Other: Trigger dbt jobs after refresh data done from fivetran
CompletedHi Fivetran team,
We have exercise to make real time data analysis and reports.
The main datasource coming from shopify where we use fivetran to migrate into redshift. However, to fullfil the dashboards and reports, we need to run complex transformation where we use dbt.
But the schedule now, fivetran ervery 15 mins, dbt every 15 mins, could be sometimes mismatch of the runs due to the fact of data process time.
We research, and in dbt, we can make api call to trigger the jobs using post request.
We wonder, could we make that post request from fivetran after finish migrating data? With the main guy is shopify_de connector, we want to bind to that connector to call post api to trigger the dbt job.
Please adivse us.
Thank you,
Air-up team
-
Official comment
This is available in all accounts.
-
Hi Air Up IT– we have integrated scheduling available as part of our UI-based transformations for dbt Core in Beta. Would you be interested in being added to the feature flag?
Please sign in to leave a comment.
Comments
2 comments