Transformations: dbt thread increase to 32 or more
Completed
Per getdbt.com documentation - "increasing the number of threads can minimize the run time of your project". Finishing runs can overall benefit everyone. Customers will have their data transfer speedier and fivetran will have jobs finish quicker by nature of having them run with additional threads.
-
Official comment
Hi all, threading options have increased from 8 to 32 threads– you should see this change in your Github connection settings now.
-
As per the latest release we can now have 8 threads. https://fivetran.com/docs/changelog/march-2021#increasedthreadlimit
-
Yes Sandeep Kumar. We are for sure using all of the 8 threads that are allowed. With 16 or even 32 our jobs would finish even quicker. Thanks.
Please sign in to leave a comment.
Comments
3 comments