Connector Improvement: Change data process from resync to Incremental for Distribution
Completed
- As of today ,the distribution object contains huge volume of records and it is taking a couple of hours to resync it daily .The distribution data continues to increase daily, and relying on resync is not an optimal solution.
- As of today , the distribution object requires few records per day in incremental changes encompassing both inserts
and updates. - Each survey has expiration dates like 7 days, 30 days…
If we consider incremental distribution data for each survey based on the send date and expiration days, it will result in fewer records. This
-
Official comment
Hi all,
Sadie from the Product team here. The Qualtrics APIs don't provide us with a way to detect changed distributions, so the only way to guarantee data integrity is to reimport the distribution data on every sync. We do have a feature available that allows you to configure the length of the expiration window for you distributions via the Fivetran REST API. If you set the window, we will only fetch new and updated distributions during that time window, which reduces your incremental sync time. Please reach out to our Support team if you would like to try this out.
Best,
Sadie
-
Hey Sriman, could you provide more information about the connector you are referring to here?
Please sign in to leave a comment.
Comments
2 comments