Connector Improvement: Qualtrics: Capture deletes for QUESTION_RESPONSE, SURVEY_RESPONSE
Hi,
This is regarding the Fivetran - Qualtrics connector, we are facing some major issues with the connector related to capturing deletes.
When survey responses are deleted in Qualtrics, those were not being captured by Qualtrics connector. As per Qualtrics connector documentation Qualtrics | Fivetran documentation observed no support for Capture deletes feature for QUESTION_RESPONSE, SURVEY_RESPONSE tables.
However, Fivetran’s general guidance states in “inferred deletes through re-syncs” that a full historical resync captures the deleted records https://fivetran.com/docs/getting-started/feature#inferreddeletesthroughresyncs but this was not happened when we performed full re-sync for SURVEY_RESPONSE table.
Would it be possible to include this feature in upcoming releases?
Thank you.
-
Official comment
Hi all,
Sadie from the PM team here. An update here: we are considering enabling delete capture by scheduling a weekly resync of survey_response and question_response. Would capturing deletes once per week be a suitable solution? If not, at what frequency would you need to capture deletes?
Best,
Sadie
-
Another vote for this, it would be great to be able to flag deleted responses without having to drop and reconnect the whole table
-
Hi Sadie,
Once a week would be a suitable compromise for us. In an ideal world this would sync daily but as I tend to report on this on a Monday then having a resync between late sunday and early hours Monday would be great.
Thanks,
Nick
-
Hi Sadie, thank you for following up. We ended up implementing our own solution where we daily pull these responses from the API into our DW and flag any from the Fivetran extract not in this new daily extract as deleted. That means we no longer need this feature. Like Nick though, if we were starting over again, I would expect the sync to occur daily/at the same cadence as the extracts for consistency and completeness. Weekly is better than nothing. Unfortunately any lag between new survey responses in general and flagging deletes would inevitably result in stakeholders seeing deleted data in their analysis.
Please sign in to leave a comment.
Comments
4 comments