Populate _fivetran_deleted = false for active SURVEY_RESPONSE records
Answered
Which connector?: Qualtrics connector
Additional details:
The following are the features of the new feature of delete capturing using weekend syncs as mentioned by Fivetran support :
- Qualtrics still does not expose deleted survey responses directly via its API.
- Because of this, Fivetran runs a weekly delete-capture pass for the SURVEY_RESPONSE table.
- During that pass, the connector re-exports the current survey responses.
- If a previously synced response ID is missing from this export, Fivetran marks it as deleted in your destination.
Currently, the _fivetran_deleted column is set to true when a response ID is missing from the source export. However, records that are present and active retain the default NULL value.
We request an enhancement to explicitly populate _fivetran_deleted as false for active records and true for deleted records. A consistent boolean value would simplify downstream filtering, transformations, and delete-handling logic.
-
Official comment
Hi Shreya,
Thanks for raising this! Quick question for you: our understanding is that a missing record at source means it was deleted. Do you know of any other reasons a response ID might go missing from the source ?
Just want to confirm "missing = deleted" always holds before we move forward.
Thanks,
Vicky
Fivetran Product team
Please sign in to leave a comment.
Comments
1 comment