Populate _fivetran_deleted = false for active SURVEY_RESPONSE records
AnsweredWhich connector?: Qualtrics connector
Additional details:
The following are the features of the new feature of delete capturing using weekend syncs as mentioned by Fivetran support :
- Qualtrics still does not expose deleted survey responses directly via its API.
- Because of this, Fivetran runs a weekly delete-capture pass for the SURVEY_RESPONSE table.
- During that pass, the connector re-exports the current survey responses.
- If a previously synced response ID is missing from this export, Fivetran marks it as deleted in your destination.
Currently, the _fivetran_deleted column is set to true when a response ID is missing from the source export. However, records that are present and active retain the default NULL value.
We request an enhancement to explicitly populate _fivetran_deleted as false for active records and true for deleted records. A consistent boolean value would simplify downstream filtering, transformations, and delete-handling logic.
-
Official comment
Hi Shreya,
Thanks for raising this! Quick question for you: our understanding is that a missing record at source means it was deleted. Do you know of any other reasons a response ID might go missing from the source ?
Just want to confirm "missing = deleted" always holds before we move forward.
Thanks,
Vicky
Fivetran Product team -
Hi Vignesh,
Yes, that is correct. A missing response ID at the source indicates that the record was deleted. -
Hi team ,
I noticed recently that the_fivetran_deletedcolumn in ourSURVEY_RESPONSEtable has started populating asfalsefor active records instead of remainingNULL.Could you please confirm if this update was officially rolled out as part of the requested enhancement for the Qualtrics connector? If so, we'd love to know if this behavior is now permanent and fully implemented across all syncs going forward.
Thanks for your help!
Shreya
Please sign in to leave a comment.
Comments
3 comments