Destination Improvement: History mode should generate OPERATION_TYPE and DELETE_FLAG introduced in the context of audit attributes
AnsweredWe were analysing the output from Fivetran with ‘History Mode’ and what we found there are 4 audit columns generated at the target (Snowflake STG in this case) like FIVETRAN_SYNCED, FIVETRAN_START, FIVETRAN_END AND FIVETRAN_ACTIVE as shown below. But with these we can not directly track the deleted records. These should be minimum these two additional audit attributes like IS_DELETED flag and OPERATION_TYPE (insert, update, delete, signifying scd type 1 or 2 etc.) Can you please introduce them into Fivetran ‘History Mode’?
-
Official comment
Hi Samik,
We understand the need for additional audit attributes such as IS_DELETED and OPERATION_TYPE in ‘History Mode’ to track deleted records and operation types more effectively. We're looking into it and will provide updates here as we evaluate this enhancement for the product roadmap.
Thanks,
Amanda
Please sign in to leave a comment.
Comments
1 comment