Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Other: Duplicate in Refresh in Timekey channels

Answered
azhar ahmad User

This is related to Ticket: https://support.fivetran.com/hc/en-us/requests/326613. 

The TimeKey channel insert records that occure during refresh job, both during refresh and later (once Refresh has finished) on in Capture/Integrate based on CDC transaction logs. This results in 2 duplicate records with operation type "insert" in target table and need to be cleaned up manually. 

We would very much like to either: 

- The Refresh job would ignore new insert (and maybe updates/deletes) during Refresh as they are included in the CDC run any way

- if Refresh include this, it would automatically reconcile these duplicate Inserts with insert from CDC logg in Capture/Integrate jobs. 

The expectations from HVR is to not create duplicates during Refresh and Capture/Integrate job and just give us all change event as they occure without duplicates. 

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Edwin Fivetranner

    Hi Azhar,

    Thank you for raising this. We agree that HVR can be improved by ensuring the capture job avoids performing duplicate INSERT operations on the target.

    We’ll review this request internally and follow up once we know more about how we want to address it.

    Best regards,
    Edwin