Connector Improvement: Transaction_lines table resync issue
Not plannedHi,
Recently, we have archived data in some major tables like transaction_lines and noticed that, when we delete the records fivetran went into a full resync mode for this table automatically.
This has caused interruption in our production due to locked tables and also exaggerated the cost of our account consumption.
We would like to see an option to disable this feature for major tables.
-
Official comment
Hi Mehmet -
Thanks for submitting this feature request. I will need to investigate what process this is caused by, as it may be a NetSuite specific change or a Fivetran specific change.
I will investigate and try to confirm back.
Best,
Erin
-
Hi Mehmet -
I've discussed this with engineering and currently the approach we have for our delete capture includes re-importing chunks of the transaction line table when a change has been detected. We document this process here.
The process of archiving your data in your destination is not what is causing these records to be re-imported but rather the fact that we have to re-import chunks of records when there is a checksum mismatch between the previous sync and the current sync.At this time, we are going to maintain our approach to delete capture as it is currently the most reliable way to support data integrity in the NetSuite source.
Best,
Erin
Please sign in to leave a comment.
Comments
2 comments