New Connector: Update old soft deleted records, instead of insert causing duplicates records
CompletedWe have a soflt delete channel (hana to snowflake) and when a record is deleted in the source (hana) it is updated at destination with is_deleted flag column set to true.
In our business, some customers return back and then in hana the primary key is reused and on a soft delete channel hvr issue an insert at the target (snowflake) with is_deleted flag column set to false. This lead to a duplicate records in our BI solution running on top of snowflake.
We would request hvr to identify such scenarios when a customer is added back to the source and only issue an update statement in target (snowflake) and reset is_deleted flag to false.
-
Hi Babakar,
I am surprised to hear that our default behavior results in duplicate values for an SAP HANA source database. Our default behavior should be that no duplicates end up in the target. I wonder if the behavior is incorrect because of our use of hvr_rowid as the key.
Let me talk to the internal team to confirm the intended behavior. However I am tempted to treat this behavior as a bug rather than an enhancement.
Thanks,
Mark. -
Hello Mark,
I must say, I am also surprised that we need to submit a feature request to resolve this issue
I look forward to your feedbacks on this matter.
Best regards,
Babacar
-
Hi Babacar,
I attempted to reproduce the issue on an S/4HANA system by creating a sales order item, deleting it, and then recreating it (create/delete/create). As expected, HVR returned only a single record — no duplicates were found. The recreated record showed the latest state, and the delete flag was false. This indicates that the behavior you're seeing is likely specific to your HVR environment, as it is not standard.
I recommend opening a support ticket so our support team can investigate further.
Best regards,
Edwin -
Hello Edwin
Thank you for your answer.
I already opened a ticket previously in which they suggested me to create a feature request.
Please check incident number Id #302886.
- Best regards,
- Babacar
Please sign in to leave a comment.
Comments
4 comments