Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Transformations: LDP/HVR: Allow Inserting SoftDeletes within a single Integrate Burst cycle

Answered
Marcus Hartman User

Situation:

I have a Table where rows are sometimes Deleted shortly after being Inserted. These rows are "missing" from our "SoftDelete version" of the Table, when the row is Deleted in the same Integrate Burst cycle as the Insert.

To work-around this behavior, we have to keep a "TimeKey version" of the Table and a "SoftDelete version" of the Table so that we can reference the "TimeKey version" for these "missing rows" and then self-Insert these "missing rows" back into the "SoftDelete version" of the Table.

Requested Behavior:

For non-TimeKey: Rows that are "Inserted then Deleted" within a single Burst cycle are Inserted into the Target as a SoftDelete. Toggled by a parameter in Integrate?

Current Behavior:

For non-TimeKey: Rows that are "Inserted then Deleted" within a single Burst cycle are coalesced and optimized away.

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Mark Van de Wiel User

    Hi Marcus,

    Thank you for your suggestion. We may be able to change this behavior. However, to ensure we cover all the corner cases would require more detailed research that we do not currently have bandwidth for. So I put your request on the backlog for now.

    Thanks again,
    Mark.