Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Delete specific data from Webhook Connector

Xavier Vilallonga | elrowfamily User

I recently had some incorrect data pushed to a webhook connector from a 3rd party. That means that this data will live forever in our database, since deleting it will trigger the sync from Fivetran's storage.

Would be great to have a way to delete specific rows from a webhook connector, as currently only removal by date is available (for a specific day, no extra grannularity available).

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Alison Fivetranner

    Hi Xavier,

    Thank you for using our webhook connector and sharing the use case for this request.

    I'm curious what information do you know about the 'bad data'?
    ie What's the best ID a message ID or batch ID or similar in the data warehouse table.

    I'm wondering if you would be able to identify the 'bad data' in your data warehouse and then use a Fivetran API call to actually remove it.

    It would be great if this can be upvoted to help prioritize this in our back log.

    Regards,

    Alison

  • Xavier Vilallonga | elrowfamily User

    Hi Alison,

    Given how the connector works (dumps everything, always, to a table in our end), from my side I can find out any information to track the data. In our case it spawned acroos several days, mixed with "good data". 

    Because of this, having a batch ID would not work. A message ID would, I guess.

    In an ideal scenario I should be able to remove using a query, i.e. main_id IN (x, y) or custom_column = 'xyz'.

    We've had this issue once in three years, so having to go through Support to achieve this should be fine.