Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: allows users to explicitly define criteria for skipping records prior to loading them into the destination

Planned
Ami Shurki User

I’d like to request a feature that allows users to explicitly define criteria for skipping records before they’re loaded into the destination.

Currently, if I delete records in the source and also remove them from the destination, Fivetran continues to re-insert them—likely by recovering them from Polaris.

There should be a way to fully delete records and prevent Fivetran from syncing them again. Having a configurable option to skip specific records based on defined criteria would solve this issue.

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Kevin Kim Fivetranner

    Hi Ami,

    Thanks for your question! We are currently building a row filtering feature, which lets you fitler out rows from being synced based on a critiera, e.g. as date, integer, and string filters.

    What sources are you trying to filter? What type of criteria are you hoping to use? This capability should be available for users in a few months!

  • Ami Shurki User
    • Edited

    Hey Kevin

    Specifically I wanted to add filter to Amazon Aurora PostgreSQL with a filter like:
    column_y in ('a', 'b', 'c') and column_x IN (32,79,80)

    But I guess one would expect this to be on all databases and option to add custom SQL where condition