Connector Improvement: Raw filtering feature enhancement
We have tried to enable raw filtering feature (case 250839) private preview at connector level but came to know that it has a limitation. This feature is currently available for initial sync as one time option, however we like to use for incremental sync.
We use history mode for most of the tables and if that filter is available then we can check the data if some column is null then do not insert the new records.
Could you please keep it as priority if possible? We are facing a recent issue where Fivetran pushing 2 records to targe due to source side changes happening in milliseconds (Case#250481). We want to avoid those additional records with applying filter on incremental basis.
Regards,
Nish
-
This will significantly help us to simplify our workloads to avoid post-load transformations, or having to switch to another extract & load tool.
Please sign in to leave a comment.
Comments
1 comment