Connector Improvement: Point-in-time changes
Not plannedCurrently, when processing connectors, Fivetran uses all columns to decide the change logic, creating a new version of changed records and marking the old ones as _Fivetran_Deleted=Trye. I'm requesting that we be given an option to choose which columns to include/exclude from this change logic.
For instance, if 60 attributes were coming over for a customer table, we would like to have an option to include/exclude columns to manage the changes.
-
Official comment
Hi Sendhil,
Thanks for the inputs.
Since this is a core behavior of the way we track changes, such an option can cause data integrity issues. You can deselect columns using the API to not have them land on the destination, but changes will still be monitored for the columns.
Having said that, we will keep this feedback and input and explore options as we work on making the experience better for our customers.
Thanks and happy data pipelining.
Please sign in to leave a comment.
Comments
1 comment