Skip to main content
Documentation
Feature Requests Trust Center Status Page

Community

Connector Improvement: SQL History Mode and soft deletes

Planned
Justin Wicks User

Hi,
Please may soft deletes be added to the new History mode feature you are trialling.


The option of only Live mode and History mode does not work for us, in 99% of the cases we require soft deletes, and then would like to add Full History modes on select tables in the sync.

Please sign in to leave a comment.

Comments

3 comments

Date Votes
  • Official comment
    Kevin Kim Fivetranner

    Hi Justin,

    Thanks for your feedback here! We are currently evaluating our sync modes approach and general strategy with soft deletes. Would you share more about your use case around soft deletes?

    What types of queries rely on _fivetran_deleted today?

    As we complete this user research, we will be sure to share out a plan to keep our customers updated.

  • Justin Wicks User

    Hi Kevin,

    Apologies for my delayed response.
    So the soft delete option really works well for us, in that we can clean up/delete source data , knowing that we have a record of it in our Snowflake data warehouse, so it keeps our production databases leaner.


    99% of our Snowflake queries are all written with _FIVETRAN_DELETED = 0 in the join, if we only want to see current valid data, so to remove this column from the tables will break over a thousand views in our cloud data warehouse.

  • Kevin Kim Fivetranner

    Hi Justin,

    We are currently working on allowing both soft deletes and history mode on the same connector for the database connectors. Please stay tuned as we plan to release it this quarter!