Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Destination Improvement: Ability to delete data from Managed Data Lake Destinations

Planned
Anthony Gianastasio User

Hello,

In order to comply with data lifecycle management and deletion request related to GDPR requirements, we should be able to delete data from Managed Data lake tables.

At the moment, it's not possible as Polaris catalog access is read only!

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Casey Karst Fivetranner

    Hi Anthony, 
    This is a feature we are currently working through. 
    For clarity, are you looking for the ability to delete individual records and tables? 
    What would be the ideal way for you to execute these commands against the Polaris Catalog?

    -Casey

  • Anthony Gianastasio User

    Thanks a lot Casey!

    In fact, there are potentially two different use cases :

    - Historical data deletion, for example everyday remove data older than 5 years ago for table X

    - Individual row deletion or anonymization from "Right to be forgotten" request UPDATE user_email  as XXX FROM users.

    To be honest I have not deeply thought about the best way to achieve this so I'm totally opened but I would say the best is to let our query engine (Snowflake, Athena or whatever else) execute such command because it needs to be automated in some way!