Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Remove Iceberg Table Maintenance Task Dependency on Loading New Data

Answered
Rob Oestreich User

As Shown:

Event Driven Data Pipelines that have short SLAs are currently potentially slowed down by maintenance procedures on iceberg tables every other Saturday resulting in massive delays for users that require up to date data

Request:

  • Remove maintenance dependency on loading data into iceberg tables
  • Allow customers to set a customizable maintenance window/time
  • Allow customers to discontinue maintenance tasks if they are causing slowdowns

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Casey Karst Fivetranner

    Thanks for reaching out Rob. I have reviewed this request; as well as, the support ticket you created. I will work with the team to see what optimizations we can make to this workflow to make the table maintenance tasks non-disruptive to your workflow. Do you mind if I reach out directly to better understand your use case and requirement? 

    Thanks,

    Casey Karst- Product Manager Data Lakes