Skip to main content

Community

Please sign in to leave a comment.

Comments

2 comments

  • Official comment

    Fivetran currently does not support S3 Tables as a Storage Provider. 
    Managed Data Lakes provides a managed Data Lake offering on S3 buckets directly. Are there any features or capabilities in S3 tables that MDLS doesnt offer that is driving this ask?

    Hello @Casey Karst! We did review MDLS, but our team is currently standardized on the AWS-managed S3 Tables service. It's not that MDLS is missing a feature, we understand it's a fully managed offering that handles Iceberg maintenance for us. The issue is that adopting it would introduce a second, parallel Iceberg distribution that we'd then have to own and operate alongside the one we already run.

    We've standardized on S3 Tables as our single Iceberg catalog and storage standard, AWS-native, in table buckets we own, governed through Lake Formation, with AWS handling compaction and maintenance. Adopting MDLS therefore means running two different Iceberg catalog distributions side by side, Fivetran's Polaris catalog plus its Glue sync layer, in addition to our native S3 Tables catalog. That means two governance models, two sources of truth, and two maintenance regimes to reconcile, which is exactly the operational overhead we adopted S3 Tables to avoid. Native S3 Tables support as a storage provider would let Fivetran write into the one catalog we already own and govern, instead of standing up a parallel managed lake next to it. That's the gap driving the request.