Skip to main content

Community

Support arbitrary regions for final managed datalake S3 storage bucket region

Please sign in to leave a comment.

Comments

4 comments

  • Official comment

    Hi Chris --
    Please work with your account team to get support for your requested region prioritized. 
    Thanks for taking the time to write in, it is much appreciated!

    We are evaluating the move to MDLS on Azure and this is a blocker for us as well.

    Also, Chris --- the bucket / region requirement is documented here:
    https://fivetran.com/docs/managed-data-lake-service/setup-guide#prerequisites

    Yes, that documentation was added a couple of days ago as a result of my support request 😊.

    We would still appreciate it if this restriction could be reconsidered. In the meantime, could someone help me understand the technical rationale for restricting the destination region?

    I'm not asking for a new processing region. Fivetran already fully supports copying the resulting files to a remote region after processing is complete, so I'm struggling to understand why there is a restriction on which remote regions those files can be copied to.

    The newly added documentation says this restriction is intended to avoid egress costs, but that rationale isn't clear to me. The documentation for the Managed Data Lake service explicitly states that network data-transfer charges apply when the Fivetran processing region and the storage account region differ (documentation). This clearly indicates that cross-region transfers are already supported, with the associated transfer costs.

    If there is a technical limitation I'd appreciate some clarification on what it is.

    Thanks!