Aurora MySql Sharded Database Support -> Snowflake/MDLS
Our single Aurora MySql environment is going to be split into Multiple Sharded environments. This brings in couple of challenges in using Fivetran to replicate data to Snowflake or MDLS Destination.
1) Each Sharded Aurora MySql environment need to be in a separate connector.
2) Too much connector to support and maintain Binlog based replication.
3) Unification of data from all replicated Shards is required on Snowflake Destination or MDLS. It is not supported in Fivetran currently. This would require building custom Unificiation layer(Union/Union All) to support data and schema consistency on final serving layer.
Can we get Fivetran support Many Sources to 1 Destination data replication especially from Aurora MySql to Snowflake/MDLS destinations possibly configurable in 1 connector and provide a serving layer.
-
Hi Ramki! Thank you for raising this request. I am Sumant, a product manager on the Fivetran team.
We’re working on this and it’s planned. At the moment, we’re not able to share a timeline for availability, but we’ll update this thread as we make progress. We appreciate the feedback and the additional context on your use case.
Please sign in to leave a comment.
Comments
1 comment