Other: Many to 1 database replication
Answered
Hi,
I am trying to ETL or replicate data from AWS RDS SQl Server to AWS Aurora MySQL. I have 3 source databases with same schema in RDS SQL Server SOurceDB1, SourceDB2, SourceDB3. I would like to ETL/replicate them to single database to Aurora MySQL TargetDB using FiveTran .TargetDB has same schema as all 3 sources. Is this possible to ETL or replicate minute by minute to a single Aurora target on daily basis or can they only be replicated to 3 targetDB's ?, Which 5Tran feature can be used, what limitations I need to consider other than SQLServer vs MySQL DB differences ?, Will I have to go ETL route in 5tran, with transformations in between source and target ?
Example:Lets say 3 source DBs have 100 records each i.e 300. The target MySQL Aurora single Database will store all 300 records. Also when a record is added , updated to any of the source DB same should reflect in the target DB
-
Official comment
Hello Prashant,
Thanks for your question in our feature requests portal!
This is an interesting use case and I definitely understand it is not easy to accomplish this today. I believe with 3 identical schemas, you should be able to create a view or transformation that will run a UNION ALL against the 3 schemas from the same sources. However, this would not be an automated process and would mean more overhead for your team.
We have been researching a similar capability, 1 to many database replication as well. Both of these requests are things many customers have brought up and we will look into more deeply. While I don't have a timeline at this moment, please know your feedback has been taken into consideration!
If you have more details about your use case, or if other users have more feedback, please don't hesitate to share.
Please sign in to leave a comment.
Comments
1 comment