Connector Improvement: MySQL Connector: Allow user to set binglog offset
MySQL maintenance sometimes requires binlog reset (such as reset replica or reset master). In such case , binlog file names & offset will all be reset. Currently, we are forced to do full historic resync, which usually take a week or so to finish. Please keep in mind that the estimated time will grow as data grow. During historical resync, we don't get any fresh data in. This basically means that we have to hang up data updates to downstream systems such as salesforce & marketing ones which in turn will have very significant impact to business.
We hereby request a feature to allow us:
1. be able to get last binlog file & offset info after we pause the connector
2. be able to set binlog file & offset before we resume the connector.
Please sign in to leave a comment.