Question
My sync is taking longer than normal. What is causing this?
Environment
All Connectors
Answer
This can be caused by a number of factors:
- Increase in data volume
There has been an increase in the data volume to sync. To check for this you can hover over the sync bar in the dashboard and see a breakdown of the extract, process, and load volumes. You can then compare this to another shorter sync to verify if the volume has increased for the longer sync. - Schema Change
If there has been an additional column or table synced then this can cause an increase in the sync time. You can filter the dashboard logs by schema change events to check for this. - Large change in source
If there has been a large change in data at the source, such as a mass delete or mass record update this will result in an increase in changes to sync, and thus an increase in sync time.
You can check:
- the source for any large changes
- following sync completion, search the dashboard logs with the valuerecords_modifed
to verify if any tables have a large increase in thecount
parameter for therecords_modifed
event. - Network Latency
There may be intermittent network latency that is slowing the sync. This may occur on the connection to a database connector or to the destination database. Check with your network team to verify if there are known or potential network latency Issues. - API rate limits (Application Connectors Only)
The source API rate limits may be hit which then requires the connector to wait until it can query the API again. This can slow the sync if it is regularly hit. You can filter the dashboard logs by warnings only to see Warnings for this and verify if this is the cause for the slower sync.