You are curious to know the estimated time it takes to sync data from your source to your destination. This requires the use of the free Fivetran Log Connector, and sample queries Fivetran provides.
We recommend using this calculation as an estimate, as sync speed depends on a variety of factors:
- Volume of data in the data source
- Connector type (e.g. application, database, function)
- Subscription tier (for application connectors)
Using our documented sample queries, Check Daily Modified Records, to determine the amount of records modified in a certain amount of time. Note: you can change the time measurement from days to hours or to minutes, depending on the volume of data.
Here are the recommended steps to roughly estimate sync speed:
- Make sure that the Fivetran Log Connector is configured
- Initiate the initial / historical sync
- [Optional] start with a few select tables. If your data source contains a large volume of data, we recommend starting with a small sample base
- Use the Fivetran Log Connector and the sample query to measure average # of rows updated (records_modified) per 24 hours
- Estimate total source volume
- Project how long Fivetran sync will take
Database connectors have throughput limits, which can be found in our documentation for the respective database type.
If you are concerned about MAR, create a designated test connector to start and use to run these tests before creating a production connector that will sync all of your data.