Introduction

Find out how you can discover the estimated time it takes to sync data from your source to your destination. This requires the use of the free Fivetran Log Connector, and sample queries Fivetran provides.

Recommendation

We recommend using this calculation as an estimate, as sync speed depends on a variety of factors:

• The volume of data in the data source
• Connector type (e.g. application, database, function)
• Subscription tier (for application connectors)

Using our documented sample queries, Check Daily Modified Records , to determine the number of records modified in a certain amount of time. Note: you can change the time measurement from days to hours or to minutes, depending on the volume of data.

Here are the recommended steps to roughly estimate sync speed:

1. Make sure that the Fivetran Log Connector is configured
2. Initiate the initial/historical sync
1. [Optional] start with a few select tables. If your data source contains a large volume of data, we recommend starting with a small sample base
3. Use the Fivetran Log Connector and the sample query to measure average # of rows updated (records_modified) per 24 hours
4. Estimate total source volume
5. Project how long Fivetran sync will take

Considerations

Database connectors have throughput limits, which can be found in our documentation for the respective database type. 

If you are concerned about MAR, create a designated test connector to start and use to run these tests before creating a production connector that will sync all of your data.