Other: Data Report for Data Volume being transferred from connector to target (Snowflake)
The ideal is to get a measure of the Bandwidth for the amount in MB of data flowing from FiveTran to target.
The reason is simple. As a company one want to identify what processes are taking resource on a source database server. FiveTran being such an external process will operate on data detected within the CDC logs of SQL Server.
At peak times, if a huge volume of data is being synced by FiveTran, then, regardless of the chunking process of the FiveTran sync, it maybe causing adverse effects on the Sql Server and its CPU.
In its simplicity, we need something that shows the amount of data picked up in MB for each time the connector synchonises.
We land the data in Snowflake at present so if you know something that we can use to leverage such a report in the first instance that would be great.
Many Thanks,
Paul Morris
-
Hi Paul,
Thanks for this feature request. We are starting to look at what additional data we can surface in relation to the sync for use cases exactly like this, so I've put this on my backlog. If you'd be open to talking more about this, as well as any other data that would be useful to understand about the sync, I'd love to set up time.
Thanks,
Lyndsey
Fivetran PM
Please sign in to leave a comment.
Comments
1 comment