Other: HVR: HVR event display to show breakdown how long HVR refresh time is spent on each task.
Not planned
HVR event display for refresh should show in detail how long HVR refresh time is spent on each task. e,g, how long it took HVR to read the data from source and the time spent on writing the data into target system instead of overall time spent for the job. As it will very useful for isolating performance issues instead of enabling extra logging.
-
Official comment
Hi Zahid,
HVR performs refresh in a single pipeline, with no staging in the middle. The load will run at the pace of the slowest component. E.g. to read from Db2 will take as long as it takes to write to Snowflake staging if Snowflake is the target. We report table-level metrics in the event results.
There is an argument that between staging the data and running copy into we could provide an additional measurement. However, this information is also available in the Snowflake query history (for Snowflake anyway).
If the destination is Db2 or SQL Server then there is no staging in between so the time to select the data is the time it takes to load the data, which is the time we report (by table).
We have no plans to add more details to our reporting.
Thank you,
Mark.
Please sign in to leave a comment.
Comments
1 comment