Support CPU, I/O and Performance Profiling for SingleStore/MemSQL Integrate Channels
Details
We have an impacted SingleStore (MemSQL) Integrate channel experiencing high latency and I/O delays. We need the ability to capture detailed performance information at the channel/job level to identify where the delay is occurring.
Currently:
-
HVR_TIME_PROFILER_TRACEis not supported for MySQL/MemSQL (SingleStore). - HVR Support confirmed this is a product limitation, not a configuration issue.
- We tried:
HVR_TIME_PROFILER_TRACE=LOWHVR_PERFORMANCE_METRIC_ENABLE=1HVR_SQL_TRACE=1
-
HVR_SQL_TRACEcan provide SQL/per-statement duration information, but it does not provide the required CPU and I/O performance details. -
HVR_TIME_PROFILER_TRACEprovides useful timing information such as Functional Calls, Network I/O and SQL timing, but this functionality is currently unavailable for SingleStore/MemSQL.
Feature Request:
Please consider adding support for HVR_TIME_PROFILER_TRACE for SingleStore/MemSQL Integrate channels, including:
- CPU utilization/time
- Network I/O
- Database I/O
- SQL execution time
- Functional/call timing
- Overall source/hub/target timing breakdown
Ideally, this should be configurable at the channel/job level, so performance data can be captured for a specific impacted channel without enabling extensive tracing across the entire HVR Hub.
This capability would help us troubleshoot SingleStore Integrate channel latency and identify whether the bottleneck is related to HVR processing, network I/O, SQL execution, or the target database.
Expected outcome:
Ability to enable detailed performance profiling for SingleStore/MemSQL Integrate channels similar to the profiling available for supported target technologies.
-
100% Agree. When HVR_TIME_PROFILER_TRACE=LOW or MEDIUM or HIGH is supporting oracle/sql/db2 on target side, there is a question of why SingleStore/MYSQL is not supported. I would not say it is a bug but it is likely a design mistake when I set this ENVIRONMENT variable in channel and target is SingleStore but I am able to successfully activating the capture and integrate jobs without any warning or error so I was having impression that all my actions in the channel are good and valid but this is not true when I do not see any TRACE information in my integrate logs. Do you think it is a design flaw?
Please sign in to leave a comment.
Comments
2 comments