Procedure
Click Instance Metrics to view monitoring metrics for the instance. Select a time range from the drop-down list to view detailed metrics for that period.
The page displays the ha3 metrics dashboard, which includes panels such as SQL_QRS, SQL_Searcher, QRS, Searcher-normal, Searcher_phase1, Searcher_phase2, and Searcher_rt_build. Click a panel to expand it and view its metrics.
Metrics
SQL_QRS
|
Metric |
Description |
|
QPS |
The number of SQL queries per second (QPS), including queries that return an error. |
|
EmptyQps |
The QPS of normal queries or standalone phase-1 queries on the QRS that return empty results. |
|
ErrorQps |
The number of SQL queries per second (QPS) that return an error. |
|
GetPlanErrorQps |
The number of queries per second (QPS) that fail to generate a usable iquan plan. |
|
SessionLatency |
Total time spent on an SQL query, including time spent waiting in the thread pool and processing the query. |
|
ProcessLatency |
Time taken to process an SQL query. |
|
Sql plan parsing latency |
Time spent parsing the SQL plan. |
|
Number of returned results |
Number of results returned by the query. |
|
Length of returned results |
Total length of the results returned by the query. |
SQL_Searcher
|
Metric |
Description |
|
qps |
Number of SQL queries per second (QPS) processed by the Searcher worker, including those that return an error. |
|
Searcher query latency |
Time taken for the Searcher worker to process a query. |
QRS
|
Metric |
Description |
|
qps |
The number of queries per second (QPS) processed by the QRS worker. |
|
one-phase qps |
The number of phase-1 queries per second (QPS) processed by the QRS worker. |
|
two-phase qps |
The number of phase-2 queries per second (QPS) processed by the QRS worker. |
|
proc_cpu |
CPU utilization of the QRS worker. |
|
proc_mem_rss |
Amount of memory used by the QRS worker. |
|
mem |
Memory usage of the QRS worker. |
|
qrsSessionLatencyNormal |
The processing latency for normal, standalone phase-1, or standalone phase-2 queries on the QRS, measured from when a session is dequeued until its processing is complete. |
|
waitLatencyPhase1 |
The time the QRS worker waits for an asynchronous response from downstream nodes during a phase-1 query. |
|
waitLatencyPhase2 |
The time the QRS worker waits for an asynchronous response from downstream nodes during a phase-2 query. |
|
returnCountNormal |
The number of normal results returned by the QRS worker. |
|
resultLenNormal |
The length of normal query results. |
|
emptyQps |
The number of queries per second (QPS) that return empty results. |
|
syntaxErrorQps |
The number of requests per second (QPS) that fail on the QRS worker due to syntax errors, such as a clause parsing failure or an invalid result format. |
|
RequestPoolWaitTime |
The time a session waits in the worker queue on the QRS worker. |
|
multiCallLatency |
The latency of multiCall invocations on the QRS worker. |
|
early_terminator_qps |
The number of queries per second (QPS) that are terminated early on the QRS worker. |
|
worker_status |
Status of the QRS worker. A value of 1 indicates normal, and 0 indicates abnormal. |
|
processerrorqps |
The number of requests per second (QPS) that fail on the QRS worker due to processing errors. This includes errors such as a non-existent Processor or ProcessorChain, and excludes syntax errors. |
Searcher-normal
|
Metric |
Description |
|
proc_Cpu |
CPU utilization of the Searcher worker. |
|
proc_Mem_Rss |
Amount of memory used by the Searcher worker. |
|
proc_Mem_Use_Ratio |
Memory usage of the Searcher worker. |
|
disk_use |
Amount of disk space used by the Searcher worker. |
|
disk_use_ratio |
Disk usage of the Searcher worker. |
|
partitionDocCount |
The number of documents stored on the Searcher worker. |
|
partitionMemoryQuotaUse |
The memory quota used by the index on the Searcher worker. |
|
incIndexMemoryUse |
The memory used by the incremental index. |
|
oldInMemorySegmentMemoryUse |
The memory used by in-memory segments that have not yet been released. |
|
SegmentCount |
The number of segments on the Searcher worker. |
|
requestPoolWaitTime |
The time a query request waits in the request pool of the Searcher worker. |
|
worker_status |
Status of the Searcher worker. A value of 1 indicates normal, and 0 indicates abnormal. |
|
deletedDocCount |
The number of documents deleted from the Searcher worker. |
Searcher_phase1
|
Metric |
Description |
|
inQpsPhase1 |
The number of phase-1 queries per second (QPS) processed by the Searcher worker. |
|
searcherProcessLatencyPhase1 |
The processing latency for phase-1 queries on the Searcher worker. |
|
sessionLatencyPhase1 |
The total session latency for phase-1 queries on the Searcher worker. |
|
beforeSearchLatency |
The time taken for query initialization on the Searcher worker. |
|
rankLatency |
Time taken for the initial sorting stage (rough sorting) on the Searcher worker. |
|
rerankLatency |
The time taken for fine sorting on the Searcher worker. |
|
matchCount |
The exact number of matching documents found on the Searcher worker. |
|
matchDocSize |
The actual number of matched documents returned by the Searcher worker during phase 1. |
|
seekCount |
The exact total seek count on the Searcher worker. |
|
seekDocCount |
The number of documents sought on the Searcher worker. |
|
phase1EmptyQps |
The QPS of phase-1 queries that return empty results on the Searcher worker. |
|
phrase1TimeoutQps |
The QPS of phase-1 queries that time out on the Searcher worker. |
|
cacheHitRatio |
The full-cache hit ratio on the Searcher worker. |
|
cacheGetNum |
The QPS of lookups in the full cache on the Searcher worker. |
|
cachePutNum |
The QPS of insertions into the full cache on the Searcher worker. |
|
cacheItemNum |
The number of items in the full cache on the Searcher worker. |
|
extraRankCount |
The number of documents processed in the final ranking stage on the Searcher worker. |
|
extraRankLatency |
The time taken for the final ranking stage on the Searcher worker. |
|
aitheta_seek_count |
The aitheta seek count on the Searcher worker. |
|
aitheta_recall_ratio |
The aitheta recall ratio on the Searcher worker. |
|
aitheta_seek_latency |
The aitheta seek latency on the Searcher worker. |
|
after_search_latency |
Time elapsed from the completion of ranking to the return of the final result on the Searcher worker. |
|
request_pool_wait_time |
The time a query request waits in the request pool of the Searcher worker. |
Searcher_phase2
|
Metric |
Description |
|
inQpsPhase2 |
The number of phase-2 queries per second (QPS) processed by the Searcher worker. |
|
searcherProcessLatencyPhase2 |
The processing latency for phase-2 queries on the Searcher worker. |
|
sessionLatencyPhase2 |
The session latency for phase-2 queries on the Searcher worker. |
|
blockCacheHitRatio |
The hit ratio of the block cache on the Searcher worker. |
|
fetchSummaryLatency |
The time taken to fetch summaries on the Searcher worker. |
|
extractSummaryLatency |
Time taken to extract the dynamic summary on the Searcher worker. |
Searcher_rt_build
|
Metric |
Description |
|
addQps |
The QPS of add document operations pushed via API to the Searcher worker. |
|
deleteQPS |
The QPS of delete document operations pushed via API to the Searcher worker. |
|
buildQps |
The QPS of real-time index build operations on the Searcher worker. |
|
end2EndLatency_API |
The end-to-end latency for data pushed via API. |
|
end2EndLatency_default |
Default end-to-end latency for data pushed via API. |
|
swiftReadDelay |
The Swift read delay on the Searcher worker. |
|
rtIndexMemoryUse |
The amount of real-time memory used by the Searcher worker. |
|
rtIndexMemoryUseRatio |
The real-time memory usage of the Searcher worker. |
|
dumpSegmentLatency |
The time taken to dump real-time data segments during a batch switch on the Searcher worker. |
|
processedDocSize |
Total size of documents processed by the Searcher worker. |