CloudMonitor
Hologres integrates with CloudMonitor to provide visibility into the resource utilization, operational status, and health of your instances. You can monitor key metrics and configure alert rules to detect anomalies and respond quickly.
Prerequisites
You have purchased a Hologres instance.
Recommendations
CloudMonitor supports metrics by Hologres instance type, including Hologres follower instance, Hologres acceleration instance, Hologres standard instance, and Hologres warehouse instance. Each type has dedicated metrics for monitoring and troubleshooting. We recommend that you monitor by specific instance type. On the Hologres page in the CloudMonitor console, use the region selector at the top and switch between instance types in the tab bar. You can click Create Alert Rule or View Alert Rules to manage alerts.
CloudMonitor metrics
For more information about the Hologres instance metrics that are supported by CloudMonitor, see Metrics in the Hologres console.
Metric and system event definitions
CloudMonitor publishes the monitoring metadata of each cloud service on a dedicated Metric List page. The Hologres Metric List page lists every time series metric and system event that Hologres reports to CloudMonitor. Each time series metric entry shows its Metric ID, description, unit, dimensions, and minimum statistical period (Min Periods). Each system event entry shows its name, description, status, and severity.
The Hologres namespace in CloudMonitor is acs_hologres. Each instance type reports its own set of metrics, so you can browse metrics by instance type.
|
Instance type |
Metric List page |
|
All instance types (the |
|
|
General-purpose instance |
|
|
Virtual warehouse instance |
|
|
Shared Cluster (Lakehouse Acceleration Edition) instance |
|
|
Follower instance |
-
To open a Metric List page, log on with an Alibaba Cloud account. A RAM user must also have read permissions on CloudMonitor. For more information, see Grant permissions to a RAM user.
-
A Metric List page reflects the metrics and events that CloudMonitor currently receives. If the page differs from this topic or from Metrics in the Hologres console, follow the Metric List page.
-
When you query monitoring data through the CloudMonitor API, the namespace, metric name, dimensions, and period all come from this page. For more information, see Access metrics by using APIs.
View metrics
View metrics in the CloudMonitor console.
-
Log on to the CloudMonitor console.
-
In the left-side navigation pane, click Cloud Service Monitoring.
-
In the Big Data section, click the target instance type, such as Hologres follower instance, Hologres acceleration instance, Hologres standard instance, or Hologres warehouse instance, to open the Hologres monitoring dashboard.
-
Click the
icon next to the region and select your region. -
Click an Instance ID or click Monitoring Chart in the Actions column to view the instance's metrics.
NoteYou can specify a time range to view instance metrics. Monitoring data is retained for up to 30 days.
Monitoring and alerting practices
Initiative alert
You can enable initiative alert in CloudMonitor to apply default alert rules to all your instances. After you enable this feature, alert rules are created for metrics such as CPU usage, disk usage, memory usage, and connection count. These rules apply to all Hologres instances under your Alibaba Cloud account (primary account). The default alert rules are:
-
If the average connection usage (Info) is greater than or equal to 95% for three consecutive cycles, CloudMonitor sends a notification to the alert contact group.
-
If the average storage usage (Warn) is greater than 90% for three consecutive cycles, CloudMonitor sends a notification to the alert contact group.
-
If the average memory usage (Warn) is greater than or equal to 90% for three consecutive cycles, CloudMonitor sends a notification to the alert contact group.
-
If the average CPU usage (Info) is greater than or equal to 99% for three consecutive cycles, CloudMonitor sends a notification to the alert contact group.
By default, the alert cycle is 5 minutes. You can customize this setting.
Create an alert rule
In addition to the default initiative alert rules, you can create custom alert rules for other metrics. To create an alert rule:
-
Log on to the CloudMonitor console.
-
In the left-side navigation pane, choose .
-
On the Alert Rule page, click Create Alert Rules and configure alert information as prompted. For more information, see Create an alert rule.
Alert setting best practices
Instance CPU usage (%)
Indicates whether your Hologres resources are bottlenecked or fully utilized. Recommended alert rules:
-
Alert rules:
-
Critical: Trigger an alert if the instance CPU usage is 99% or higher for 60 consecutive 1-minute periods. If usage stays consistently high, scale out.
-
Warn: Trigger an alert if the instance CPU usage is 99% or higher for 10 consecutive 1-minute periods. Check whether high CPU usage is caused by business changes.
-
-
Do not trigger an alert on a single occurrence of 100% CPU usage. A brief spike does not necessarily indicate overload — it can represent efficient resource utilization.
-
Do not set the CPU alert threshold too low. System components may consume resources even when no tasks are running.
Worker CPU usage (%)
Indicates whether a resource bottleneck exists on any worker node and how fully the resources are used. Recommended alert rules:
-
Alert rules:
-
Critical: Trigger an alert if the CPU usage of a worker node is 99% or higher for 60 consecutive 1-minute periods. If usage stays consistently high, scale out.
-
Warn: Trigger an alert if the CPU usage of a worker node is 99% or higher for 10 consecutive 1-minute periods. Check whether high CPU usage is caused by business changes.
-
-
Do not trigger an alert on a single occurrence of 100% CPU usage on a worker node. A brief spike does not necessarily indicate overload — it can represent efficient resource utilization.
-
Do not set the CPU alert threshold too low. System components may consume resources even when no tasks are running.
Instance memory usage (%)
Reflects overall memory usage of the instance. Recommended alert rules:
-
Alert rules:
-
Critical: Trigger an alert if the instance memory usage is 99% or higher for 60 consecutive 1-minute periods. If usage stays consistently high, scale out.
-
Warn: Trigger an alert if the instance memory usage is 99% or higher for 10 consecutive 1-minute periods. Check whether high memory usage is caused by business changes.
-
-
Do not set the memory alert threshold too low. Memory is used for queries, metadata, and caches, so some memory is consumed even when the instance is idle.
Worker memory usage (%)
Reflects memory usage of individual worker nodes. Recommended alert rules:
-
Alert rules:
-
Critical: Trigger an alert if the memory usage of a worker node is 99% or higher for 60 consecutive 1-minute periods. If usage stays consistently high, scale out.
-
Warn: Trigger an alert if the memory usage of a worker node is 99% or higher for 10 consecutive 1-minute periods. Check whether high memory usage is caused by business changes.
-
-
Do not set the memory alert threshold too low. Memory is used for queries, metadata, and caches, so some memory is consumed even when the instance is idle.
Max FE connection usage (%)
Warn: Trigger an alert if the maximum FE connection usage is 95% or higher for 5 consecutive 1-minute periods. This helps you monitor connection usage and clear idle connections promptly.
Max FE binlog WAL sender usage (%)
Reflects the maximum WAL sender usage across all FEs. Recommended alert rule:
Warn: Trigger an alert if the maximum FE WAL sender usage is 95% or higher for 5 consecutive 1-minute periods.
Longest active query time (milliseconds)
Monitors for long-running queries on your instance. Recommended alert rule:
Warn: Trigger an alert if the longest active query time is 3,600,000 milliseconds or longer for 10 consecutive 1-minute periods.
Longest active serverless computing query time (milliseconds)
Monitors serverless computing tasks. If a task runs too long, you can terminate it. Recommended alert rule:
Warn: Trigger an alert if the longest active query time in serverless computing is 3,600,000 milliseconds or longer for 10 consecutive 1-minute periods.
Failed query QPS (count/s)
Shows the number of failed queries on the instance. Recommended alert rule:
Warn: Trigger an alert if the Failed Query QPS is 10 count/s or higher for 10 consecutive 1-minute periods. If a large number of queries fail, check the failure details in slow query logs and optimize accordingly.
FE replay time (milliseconds)
Indicates the replay time for each FE. Excessive replay time suggests a slow or stuck FE, which can cause queries to stall. Recommended alert rules:
-
Alert rule:
Warn: Trigger an alert if the FE Replay Running Time is 300,000 milliseconds or longer for 10 consecutive 1-minute periods. Check the Active Queries page in the HoloWeb console for long-running queries and try to terminate them.
-
Do not set the FE replay time threshold too low. FE replay occurs whenever instance metadata is modified, and a replay time of a few seconds is normal.
Instance sync lag (milliseconds)
Displayed only for follower instances. Shows the data synchronization latency between primary and follower instances. Recommended alert rule:
Warn: Trigger an alert if the instance sync lag is 600,000 milliseconds or longer for 10 consecutive 1-minute periods.
Tables with missing stats by DB (count/s)
Reflects the quality of the auto-analyze feature. If a table has missing statistics for an extended period, manually run the ANALYZE command on the table. For more information, see ANALYZE and AUTO ANALYZE. Recommended alert rules:
-
Alert rule:
Warn: Trigger an alert if the number of tables that are missing statistics in each database is 10 or higher for 60 consecutive 1-minute periods.
-
Do not set the alert threshold too low. If an instance has many tables, the auto-analyze process may be slow.
Subscribe to system events
In addition to time series metrics, Hologres reports selected O&M operations to CloudMonitor as system events. Subscribe to these events to receive notifications by SMS or email and stay aware of the O&M operations that run on your instance. The following system events are available:
|
Feature |
System events |
|
Time-based elasticity for compute groups |
Time-based elasticity configuration started for compute group, Time-based elasticity configuration completed for compute group, Scheduled elastic scaling for the compute group failed |
|
O&M events |
Scheduled event created, Scheduled event execution started, Scheduled event execution succeeded, Scheduled event execution failed, Scheduled event canceled, Scheduled event execution time changed |
-
View events: Log on to the CloudMonitor console. In the left-side navigation pane, choose . On the Event Monitoring tab, filter events by product, severity, event name, and time range, and set Product to Hologres. For more information, see View system events.
-
Subscribe to events: On the System Events page, click Create Now. Set Subscription Type to System Event and Product to Hologres. For the complete procedure, see Set up event alerts.
-
For the full definition of each system event, including its name, description, status, and severity, see the Hologres Metric List page.
-
The legacy system event alert rule feature is no longer updated and will be phased out. Use event subscription instead.
Troubleshoot common monitoring issues
If a metric fluctuates unexpectedly or an alert is triggered, see FAQ about monitoring metrics for troubleshooting guidance.
Access metrics by using APIs
CloudMonitor also provides custom dashboards and APIs for more flexible access to metrics.
-
To access CloudMonitor by using APIs, see Cloud Service Monitoring.
-
To use a custom monitoring dashboard, see Manage custom dashboards.
-
To access Hologres monitoring by using Application Real-Time Monitoring Service (ARMS), see Integration guide.
Before you call the API, open the Hologres Metric List page to look up the values that you need. Set the namespace to acs_hologres, take the metric name from the Metric ID column, the period from the Min Periods column, and the dimensions from the Dimensions column. You do not need to provide userId. CloudMonitor automatically fills in the ID of the current account. For details about how these values are constructed, see Appendix 1: Metrics for Alibaba Cloud products.
Grant permissions to a RAM user
By default, RAM users cannot view metrics in CloudMonitor. You must grant the required permissions.
Log on to the Resource Access Management (RAM) console with your Alibaba Cloud account (primary account) and grant one of the following policies to the RAM user. For more information, see Grant permissions to a RAM user.
You can also select policies based on your business requirements.
|
Policy name |
Description |
|
AliyunCloudMonitorFullAccess |
Permissions to fully manage CloudMonitor. |
|
AliyunCloudMonitorReadOnlyAccess |
Read-only permissions on CloudMonitor. |
|
AliyunCloudMonitorMetricDataReadOnlyAccess |
Permissions to read time series metric data in CloudMonitor. |