Managed Service for Prometheus exposes self-monitoring metrics that track agent health, scrape performance, write throughput, resource consumption, and scaling behavior. All metrics on this page are free of charge.
Use these metrics to detect issues such as scrape delays, write failures, resource exhaustion, and scaling problems before they affect your monitoring pipeline.
Scrape metrics
Track how the agent discovers targets, runs scraping jobs, and collects time series.
Metric | Description |
aliyun_prometheus_agent_all_series_num | Total number of time series scraped per epoch. |
aliyun_prometheus_agent_all_targets_num | Total number of targets scraped per epoch. |
aliyun_prometheus_agent_blackbox_probe_total | Total number of Blackbox Probe executions. |
aliyun_prometheus_agent_job_discovery_status | Whether the collection configuration was loaded successfully. |
aliyun_prometheus_agent_job_scrape_status | Whether the default collection configuration was scraped successfully. |
aliyun_prometheus_agent_scrape_error_targets_num | Number of targets that failed during a scrape. |
aliyun_prometheus_agent_scrape_latency | Distribution of scrape latency across scraping jobs. |
aliyun_prometheus_agent_scrape_samples_total | Total number of time series collected by scraping jobs. |
aliyun_prometheus_agent_target_info | Detailed information about the agent's scraping job. |
aliyun_prometheus_agent_relabel_error_num | Number of errors in the agent's Relabel Config. |
Scrape delay metrics
Indicate whether scraping jobs exceed acceptable latency thresholds. Use these metrics to identify collection bottlenecks in basic and custom scraping jobs.
Metric | Description |
aliyun_prometheus_agent_scrape_base_delay_15 | Whether the delay for basic scraping jobs exceeds 15 seconds. |
aliyun_prometheus_agent_scrape_base_delay_60 | Whether the delay for basic scraping jobs exceeds 60 seconds. |
aliyun_prometheus_agent_scrape_base_error | Whether an error occurred during a basic scraping job. |
aliyun_prometheus_agent_scrape_custom_delay_15 | Whether the delay for custom scraping jobs exceeds 15 seconds. |
aliyun_prometheus_agent_scrape_custom_delay_60 | Whether the delay for custom scraping jobs exceeds 60 seconds. |
aliyun_prometheus_agent_scrape_custom_error | Whether an error occurred during a custom scraping job. |
Write metrics
Track how the agent writes scraped data to the backend, including success rates, failure counts, and retry behavior.
Metric | Description |
aliyun_prometheus_agent_write_total | Total number of write operations. |
aliyun_prometheus_agent_write_succeed_batch_total | Total number of data packets written successfully. |
aliyun_prometheus_agent_write_succeed_bytes_total | Total bytes written successfully. |
aliyun_prometheus_agent_write_fail_batch_total | Total number of data packets that failed to be written. |
aliyun_prometheus_agent_write_fail_bytes_total | Total bytes that failed to be written. |
aliyun_prometheus_agent_write_fail_total | Total number of write failures after all retries are exhausted. |
aliyun_prometheus_agent_write_fail500_total | Number of retries for write operations. |
aliyun_prometheus_agent_write_fail_down_grade_total | Number of downgrades caused by write failures. |
aliyun_prometheus_agent_write_arms_duration_num | Time spent sending data from the agent. |
aliyun_prometheus_agent_writert_total | Time spent on write operations. |
aliyun_prometheus_agent_drop_metrics_exist | Whether dropped metrics exist. |
Remote Write metrics
Track the Prometheus Remote Write protocol, including batch success rates, failure counts, and write downgrades.
Metric | Description |
aliyun_prometheus_agent_remote_write_duration_ms | Time spent on Remote Write operations. |
aliyun_prometheus_agent_remote_write_succeed_batch_total | Total number of data packets written successfully via Remote Write. |
aliyun_prometheus_agent_remote_write_succeed_bytes_total | Total number of data bytes from remote writes by the probe that failed. |
aliyun_prometheus_agent_remote_write_failed_batch_total | Total number of data packets that failed via Remote Write. |
aliyun_prometheus_agent_remote_write_failed_down_grade_total | Number of write downgrades caused by Remote Write failures. |
Data sending metrics
Monitor the agent's outbound data pipeline, including queue capacity, batch duration, and delivery failures.
Metric | Description |
aliyun_prometheus_agent_send_batch_duration_seconds | Time spent sending a single data packet. |
aliyun_prometheus_agent_send_batch_compressed_bytes_exceeds_limit_total | Number of compressed data packets that exceed the size limit. |
aliyun_prometheus_agent_send_data_queue_capicaty | Capacity of the agent's data sending queue. |
aliyun_prometheus_agent_send_data_queue_length | Used capacity of the agent's data sending queue. |
aliyun_prometheus_agent_dns_not_available_total | Number of times DNS was unavailable when sending data. |
aliyun_prometheus_agent_local_storage_conflicts_total | Whether the agent's internal queue is blocked. |
aliyun_prometheus_agent_memorybackpressure_total | Number of times backpressure occurred because the agent failed to send data. |
aliyun_prometheus_agent_unzip_response_body_exceed_512M | Number of times the uncompressed size of a single collection from a target exceeds 512 MB. |
Resource metrics
Report CPU and memory consumption, resource limits, and out-of-memory (OOM) restarts.
Metric | Description |
aliyun_prometheus_agent_cpu_limit | CPU resource limit for the agent. |
aliyun_prometheus_agent_cpu_usage_rate | CPU utilization of the agent, as a percentage. |
aliyun_prometheus_agent_memory_usage_rate | Memory utilization of the agent, as a percentage. |
aliyun_prometheus_agent_memorylimit_alloc_mb | Memory allocated to the probe. |
aliyun_prometheus_agent_memorylimit_limit_mb | Memory limit allocated to the agent. |
aliyun_prometheus_agent_restart_by_oom_num | Number of times the agent restarted due to an out-of-memory (OOM) error. |
Agent health metrics
Track agent liveness and initialization status.
Metric | Description |
aliyun_prometheus_agent_heartbeat | Agent heartbeat counter. Auto-increments by 1 every 15 seconds. |
aliyun_prometheus_agent_regis_fail_total | Total number of times the agent failed to initialize resources. |
Cluster and scaling metrics
Track cluster topology, horizontal scaling, and replica management.
Metric | Description |
aliyun_prometheus_agent_cluster_node_num | Total number of nodes in the container cluster. |
aliyun_prometheus_agent_replica_current_num | Expected number of replicas currently running. |
aliyun_prometheus_agent_scale_out_failed | Whether the agent scale-out failed. |
aliyun_prometheus_agent_scale_out_fail_count | Number of times the agent failed to scale out. |
aliyun_prometheus_agent_hpa_max_limit | Maximum number of replicas allowed during horizontal scaling of the agent. |
Master-worker coordination metrics
Track how the master node distributes scraping jobs to worker nodes and syncs configuration.
Metric | Description |
aliyun_prometheus_agent_master_send_targets_time | Time spent by the master node distributing scraping jobs. |
aliyun_prometheus_agent_master_send_targets_total | Number of times the master node distributed scraping jobs. |
aliyun_prometheus_agent_send_config_fail_total | Number of times the master node failed to sync the collection configuration. |
aliyun_prometheus_agent_send_discovery_config_fail_total | Number of times the master node failed to sync scraping jobs. |
aliyun_prometheus_agent_sync_worker_series_duration_ms | Time spent by the master node syncing the status of scraping jobs. |
aliyun_prometheus_agent_worker_series_num | Total number of time series collected by worker nodes. |
aliyun_prometheus_agent_worker_targets_num | Total jobs collected by the probe from the secondary node. |