Basic metrics for container clusters

更新时间:
复制 MD 格式

This topic describes the basic metrics that Managed Service for Prometheus collects from container clusters.

Important
  • Managed Service for Prometheus charges based on write volume or the number of data points reported. Metrics are categorized into two types:

    • Basic metrics: Managed Service for Prometheus does not charge for basic metrics collected from Alibaba Cloud Container Service, such as ACK, ACS, ASK, ACK One, and ACK Edge. This benefit does not extend to other types of container clusters.

    • Custom metrics: All other metrics are custom metrics. Billing for custom metrics started on January 6, 2020.

  • Effective 00:00:00 on November 12, 2024 (UTC+8), Managed Service for Prometheus will adjust the scope of basic metrics collected from Alibaba Cloud Container Service clusters.

Only the basic metrics described in this topic are collected from container clusters by default.

Any other container cluster metrics are custom metrics and are billable. For billing standards, see Prometheus instance billing.

cAdvisor (Job name: _arms/kubelet/cadvisor)

Metric

Description

container_cpu_usage_seconds_total

The total CPU time consumed by the container, in seconds.

container_fs_usage_bytes

The amount of file system space used by the container, in bytes.

container_memory_cache

The amount of memory cache used by the container, in bytes.

container_memory_usage_bytes

The amount of memory used by the container, in bytes.

container_memory_working_set_bytes

The memory working set of the container, in bytes.

container_network_receive_bytes_total

Total bytes received by the container over the network.

container_network_transmit_bytes_total

Total bytes transmitted by the container over the network.

container_scrape_error

A value of 1 indicates a container metric scraping error.

container_spec_memory_limit_bytes

The memory limit configured for the container, in bytes.

container_spec_cpu_quota

The CFS CPU quota configured for the container.

container_sockets

The number of active TCP/UDP network sockets in the container.

container_network_transmit_errors_total

Total transmit (outgoing) packet errors on the container's network interface.

container_network_receive_errors_total

Total receive (incoming) packet errors on the container's network interface.

container_memory_rss

The resident set size (RSS) of the container, in bytes.

container_cpu_user_seconds_total

The total CPU time consumed by the container in user mode, in seconds.

container_cpu_system_seconds_total

The total CPU time consumed by the container in kernel mode, in seconds.

DCGM_CUSTOM_CONTAINER_CP_ALLOCATED

The proportion of a GPU's total computing power allocated to the container. The value ranges from 0 to 1. If a container requests only graphics memory, this metric is 0, indicating no limit on computing power. For example, if a GPU has 100 units of computing power and 30 units are allocated to a container, the allocated ratio is 30/100 = 0.3.

DCGM_CUSTOM_CONTAINER_MEM_ALLOCATED

Graphics memory allocated to the container, in bytes.

DCGM_CUSTOM_DEV_FB_ALLOCATED

The proportion of allocated graphics memory relative to the GPU's total graphics memory. The value ranges from 0 to 1.

DCGM_CUSTOM_DEV_FB_TOTAL

Total graphics memory of the GPU, in bytes.

DCGM_CUSTOM_DEV_HEALTH

GPU health status.

DCGM_CUSTOM_PROCESS_DECODE_UTIL

Decoder utilization for a GPU process.

DCGM_CUSTOM_PROCESS_ENCODE_UTIL

Encoder utilization for a GPU process.

DCGM_CUSTOM_PROCESS_MEM_COPY_UTIL

Memory copy utilization for a GPU process.

DCGM_CUSTOM_PROCESS_MEM_USED

Graphics memory currently used by a GPU process, in bytes.

DCGM_CUSTOM_PROCESS_SM_UTIL

SM utilization for a GPU process.

DCGM_CUSTOM_PROF_MEM_BANDWIDTH_USED

Used graphics memory bandwidth.

DCGM_CUSTOM_PROF_TENS_TFPS_USED

GPU Tensor Core usage.

DCGM_FI_DEV_DEC_UTIL

The GPU's decoder utilization.

DCGM_FI_DEV_ENC_UTIL

The GPU's encoder utilization.

DCGM_FI_DEV_FB_FREE

Free framebuffer memory, in bytes.

DCGM_FI_DEV_FB_USED

Used framebuffer memory, in bytes. This value corresponds to the used memory value under Memory-Usage reported by the nvidia-smi command.

DCGM_FI_DEV_GPU_TEMP

GPU temperature, in degrees Celsius.

DCGM_FI_DEV_GPU_UTIL

The GPU utilization, which represents the percentage of time over a sample period (e.g., 1s or 1/6s, depending on the GPU product) when one or more kernel functions were active. This metric shows that GPU resources are in use by a kernel function, but does not detail the intensity of that use.

DCGM_FI_DEV_MEM_CLOCK

Memory clock frequency, in MHz.

DCGM_FI_DEV_MEM_COPY_UTIL

Memory bandwidth utilization. For example, an NVIDIA V100 GPU has a maximum memory bandwidth of 900 GB/s. If the current memory bandwidth is 450 GB/s, the utilization is 50%.

DCGM_FI_DEV_POWER_USAGE

Power usage, in watts.

DCGM_FI_DEV_SM_CLOCK

SM clock frequency, in MHz.

DCGM_FI_DEV_TOTAL_ENERGY_CONSUMPTION

The total energy consumed since the driver was loaded, in millijoules.

DCGM_FI_DEV_XID_ERRORS

The code for the last XID error that occurred during the sample period.

DCGM_FI_PROF_DRAM_ACTIVE

The fraction of cycles during which data is sent to or received from the device memory. This metric represents memory bandwidth utilization.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher device memory utilization.

A value of 1.0 (100%) means a DRAM instruction was executed every cycle during the interval. In practice, the maximum achievable value is approximately 0.8 (80%).

For example, a value of 0.2 (20%) means that for 20% of the cycles in the interval, device memory was read from or written to.

DCGM_FI_PROF_NVLINK_RX_BYTES

Data receive rate over NVLink, excluding protocol headers.

This value is an average over a time interval, not an instantaneous value.

The rate is averaged over the interval. For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer occurred at a constant rate or in a burst. The theoretical maximum bandwidth for NVLink Gen2 is 25 GB/s per link in each direction.

DCGM_FI_PROF_NVLINK_TX_BYTES

Total bytes transmitted (sent) over NVLink.

DCGM_FI_PROF_PCIE_RX_BYTES

Data receive rate over the PCIe bus, including protocol headers and data payload.

This value is an average over a time interval, not an instantaneous value.

The rate is averaged over the interval. For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer occurred at a constant rate or in a burst. The theoretical maximum bandwidth for PCIe Gen3 is 985 MB/s per lane.

DCGM_FI_PROF_PCIE_TX_BYTES

Data transmission rate over the PCIe bus, including protocol headers and data payload.

This value is an average over a time interval, not an instantaneous value.

The rate is averaged over the interval. For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer occurred at a constant rate or in a burst. The theoretical maximum bandwidth for PCIe Gen3 is 985 MB/s per lane.

DCGM_FI_PROF_PIPE_TENSOR_ACTIVE

The fraction of cycles the Tensor (HMMA/IMMA) pipe is active.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher utilization of the Tensor Cores.

A value of 1.0 (100%) means a Tensor instruction was issued every other cycle, as one instruction takes two cycles to complete.

A value of 0.2 (20%) could indicate any of the following scenarios:

20% of SMs ran their Tensor Cores at 100% utilization throughout the interval.

100% of SMs ran their Tensor Cores at 20% utilization throughout the interval.

100% of SMs ran their Tensor Cores at 100% utilization for one-fifth of the interval.

Other combinations.

DCGM_FI_PROF_SM_ACTIVE

The percentage of time during an interval that at least one warp was active on a streaming multiprocessor (SM). This value is an average across all SMs and is not sensitive to the number of threads per block. A warp is considered active if it is scheduled and its resources are allocated, regardless of whether it is computing or in a non-computing state (e.g., waiting for a memory request). A value below 0.5 indicates inefficient GPU utilization, while a value above 0.8 is desirable. For a GPU with N SMs, consider these examples: If a kernel function runs with N thread blocks on all SMs for the entire interval, the value is 1 (100%). If a kernel function runs with N/5 thread blocks during the interval, the value is 0.2. If a kernel function runs with N thread blocks but for only one-fifth of the interval, the value is 0.2.

machine_cpu_cores

Number of CPU cores on the machine.

node_exporter_build_info

Build information for the node exporter.

nvidia_gpu_duty_cycle

The percentage of time over the last sample period during which one or more kernel functions were executing on the GPU.

nvidia_gpu_memory_total_bytes

Total NVIDIA GPU memory, in bytes.

nvidia_gpu_memory_used_bytes

Used memory on the NVIDIA GPU, in bytes.

nvidia_gpu_num_devices

Number of NVIDIA GPU devices.

nvidia_gpu_power_usage_milliwatts

NVIDIA GPU power consumption, in milliwatts.

nvidia_gpu_temperature_celsius

NVIDIA GPU temperature, in degrees Celsius.

rdma_service_monitor_local_ack_timeout_err

Number of RDMA network timeout errors.

rdma_service_monitor_out_of_seq

Number of out-of-sequence RDMA network data packets.

rdma_service_monitor_packet_seq_err

Number of RDMA network packet sequence errors during transmission.

rdma_service_monitor_rx_bytes

Receive throughput of the RDMA network.

rdma_service_monitor_rx_packets

Number of packets received by the RDMA network.

rdma_service_monitor_tx_bytes

Transmit throughput of the RDMA network.

rdma_service_monitor_tx_packets

Number of packets transmitted by the RDMA network.

up

A value of 1 means the target is up and reachable, while 0 indicates it is down.

ACK control plane APIServer (Includes control plane components—APIServer, etcd, scheduler, KCM, and CCM—for ACK Pro clusters, and only the APIServer for ACK dedicated clusters) (job name: apiserver)

Metric

Description

aggregator_discovery_aggregation_count_total

Total count of discovery aggregations performed by the aggregator.

aggregator_openapi_v2_regeneration_count

Number of times the aggregator has regenerated the OpenAPI v2 specification.

aggregator_openapi_v2_regeneration_duration

Duration of OpenAPI v2 specification regeneration by the aggregator.

aggregator_unavailable_apiservice

A gauge of unavailable APIService instances detected by the aggregator.

aggregator_unavailable_apiservice_count

Number of unavailable APIService instances detected by the aggregator.

aggregator_unavailable_apiservice_total

Total number of unavailable APIService instances detected by the aggregator over time.

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations by the Alibaba Cloud Prometheus Agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Discovery status of jobs for the Alibaba Cloud Prometheus Agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by target for the Alibaba Cloud Prometheus Agent.

aliyun_prometheus_agent_target_info

Information about the Alibaba Cloud Prometheus Agent's targets.

apiextensions_apiserver_validation_ratcheting_seconds_bucket

Latency histogram of APIServer validation ratcheting, in seconds.

apiextensions_apiserver_validation_ratcheting_seconds_count

Total observations in the APIServer validation ratcheting latency histogram.

apiextensions_apiserver_validation_ratcheting_seconds_sum

Total sum of durations for the APIServer validation ratcheting latency histogram, in seconds.

apiextensions_openapi_v2_regeneration_count

Number of times the apiextensions OpenAPI v2 specification has been regenerated.

apiextensions_openapi_v3_regeneration_count

Number of times the apiextensions OpenAPI v3 specification has been regenerated.

apiserver_accepted_listall_requests_total

Total number of list-all requests accepted by the APIServer.

apiserver_admission_controller_admission_duration_seconds_bucket

Latency histogram of the admission controller, in seconds.

apiserver_admission_controller_admission_duration_seconds_count

Total observations in the admission controller latency histogram.

apiserver_admission_controller_admission_duration_seconds_sum

Total sum of durations for the admission controller latency histogram, in seconds.

apiserver_admission_step_admission_duration_seconds_bucket

Latency histogram for individual admission steps, in seconds.

apiserver_admission_step_admission_duration_seconds_count

Total observations in the admission step latency histogram.

apiserver_admission_step_admission_duration_seconds_sum

Total sum of durations for the admission step latency histogram, in seconds.

apiserver_admission_step_admission_duration_seconds_summary

Summary of individual admission step latency, in seconds.

apiserver_admission_step_admission_duration_seconds_summary_count

Total observations in the admission step latency summary.

apiserver_admission_step_admission_duration_seconds_summary_sum

Total sum of durations for the admission step latency summary, in seconds.

apiserver_admission_webhook_admission_duration_seconds_bucket

Latency histogram of the admission webhook, in seconds.

apiserver_admission_webhook_admission_duration_seconds_count

Total observations in the admission webhook latency histogram.

apiserver_admission_webhook_admission_duration_seconds_sum

Total sum of durations for the admission webhook latency histogram, in seconds.

apiserver_admission_webhook_fail_open_count

Number of times an admission webhook has failed open.

apiserver_admission_webhook_rejection_count

Number of rejections by admission webhooks.

apiserver_admission_webhook_request_total

Total number of requests to admission webhooks.

apiserver_audit_error_total

Total number of audit logging errors.

apiserver_audit_event_total

Total number of audit events generated.

apiserver_audit_level_total

Total number of audit events at each level.

apiserver_audit_requests_rejected_total

Total number of rejected audit requests.

apiserver_authorization_decisions_total

Total number of authorization decisions made by the APIServer.

apiserver_cache_list_fetched_objects_total

Total number of objects fetched from the APIServer list cache.

apiserver_cache_list_returned_objects_total

Total number of objects returned from the APIServer list cache.

apiserver_cache_list_total

Total number of APIServer list cache operations.

apiserver_cacher_received_events

Number of events received by the APIServer cacher.

apiserver_cacher_sended_events_latency_milliseconds_bucket

Latency histogram of events sent from the APIServer cacher, in milliseconds.

apiserver_cacher_sended_events_latency_milliseconds_count

Total observations in the cacher event sending latency histogram.

apiserver_cacher_sended_events_latency_milliseconds_sum

Total sum of durations for the cacher event sending latency histogram, in milliseconds.

apiserver_cacher_watcher_channel_length

Length of the APIServer cacher watcher channel.

apiserver_cel_compilation_duration_seconds_bucket

Latency histogram of APIServer CEL compilations, in seconds.

apiserver_cel_compilation_duration_seconds_count

Total number of APIServer CEL compilations.

apiserver_cel_compilation_duration_seconds_sum

Total duration of all APIServer CEL compilations, in seconds.

apiserver_cel_evaluation_duration_seconds_bucket

Latency histogram of APIServer CEL evaluations, in seconds.

apiserver_cel_evaluation_duration_seconds_count

Total count of APIServer CEL evaluations.

apiserver_cel_evaluation_duration_seconds_sum

Total duration of all APIServer CEL evaluations, in seconds.

apiserver_client_certificate_expiration_seconds_bucket

Histogram of remaining seconds before APIServer client certificate expiration.

apiserver_client_certificate_expiration_seconds_count

Total observations in the client certificate expiration histogram.

apiserver_client_certificate_expiration_seconds_sum

Total sum of remaining seconds for the client certificate expiration histogram.

apiserver_clusterip_repair_ip_errors_total

Total number of IP-related errors during ClusterIP repair.

apiserver_clusterip_repair_reconcile_errors_total

Total number of reconciliation errors during ClusterIP repair.

apiserver_conversion_webhook_duration_seconds_bucket

Latency histogram of APIServer conversion webhook calls, in seconds.

apiserver_conversion_webhook_duration_seconds_count

Total number of APIServer conversion webhook calls.

apiserver_conversion_webhook_duration_seconds_sum

Total duration of all APIServer conversion webhook calls, in seconds.

apiserver_conversion_webhook_request_total

Total number of requests to APIServer conversion webhooks.

apiserver_crd_conversion_webhook_duration_seconds_bucket

Latency histogram of APIServer CRD conversion webhook calls, in seconds.

apiserver_crd_conversion_webhook_duration_seconds_count

Total number of APIServer CRD conversion webhook calls.

apiserver_crd_conversion_webhook_duration_seconds_sum

Total duration of all APIServer CRD conversion webhook calls, in seconds.

apiserver_crd_webhook_conversion_duration_seconds_bucket

Latency histogram of APIServer CRD webhook conversions, in seconds.

apiserver_crd_webhook_conversion_duration_seconds_count

Total count of APIServer CRD webhook conversions.

apiserver_crd_webhook_conversion_duration_seconds_sum

Total duration of all APIServer CRD webhook conversions, in seconds.

apiserver_created_watchers

Number of watchers created by the APIServer.

apiserver_current_inflight_requests

Current number of in-flight requests handled by the APIServer.

apiserver_current_inqueue_requests

Current number of requests in the APIServer queue.

apiserver_dropped_requests_total

Total number of requests dropped by the APIServer.

apiserver_encryption_config_controller_automatic_reload_failures_total

Total number of failed automatic reloads of the APIServer encryption configuration controller.

apiserver_encryption_config_controller_automatic_reload_success_total

Total number of successful automatic reloads of the APIServer encryption configuration controller.

apiserver_envelope_encryption_dek_cache_fill_percent

Fill percentage of the DEK cache for APIServer envelope encryption.

apiserver_error_watchers

Number of APIServer error watchers.

apiserver_flowcontrol_current_executing_requests

Current number of requests executing under APIServer flow control.

apiserver_flowcontrol_current_executing_seats

Current number of occupied seats under APIServer flow control.

apiserver_flowcontrol_current_inqueue_requests

Current number of requests in the queue under APIServer flow control.

apiserver_flowcontrol_current_inqueue_seats

Current number of seats in the queue under APIServer flow control.

apiserver_flowcontrol_current_limit_seats

Current seat limit for APIServer flow control.

apiserver_flowcontrol_current_r

Current R value for APIServer flow control.

apiserver_flowcontrol_demand_seats_average

Average seat demand for APIServer flow control.

apiserver_flowcontrol_demand_seats_bucket

Histogram of seat demand for APIServer flow control.

apiserver_flowcontrol_demand_seats_count

Total observations in the seat demand histogram.

apiserver_flowcontrol_demand_seats_high_watermark

High watermark of seat demand for APIServer flow control.

apiserver_flowcontrol_demand_seats_smoothed

Smoothed value of seat demand for APIServer flow control.

apiserver_flowcontrol_demand_seats_stdev

Standard deviation of seat demand for APIServer flow control.

apiserver_flowcontrol_demand_seats_sum

Total sum of observations for the seat demand histogram.

apiserver_flowcontrol_dispatch_r

Dispatch R value for APIServer flow control.

apiserver_flowcontrol_dispatched_requests_total

Total number of requests dispatched under APIServer flow control.

apiserver_flowcontrol_latest_s

Latest S value bound for APIServer flow control.

apiserver_flowcontrol_lower_limit_seats

Lower seat limit for APIServer flow control.

apiserver_flowcontrol_next_discounted_s_bounds

Next discounted S value bound for APIServer flow control.

apiserver_flowcontrol_next_s_bounds

Next S value bound for APIServer flow control.

apiserver_flowcontrol_nominal_limit_seats

Nominal seat limit for APIServer flow control.

apiserver_flowcontrol_priority_level_request_count_samples_bucket

Histogram of request count samples for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_request_count_samples_count

Total observations in the priority level request count samples histogram.

apiserver_flowcontrol_priority_level_request_count_samples_sum

Total sum for the priority level request count samples histogram.

apiserver_flowcontrol_priority_level_request_count_watermarks_bucket

Histogram of request count watermarks for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_request_count_watermarks_count

Total observations in the priority level request count watermarks histogram.

apiserver_flowcontrol_priority_level_request_count_watermarks_sum

Total sum for the priority level request count watermarks histogram.

apiserver_flowcontrol_priority_level_request_utilization_bucket

Histogram of request utilization for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_request_utilization_count

Total observations in the priority level request utilization histogram.

apiserver_flowcontrol_priority_level_request_utilization_sum

Total sum for the priority level request utilization histogram.

apiserver_flowcontrol_priority_level_seat_count_samples_bucket

Histogram of seat count samples for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_seat_count_samples_count

Total observations in the priority level seat count samples histogram.

apiserver_flowcontrol_priority_level_seat_count_samples_sum

Total sum for the priority level seat count samples histogram.

apiserver_flowcontrol_priority_level_seat_count_watermarks_bucket

Histogram of seat count watermarks for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_seat_count_watermarks_count

Total observations in the priority level seat count watermarks histogram.

apiserver_flowcontrol_priority_level_seat_count_watermarks_sum

Total sum for the priority level seat count watermarks histogram.

apiserver_flowcontrol_priority_level_seat_utilization_bucket

Histogram of seat utilization for each priority level in APIServer flow control.

apiserver_flowcontrol_priority_level_seat_utilization_count

Total observations in the priority level seat utilization histogram.

apiserver_flowcontrol_priority_level_seat_utilization_sum

Total sum for the priority level seat utilization histogram.

apiserver_flowcontrol_read_vs_write_current_requests_bucket

Histogram of current read vs. write requests in APIServer flow control.

apiserver_flowcontrol_read_vs_write_current_requests_count

Total observations in the read vs. write current requests histogram.

apiserver_flowcontrol_read_vs_write_current_requests_sum

Total sum for the read vs. write current requests histogram.

apiserver_flowcontrol_read_vs_write_request_count_samples_bucket

Histogram of read vs. write request count samples in APIServer flow control.

apiserver_flowcontrol_read_vs_write_request_count_samples_count

Total number of samples for the read vs. write request count histogram.

apiserver_flowcontrol_read_vs_write_request_count_samples_sum

Total sum for the read vs. write request count samples histogram.

apiserver_flowcontrol_read_vs_write_request_count_watermarks_bucket

Histogram of read vs. write request count watermarks in APIServer flow control.

apiserver_flowcontrol_read_vs_write_request_count_watermarks_count

Total number of samples for the read vs. write request count watermarks histogram.

apiserver_flowcontrol_read_vs_write_request_count_watermarks_sum

Total sum for the read vs. write request count watermarks histogram.

apiserver_flowcontrol_rejected_requests_total

Total number of requests rejected by APIServer flow control.

apiserver_flowcontrol_request_concurrency_in_use

Number of concurrent requests in use by APIServer flow control.

apiserver_flowcontrol_request_concurrency_limit

Concurrency limit for requests in APIServer flow control.

apiserver_flowcontrol_request_dispatch_no_accommodation_total

Total number of requests that could not be dispatched due to no accommodation in APIServer flow control.

apiserver_flowcontrol_request_execution_seconds_bucket

Latency histogram of request execution in APIServer flow control, in seconds.

apiserver_flowcontrol_request_execution_seconds_count

Total observations in the request execution latency histogram.

apiserver_flowcontrol_request_execution_seconds_sum

Total sum of durations for the request execution latency histogram, in seconds.

apiserver_flowcontrol_request_queue_length_after_enqueue_bucket

Histogram of queue length after enqueue for APIServer flow control requests.

apiserver_flowcontrol_request_queue_length_after_enqueue_count

Total observations in the request queue length histogram.

apiserver_flowcontrol_request_queue_length_after_enqueue_sum

Total sum for the request queue length histogram.

apiserver_flowcontrol_request_wait_duration_seconds_bucket

Latency histogram of request wait time in APIServer flow control, in seconds.

apiserver_flowcontrol_request_wait_duration_seconds_count

Total observations in the request wait latency histogram.

apiserver_flowcontrol_request_wait_duration_seconds_sum

Total sum of durations for the request wait latency histogram, in seconds.

apiserver_flowcontrol_seat_fair_frac

Fair-share fraction determined during the last borrowing adjustment period for APIServer flow control.

apiserver_flowcontrol_target_seats

Target seat count for APIServer flow control.

apiserver_flowcontrol_upper_limit_seats

Upper seat limit for APIServer flow control.

apiserver_flowcontrol_watch_count_samples_bucket

Histogram of watch count samples in APIServer flow control.

apiserver_flowcontrol_watch_count_samples_count

Total observations in the watch count samples histogram.

apiserver_flowcontrol_watch_count_samples_sum

Total sum for the watch count samples histogram.

apiserver_flowcontrol_work_estimated_seats_bucket

Histogram of estimated work seats in APIServer flow control.

apiserver_flowcontrol_work_estimated_seats_count

Total observations in the estimated work seats histogram.

apiserver_flowcontrol_work_estimated_seats_sum

Total sum for the estimated work seats histogram.

apiserver_init_events_total

Total number of APIServer initialization events.

apiserver_kube_aggregator_x509_insecure_sha1_total

Total number of requests to the kube-aggregator signed with an insecure SHA-1 signature.

apiserver_kube_aggregator_x509_missing_san_total

Total number of X.509 certificates with a missing SAN in the APIServer kube-aggregator.

apiserver_longrunning_gauge

Gauge of APIServer long-running requests.

apiserver_longrunning_requests

Number of APIServer long-running requests.

apiserver_nodeport_repair_reconcile_errors_total

Total number of reconciliation errors during APIServer NodePort repair.

apiserver_realtime_watchers

Number of APIServer real-time watchers.

apiserver_registered_watchers

Number of registered watchers in the APIServer.

apiserver_request_aborts_total

Total number of aborted APIServer requests.

apiserver_request_body_size_bytes_bucket

Histogram of APIServer request body sizes, in bytes.

apiserver_request_body_size_bytes_count

Total observations in the request body size histogram.

apiserver_request_body_size_bytes_sum

Total sum for the request body size histogram, in bytes.

apiserver_request_count

Number of requests to the APIServer.

apiserver_request_duration_seconds_bucket

Latency histogram of APIServer requests, in seconds.

apiserver_request_duration_seconds_count

Total observations in the request latency histogram.

apiserver_request_duration_seconds_sum

Total sum of durations for the request latency histogram, in seconds.

apiserver_request_filter_duration_seconds_bucket

Latency histogram of APIServer request filters, in seconds.

apiserver_request_filter_duration_seconds_count

Total observations in the request filter latency histogram.

apiserver_request_filter_duration_seconds_sum

Total sum of durations for the request filter latency histogram, in seconds.

apiserver_request_latencies_summary

Summary of the APIServer request latency distribution.

apiserver_request_no_resourceversion_list_total

Total number of LIST requests without a resource version.

apiserver_request_post_timeout_total

Total number of API POST request timeouts.

apiserver_request_sli_duration_seconds_bucket

Latency histogram of API request SLIs (Service Level Indicators), in seconds.

apiserver_request_sli_duration_seconds_count

Total observations in the API request SLI latency histogram.

apiserver_request_sli_duration_seconds_sum

Total sum of durations for the API request SLI latency histogram, in seconds.

apiserver_request_slo_duration_seconds_bucket

Latency histogram of API request SLOs (Service Level Objectives), in seconds.

apiserver_request_slo_duration_seconds_count

Total observations in the API request SLO latency histogram.

apiserver_request_slo_duration_seconds_sum

Total sum of durations for the API request SLO latency histogram, in seconds.

apiserver_request_terminations_total

Total number of API request terminations.

apiserver_request_timestamp_comparison_time_bucket

Histogram of API request timestamp comparison times.

apiserver_request_timestamp_comparison_time_count

Total number of samples for the API request timestamp comparison time histogram.

apiserver_request_timestamp_comparison_time_sum

Total sum for the API request timestamp comparison time histogram.

apiserver_request_total

Total number of API requests.

apiserver_requested_deprecated_apis

Number of APIServer requests for deprecated APIs.

apiserver_response_sizes_bucket

Histogram of API response sizes.

apiserver_response_sizes_count

Total observations in the API response size histogram.

apiserver_response_sizes_sum

Total sum for the API response size histogram.

apiserver_selfrequest_total

Total number of self-requests to the APIServer.

apiserver_storage_data_key_generation_duration_seconds_bucket

Latency histogram of APIServer storage data key generation, in seconds.

apiserver_storage_data_key_generation_duration_seconds_count

Total observations in the data key generation latency histogram.

apiserver_storage_data_key_generation_duration_seconds_sum

Total sum of durations for the data key generation latency histogram, in seconds.

apiserver_storage_data_key_generation_failures_total

Total number of APIServer storage data key generation failures.

apiserver_storage_db_total_size_in_bytes

Total size of the APIServer storage database, in bytes.

apiserver_storage_decode_errors_total

Total number of APIServer storage decoding errors.

apiserver_storage_envelope_transformation_cache_misses_total

Total number of cache misses for APIServer storage envelope encryption transformations.

apiserver_storage_events_received_total

Total number of events received by APIServer storage.

apiserver_storage_list_evaluated_objects_total

Total number of objects evaluated by APIServer storage list operations.

apiserver_storage_list_fetched_objects_total

Total number of objects fetched from APIServer storage list operations.

apiserver_storage_list_returned_objects_total

Total number of objects returned from APIServer storage list operations.

apiserver_storage_list_total

Total number of APIServer storage list operations.

apiserver_storage_objects

Number of objects in APIServer storage.

apiserver_storage_size_bytes

Size of APIServer storage, in bytes.

apiserver_terminated_watchers_total

Total number of terminated watchers in the APIServer.

apiserver_tls_handshake_errors_total

Total number of APIServer TLS handshake errors.

apiserver_too_large_resourceversion_errors

Number of APIServer requests that failed because their resource version was too large.

apiserver_watch_cache_events_dispatched_total

Total number of events dispatched from the APIServer watch cache.

apiserver_watch_cache_events_received_total

Total number of events received by the APIServer watch cache.

apiserver_watch_cache_initializations_total

Total number of APIServer watch cache initializations.

apiserver_watch_cache_read_wait_seconds_bucket

Latency histogram of read waits for the APIServer watch cache, in seconds.

apiserver_watch_cache_read_wait_seconds_count

Total observations in the watch cache read wait latency histogram.

apiserver_watch_cache_read_wait_seconds_sum

Total sum of durations for the watch cache read wait latency histogram, in seconds.

apiserver_watch_cache_watch_cache_initializations_total

Total number of APIServer watch cache initializations.

apiserver_watch_events_sizes_bucket

Histogram of APIServer watch event sizes.

apiserver_watch_events_sizes_count

Total observations in the watch event size histogram.

apiserver_watch_events_sizes_sum

Total sum for the watch event size histogram.

apiserver_watch_events_total

Total number of APIServer watch events.

apiserver_webhooks_x509_insecure_sha1_total

Total number of requests to webhooks signed with an insecure SHA-1 signature.

apiserver_webhooks_x509_missing_san_total

Total number of X.509 certificates with a missing SAN in APIServer webhooks.

authenticated_user_requests

Total number of authenticated user requests.

authentication_attempts

Number of authentication attempts.

authentication_duration_seconds_bucket

Latency histogram of the authentication process, in seconds.

authentication_duration_seconds_count

Total observations in the authentication latency histogram.

authentication_duration_seconds_sum

Total sum of durations for the authentication latency histogram, in seconds.

authentication_token_cache_active_fetch_count

Number of active fetches from the authentication token cache.

authentication_token_cache_fetch_total

Total number of fetches from the authentication token cache.

authentication_token_cache_request_duration_seconds_bucket

Latency histogram of requests to the authentication token cache, in seconds.

authentication_token_cache_request_duration_seconds_count

Total observations in the token cache request latency histogram.

authentication_token_cache_request_duration_seconds_sum

Total sum of durations for the token cache request latency histogram, in seconds.

authentication_token_cache_request_total

Total number of requests to the authentication token cache.

authorization_attempts_total

Total number of authorization attempts.

authorization_duration_seconds_bucket

Latency histogram of the authorization process, in seconds.

authorization_duration_seconds_count

Total observations in the authorization latency histogram.

authorization_duration_seconds_sum

Total sum of durations for the authorization latency histogram, in seconds.

cardinality_enforcement_unexpected_categorizations_total

Total number of unexpected categorizations in cardinality enforcement.

count

The count of items.

cpu_utilization_core

CPU utilization, in cores.

disabled_metric_total

Total number of disabled metrics.

disabled_metrics_total

Total number of disabled metrics.

etcd_bookmark_counts

Count of etcd bookmarks.

etcd_db_total_size_in_bytes

Total size of the etcd database, in bytes.

etcd_lease_object_counts_bucket

Histogram of etcd lease object counts.

etcd_lease_object_counts_count

Total observations in the etcd lease object count histogram.

etcd_lease_object_counts_sum

Total sum for the etcd lease object count histogram.

etcd_object_counts

Count of objects in etcd.

etcd_request_duration_seconds_bucket

Latency histogram of etcd requests, in seconds.

etcd_request_duration_seconds_count

Total observations in the etcd request latency histogram.

etcd_request_duration_seconds_sum

Total sum of durations for the etcd request latency histogram, in seconds.

etcd_request_errors_total

Total number of etcd request errors.

etcd_requests_total

Total number of etcd requests.

etcd_watcher_channel_length

Length of the etcd watcher channel.

etcd_watcher_received_events

Number of events received by the etcd watcher.

etcd_watcher_sended_events_latency_milliseconds_bucket

Latency histogram of events sent from the etcd watcher, in milliseconds.

etcd_watcher_sended_events_latency_milliseconds_count

Total observations in the etcd watcher event sending latency histogram.

etcd_watcher_sended_events_latency_milliseconds_sum

Total sum of durations for the etcd watcher event sending latency histogram, in milliseconds.

field_validation_request_duration_seconds_bucket

Latency histogram of field validation requests, in seconds.

field_validation_request_duration_seconds_count

Total observations in the field validation request latency histogram.

field_validation_request_duration_seconds_sum

Total sum of durations for the field validation request latency histogram, in seconds.

get_token_count

Number of get-token operations.

get_token_fail_count

Number of failed get-token operations.

grpc_client_handled_total

Total number of gRPC client requests handled.

grpc_client_msg_received_total

Total number of messages received by the gRPC client.

grpc_client_msg_sent_total

Total number of messages sent by the gRPC client.

grpc_client_started_total

Total number of gRPC client calls started.

hidden_metric_total

Total number of hidden metrics.

hidden_metrics_total

Total number of hidden metrics.

http_request_duration_microseconds

HTTP request duration, in microseconds.

http_request_size_bytes

HTTP request size, in bytes.

http_requests_total

Total number of HTTP requests.

http_response_size_bytes

HTTP response size, in bytes.

job

The name of the job.

job_instance_mode

The mode of the job instance.

kube_apiserver_clusterip_allocator_allocated_ips

Kubernetes APIServer: Number of allocated IPs in the ClusterIP allocator.

kube_apiserver_clusterip_allocator_allocation_errors_total

Kubernetes APIServer: Total number of allocation errors in the ClusterIP allocator.

kube_apiserver_clusterip_allocator_allocation_total

Kubernetes APIServer: Total number of allocations in the ClusterIP allocator.

kube_apiserver_clusterip_allocator_available_ips

Kubernetes APIServer: Number of available IPs in the ClusterIP allocator.

kube_apiserver_nodeport_allocator_allocated_ports

Kubernetes APIServer: Number of allocated ports in the NodePort allocator.

kube_apiserver_nodeport_allocator_allocation_errors_total

Kubernetes APIServer: Total number of allocation errors in the NodePort allocator.

kube_apiserver_nodeport_allocator_allocation_total

Kubernetes APIServer: Total number of allocations in the NodePort allocator.

kube_apiserver_nodeport_allocator_available_ports

Kubernetes APIServer: Number of available ports in the NodePort allocator.

kube_apiserver_pod_logs_backend_tls_failure_total

Kubernetes APIServer: Total number of pod/logs requests that failed due to backend TLS verification failures.

kube_apiserver_pod_logs_insecure_backend_total

Kubernetes APIServer: Total number of insecure pod/logs requests.

kube_apiserver_pod_logs_pods_logs_backend_tls_failure_total

Kubernetes APIServer: Total number of pod/logs requests that failed due to backend TLS verification failures.

kube_apiserver_pod_logs_pods_logs_insecure_backend_total

Kubernetes APIServer: Total number of insecure pod/logs requests.

kubelet_container_log_filesystem_used_bytes

Kubelet: Container log filesystem usage, in bytes.

kubelet_node_name

Kubelet: The name of the node.

kubelet_pleg_relist_duration_seconds_bucket

Kubelet: Latency histogram of PLEG relist operations, in seconds.

kubelet_pod_worker_duration_seconds_bucket

Kubelet: Latency histogram of pod worker operations, in seconds.

kubelet_volume_stats_available_bytes

Kubelet: Available bytes in the volume.

kubelet_volume_stats_capacity_bytes

Kubelet: Capacity of the volume, in bytes.

kubelet_volume_stats_inodes

Kubelet: Total number of inodes in the volume.

kubelet_volume_stats_inodes_free

Kubelet: Number of free inodes in the volume.

kubelet_volume_stats_inodes_used

Kubelet: Number of used inodes in the volume.

kubelet_volume_stats_used_bytes

Kubelet: Used bytes in the volume.

kubernetes_build_info

Kubernetes build information.

kubernetes_feature_enabled

Enablement status of a Kubernetes feature.

last_list_all_response_size_in_bytes

Size of the last list-all response, in bytes.

memory_utilization_byte

Memory utilization, in bytes.

node_authorizer_graph_actions_duration_seconds_bucket

Latency histogram of node authorizer graph actions, in seconds.

node_authorizer_graph_actions_duration_seconds_count

Total observations in the node authorizer graph action latency histogram.

node_authorizer_graph_actions_duration_seconds_sum

Total sum of durations for the node authorizer graph action latency histogram, in seconds.

pod_security_evaluations_total

Total number of pod security evaluations.

pod_security_exemptions_total

Total number of pod security exemptions.

process_cpu_seconds_total

Total CPU time used by the process, in seconds.

process_max_fds

Maximum number of file descriptors for the process.

process_open_fds

Number of open file descriptors for the process.

process_resident_memory_bytes

Resident memory size of the process, in bytes.

process_start_time_seconds

Start time of the process, in seconds since the Unix epoch.

process_virtual_memory_bytes

Virtual memory size of the process, in bytes.

process_virtual_memory_max_bytes

Maximum virtual memory size of the process, in bytes.

registered_metric_total

Total number of registered metrics.

registered_metrics_total

Total number of registered metrics.

rest_client_exec_plugin_certificate_rotation_age_bucket

Histogram of certificate rotation age for the REST client exec plugin, in seconds.

rest_client_exec_plugin_certificate_rotation_age_count

Total observations in the certificate rotation age histogram.

rest_client_exec_plugin_certificate_rotation_age_sum

Total sum for the certificate rotation age histogram, in seconds.

rest_client_exec_plugin_ttl_seconds

Certificate TTL for the REST client exec plugin, in seconds.

rest_client_request_duration_seconds_bucket

Latency histogram of REST client requests, in seconds.

rest_client_request_duration_seconds_count

Total observations in the REST client request latency histogram.

rest_client_request_duration_seconds_sum

Total sum of durations for the REST client request latency histogram, in seconds.

rest_client_request_latency_seconds_bucket

Latency histogram of REST client requests, in seconds.

rest_client_request_size_bytes_bucket

Histogram of REST client request sizes, in bytes.

rest_client_request_size_bytes_count

Total observations in the REST client request size histogram.

rest_client_request_size_bytes_sum

Total sum for the REST client request size histogram, in bytes.

rest_client_requests_total

Total number of REST client requests.

rest_client_response_size_bytes_bucket

Histogram of REST client response sizes, in bytes.

rest_client_response_size_bytes_count

Total observations in the REST client response size histogram.

rest_client_response_size_bytes_sum

Total sum for the REST client response size histogram, in bytes.

rest_client_transport_cache_entries

Number of transport cache entries in the REST client.

rest_client_transport_create_calls_total

Total number of transport creation calls in the REST client.

scheduler_pending_pods

Number of pods pending scheduling.

scheduler_pod_scheduling_attempts_bucket

Histogram of pod scheduling attempts by the scheduler.

scheduler_scheduler_cache_size

Size of the scheduler cache.

scrape_duration_seconds

Duration of the scrape, in seconds.

scrape_samples_post_metric_relabeling

Number of samples after metric relabeling.

scrape_samples_scraped

Number of scraped samples.

scrape_series_added

Number of new series added in a scrape.

serviceaccount_invalid_legacy_auto_token_uses_total

Total uses of invalid legacy auto-generated service account tokens.

serviceaccount_legacy_auto_token_uses_total

Total uses of legacy auto-generated service account tokens.

serviceaccount_legacy_manual_token_uses_total

Total uses of legacy manually-created service account tokens.

serviceaccount_legacy_tokens_total

Total number of legacy service account tokens.

serviceaccount_stale_tokens_total

Total number of stale service account tokens.

serviceaccount_valid_tokens_total

Total number of valid service account tokens.

ssh_tunnel_open_count

Count of opened SSH tunnels.

ssh_tunnel_open_fail_count

Count of failed SSH tunnel open operations.

up

The connectivity status of the scrape target. A value of 1 means the target is reachable; 0 means it is unreachable.

watch_cache_capacity

Capacity of the watch cache.

watch_cache_capacity_decrease_total

Total number of decreases in watch cache capacity.

watch_cache_capacity_increase_total

Total number of increases in watch cache capacity.

workqueue_adds_total

Total number of additions to the workqueue.

workqueue_depth

Current depth of the workqueue.

workqueue_longest_running_processor_seconds

Duration of the longest-running processor in the workqueue, in seconds.

workqueue_queue_duration_seconds_bucket

Latency histogram of item queuing time in the workqueue, in seconds.

workqueue_queue_duration_seconds_count

Total observations in the queuing latency histogram.

workqueue_queue_duration_seconds_sum

Total sum of durations for the queuing latency histogram, in seconds.

workqueue_retries_total

Total number of retries in the workqueue.

workqueue_unfinished_work_seconds

Duration of unfinished work in the workqueue, in seconds.

workqueue_work_duration_seconds_bucket

Latency histogram of item processing time in the workqueue, in seconds.

workqueue_work_duration_seconds_count

Total observations in the processing latency histogram.

workqueue_work_duration_seconds_sum

Total sum of durations for the processing latency histogram, in seconds.

Node Exporter (job name: node-exporter)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by target for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Information about the targets of the Alibaba Cloud Prometheus agent.

job

Name of the job.

node_boot_time_seconds

Boot time of the node, in seconds.

node_context_switches_total

Total number of context switches on the node.

node_cpu_seconds_total

Total CPU time used by the node, in seconds.

node_disk_io_now

Current number of I/O operations in progress on the node's disks.

node_disk_io_time_seconds_total

Total time spent on I/O operations on the node's disks, in seconds.

node_disk_io_time_weighted_seconds_total

Total weighted time spent on I/O operations on the node's disks, in seconds.

node_disk_read_bytes_total

Total number of bytes read from the node's disks.

node_disk_read_time_seconds_total

Total time spent reading from the node's disks, in seconds.

node_disk_reads_completed_total

Total number of completed read operations from the node's disks.

node_disk_reads_merged_total

Total number of merged read operations from the node's disks.

node_disk_write_time_seconds_total

Total time spent writing to the node's disks, in seconds.

node_disk_writes_completed_total

Total number of completed write operations to the node's disks.

node_disk_writes_merged_total

Total number of merged write operations to the node's disks.

node_disk_written_bytes_total

Total number of bytes written to the node's disks.

node_exporter_build_info

Build information for Node Exporter.

node_filefd_allocated

Number of allocated file descriptors on the node.

node_filefd_maximum

Maximum number of file descriptors allowed on the node.

node_filesystem_avail_bytes

Available space on the filesystem for non-root users, in bytes.

node_filesystem_free_bytes

Free space on the filesystem, in bytes.

node_filesystem_size_bytes

Total size of the filesystem, in bytes.

node_intr_total

Total number of interrupts on the node.

node_load1

1-minute load average on the node.

node_load15

15-minute load average on the node.

node_load5

5-minute load average on the node.

node_memory_MemAvailable_bytes

Amount of available memory on the node, in bytes.

node_memory_MemFree_bytes

Amount of free memory on the node, in bytes.

node_memory_MemTotal_bytes

Total amount of memory on the node, in bytes.

node_memory_Slab_bytes

Amount of memory used by the kernel slab allocator, in bytes.

node_memory_SReclaimable_bytes

Reclaimable part of the Slab memory on the node, in bytes.

node_netstat_Tcp_InErrs

Number of TCP receive errors.

node_netstat_Tcp_InSegs

Number of received TCP segments.

node_netstat_Tcp_OutSegs

Number of transmitted TCP segments.

node_netstat_Tcp_PassiveOpens

Number of passive TCP connection openings.

node_netstat_Tcp_RetransSegs

Number of retransmitted TCP segments.

node_network_receive_bytes_total

Total number of bytes received over the network interface.

node_network_receive_drop_total

Total number of received packets dropped by the network interface.

node_network_receive_errs_total

Total number of receive errors on the network interface.

node_network_receive_packets_total

Total number of packets received over the network interface.

node_network_transmit_bytes_total

Total number of bytes transmitted over the network interface.

node_network_transmit_drop_total

Total number of transmitted packets dropped by the network interface.

node_network_transmit_errs_total

Total number of transmit errors on the network interface.

node_network_transmit_packets_total

Total number of packets transmitted over the network interface.

node_network_up

Indicates whether the network interface is up. A value of 1 means up, while 0 means down.

node_processes_max_processes

Maximum number of processes allowed.

node_processes_max_threads

Maximum number of threads allowed.

node_processes_pids

Number of process IDs.

node_processes_state

Number of processes in each state, such as running, sleeping, or zombie.

node_processes_threads

Number of threads.

node_schedstat_running_seconds_total

Total time spent by processes in a running state, in seconds.

node_sockstat_TCP_alloc

Number of allocated TCP sockets.

node_sockstat_TCP_inuse

Number of TCP sockets currently in use.

node_sockstat_TCP_mem

Amount of memory used by TCP sockets, in pages.

node_sockstat_TCP_mem_bytes

Amount of memory used by TCP sockets, in bytes.

node_sockstat_TCP_tw

Number of TCP sockets in the TIME_WAIT state.

node_time_zone_offset_seconds

The time zone offset from UTC, in seconds.

node_timex_offset_seconds

Time offset, in seconds.

node_timex_sync_status

Indicates the clock synchronization status.

node_uname_info

The system information from uname.

node_vmstat_pgfault

Total number of minor page faults.

node_vmstat_pgmajfault

Total number of major page faults.

node_vmstat_pgpgin

Total number of pages paged in from disk.

node_vmstat_pgpgout

Total number of pages paged out to disk.

up

Indicates whether the target is healthy. A value of 1 means the target is up and reachable, while 0 indicates down.

Kube-state-metrics (Job Name: _kube-state-metrics)

Metric

Description

kube_configmap_info

ConfigMap information.

kube_cronjob_annotations

Annotations of the CronJob.

kube_cronjob_created

CronJob creation timestamp.

kube_cronjob_info

CronJob information.

kube_cronjob_labels

Labels of the CronJob.

kube_cronjob_metadata_resource_version

Resource version of the CronJob's metadata.

kube_cronjob_next_schedule_time

Next scheduled time for the CronJob.

kube_cronjob_spec_failed_job_history_limit

History retention limit for failed jobs of the CronJob.

kube_cronjob_spec_starting_deadline_seconds

Starting deadline in seconds for the CronJob.

kube_cronjob_spec_successful_job_history_limit

History retention limit for successful jobs of the CronJob.

kube_cronjob_spec_suspend

Whether the CronJob is suspended.

kube_cronjob_status_active

Number of active jobs for the CronJob.

kube_cronjob_status_last_schedule_time

Last time the CronJob was scheduled.

kube_cronjob_status_last_successful_time

Last successful execution time of the CronJob.

kube_daemonset_created

DaemonSet creation timestamp.

kube_daemonset_status_current_number_scheduled

Number of nodes currently running a DaemonSet pod.

kube_daemonset_status_desired_number_scheduled

The total number of nodes that should run a DaemonSet pod.

kube_daemonset_status_number_available

Number of nodes with an available DaemonSet pod.

kube_daemonset_status_number_misscheduled

Number of nodes incorrectly running a DaemonSet Pod.

kube_daemonset_status_number_ready

Number of nodes with a ready DaemonSet pod.

kube_daemonset_status_number_unavailable

Number of nodes without an available DaemonSet pod.

kube_daemonset_status_updated_number_scheduled

Number of nodes running the updated DaemonSet.

kube_daemonset_updated_number_scheduled

Number of nodes running the updated DaemonSet.

kube_deployment_created

Deployment creation timestamp.

kube_deployment_labels

Labels of the Deployment.

kube_deployment_metadata_generation

Generation of the Deployment's metadata.

kube_deployment_spec_replicas

Desired number of replicas for the Deployment.

kube_deployment_spec_strategy_rollingupdate_max_unavailable

Maximum number of unavailable replicas during a rolling update of the Deployment.

kube_deployment_status_observed_generation

Most recent generation observed by the Deployment controller.

kube_deployment_status_replicas

Total number of replicas for the Deployment.

kube_deployment_status_replicas_available

Number of available replicas for the Deployment.

kube_deployment_status_replicas_ready

Number of ready replicas for the Deployment.

kube_deployment_status_replicas_unavailable

Number of unavailable replicas for the Deployment.

kube_deployment_status_replicas_updated

Number of updated replicas for the Deployment.

kube_horizontalpodautoscaler_info

HorizontalPodAutoscaler information.

kube_horizontalpodautoscaler_labels

Labels of the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_metadata_generation

Generation of the HorizontalPodAutoscaler's metadata.

kube_horizontalpodautoscaler_spec_max_replicas

Maximum number of replicas for the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_spec_min_replicas

Minimum number of replicas for the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_spec_target_metric

Target metric for the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_status_condition

Current condition of the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_status_current_replicas

Current number of replicas for the HorizontalPodAutoscaler.

kube_horizontalpodautoscaler_status_desired_replicas

Desired number of replicas for the HorizontalPodAutoscaler.

kube_hpa_labels

Labels of the HPA.

kube_hpa_metadata_generation

Generation of the HPA's metadata.

kube_hpa_spec_max_replicas

Maximum number of replicas for the HPA.

kube_hpa_spec_min_replicas

Minimum number of replicas for the HPA.

kube_hpa_spec_target_metric

Target metric for the HPA.

kube_hpa_status_condition

Current condition of the HPA.

kube_hpa_status_current_replicas

Current number of replicas for the HPA.

kube_hpa_status_desired_replicas

Desired number of replicas for the HPA.

kube_ingress_info

Ingress information.

kube_job_created

Job creation timestamp.

kube_job_failed

Whether the job has failed.

kube_job_info

Job information.

kube_job_spec_completions

Desired number of successful completions for the job.

kube_job_status_active

Number of active Pods for the job.

kube_job_status_failed

Number of failed Pods for the job.

kube_job_status_succeeded

Number of successful Pods for the job.

kube_namespace_created

Namespace creation timestamp.

kube_namespace_labels

Labels of the namespace.

kube_namespace_status_phase

Current phase of the namespace.

kube_node_info

Node information.

kube_node_labels

Labels of the node.

kube_node_spec_taint

Taint specified for the node.

kube_node_spec_unschedulable

Whether the node is unschedulable.

kube_node_status_allocatable

Allocatable resources of the node.

kube_node_status_allocatable_cpu_cores

Allocatable CPU resources of the node, in cores.

kube_node_status_allocatable_memory_bytes

Allocatable memory resources of the node, in bytes.

kube_node_status_allocatable_pods

Number of Pods that can be allocated to the node.

kube_node_status_capacity

Total capacity of the node.

kube_node_status_capacity_cpu_cores

Total CPU capacity of the node, in cores.

kube_node_status_capacity_memory_bytes

Total memory capacity of the node, in bytes.

kube_node_status_capacity_pods

Total Pod capacity of the node.

kube_node_status_condition

Current condition of the node.

kube_persistentvolume_status_phase

Current phase of the persistent volume.

kube_persistentvolumeclaim_info

Persistent volume claim information.

kube_persistentvolumeclaim_resource_requests_storage_bytes

Requested storage for the persistent volume claim, in bytes.

kube_persistentvolumeclaim_status_phase

Current phase of the persistent volume claim.

kube_pod_completion_time

Completion time of the Pod.

kube_pod_container_info

Pod container information.

kube_pod_container_resource_limits

Resource limits for a container.

kube_pod_container_resource_limits_cpu_cores

CPU resource limit for a container, in cores.

kube_pod_container_resource_limits_memory_bytes

Memory resource limit for a container, in bytes.

kube_pod_container_resource_requests

Resource requests for a container.

kube_pod_container_resource_requests_cpu_cores

CPU resource request for a container, in cores.

kube_pod_container_resource_requests_memory_bytes

Memory resource request for a container, in bytes.

kube_pod_container_status_last_terminated_reason

Reason for the last termination of a container.

kube_pod_container_status_ready

Whether a container is ready.

kube_pod_container_status_restarts_total

Total number of container restarts.

kube_pod_container_status_running

Whether a container is in a running state.

kube_pod_container_status_terminated

Whether a container is in a terminated state.

kube_pod_container_status_terminated_reason

Reason a container is in a terminated state.

kube_pod_container_status_waiting

Whether a container is in a waiting state.

kube_pod_container_status_waiting_reason

Reason a container is in a waiting state.

kube_pod_created

Pod creation timestamp.

kube_pod_deletion_timestamp

Deletion timestamp of the Pod.

kube_pod_info

Pod information.

kube_pod_labels

Labels of the Pod.

kube_pod_owner

Owner information for a Pod.

kube_pod_start_time

Start time of the Pod.

kube_pod_status_container_ready_time

Time at which the Pod's containers became ready.

kube_pod_status_initialized_time

Time at which the Pod was initialized.

kube_pod_status_phase

Current phase of the Pod.

kube_pod_status_ready

Whether the Pod is ready.

kube_pod_status_ready_time

Time at which the Pod became ready.

kube_pod_status_reason

Reason for the Pod's current status.

kube_pod_status_scheduled_time

Time at which the Pod was scheduled.

kube_pod_status_unschedulable

Whether the Pod is unschedulable.

kube_replicaset_owner

Owner information for a ReplicaSet.

kube_replicaset_status_ready_replicas

Number of ready replicas for the ReplicaSet.

kube_resource_relationship

Relationship between resources.

kube_resourcequota

Resource quota information.

kube_resourcequota_created

Resource quota creation timestamp.

kube_secret_info

Secret information.

kube_service_info

Service information.

kube_service_spec_type

Type of the service.

kube_service_status_load_balancer_ingress

Ingress information for the service's load balancer.

kube_statefulset_created

StatefulSet creation timestamp.

kube_statefulset_metadata_generation

Generation of the StatefulSet's metadata.

kube_statefulset_replicas

Desired number of replicas for the StatefulSet.

kube_statefulset_status_replicas

Current number of replicas for the StatefulSet.

kube_statefulset_status_replicas_available

Number of available replicas for the StatefulSet.

kube_statefulset_status_replicas_ready

Number of ready replicas for the StatefulSet.

kube_statefulset_status_replicas_updated

Number of updated replicas for the StatefulSet.

rest_client_requests_total

Total requests sent by the REST client.

up

Whether the target is healthy (1 for up, 0 for down).

workqueue_adds_total

Total additions to the workqueue.

workqueue_depth

Current depth of the workqueue.

workqueue_queue_duration_seconds_bucket

Distribution of time spent in the workqueue, in seconds.

kube-events (scrape job name: _arms/kube-event)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

The duration of the append operation for the Alibaba Cloud Prometheus agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

The discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrape_custom_error

The number of custom scrape errors from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

The total number of scrapes by target for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Information about the targets of the Alibaba Cloud Prometheus agent.

eventer_events_error_total

The total number of event processing errors.

eventer_events_normal_total

The total number of normal events.

eventer_events_warning_total

The total number of warning events.

eventer_exporter_duration_milliseconds_count

The number of observations for the event export duration, in milliseconds.

eventer_exporter_duration_milliseconds_sum

The sum of all event export durations, in milliseconds.

eventer_manager_last_time_seconds

The timestamp of the last operation by the event manager, in seconds.

eventer_scraper_duration_milliseconds_count

The number of observations for the event scrape duration, in milliseconds.

eventer_scraper_duration_milliseconds_sum

The sum of all event scrape durations, in milliseconds.

eventer_scraper_events_total_number

The total number of events scraped.

eventer_scraper_last_time_seconds

The timestamp of the last event scrape, in seconds.

up

Indicates if a target is healthy: 1 means up and reachable, while 0 means down.

CoreDNS (job name: arms-ack-coredns)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus Agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Status of scrape job discovery by the Alibaba Cloud Prometheus Agent.

aliyun_prometheus_agent_scrape_custom_error

Number of custom scrape errors from the Alibaba Cloud Prometheus Agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by the Alibaba Cloud Prometheus Agent, broken down by target.

aliyun_prometheus_agent_target_info

Information about targets scraped by the Alibaba Cloud Prometheus Agent.

coredns_autopath_success_count_total

Total number of successful autopath operations.

coredns_autopath_success_total

Total number of successful autopath operations.

coredns_build_info

Build information for the CoreDNS binary.

coredns_cache_drops_total

Total number of entries dropped from the cache.

coredns_cache_entries

Number of entries currently in the cache.

coredns_cache_evictions_total

Total number of entries evicted from the cache.

coredns_cache_hits_total

Total number of cache hits.

coredns_cache_misses_total

Total number of cache misses.

coredns_cache_requests_total

Total number of requests to the cache.

coredns_cache_size

Number of entries in the cache.

coredns_dns_do_requests_total

Total number of DNS requests with the DO (DNSSEC OK) bit set.

coredns_dns_request_count_total

Total number of DNS requests.

coredns_dns_request_duration_seconds_bucket

Distribution of DNS request durations, in seconds.

coredns_dns_request_duration_seconds_count

Total number of DNS requests measured for the duration histogram.

coredns_dns_request_duration_seconds_sum

Total duration of all measured DNS requests, in seconds.

coredns_dns_request_size_bytes_bucket

Distribution of DNS request sizes, in bytes.

coredns_dns_request_size_bytes_count

Total number of DNS requests measured for the size histogram.

coredns_dns_request_size_bytes_sum

Total size of all measured DNS requests, in bytes.

coredns_dns_request_type_count_total

Total number of DNS requests, by query type.

coredns_dns_requests_total

Total number of DNS requests.

coredns_dns_response_rcode_count_total

Total number of DNS responses, by response code (RCODE).

coredns_dns_response_size_bytes_bucket

Distribution of DNS response sizes, in bytes.

coredns_dns_response_size_bytes_count

Total number of DNS responses measured for the size histogram.

coredns_dns_response_size_bytes_sum

Total size of all measured DNS responses, in bytes.

coredns_dns_responses_total

Total number of DNS responses.

coredns_forward_conn_cache_hits_total

Total number of connection cache hits for forwarded requests.

coredns_forward_conn_cache_misses_total

Total number of connection cache misses for forwarded requests.

coredns_forward_healthcheck_broken_total

Total number of times a forwarder has been marked as broken.

coredns_forward_healthcheck_failure_count_total

Total number of health check failures for forwarders.

coredns_forward_healthcheck_failures_total

Total number of health check failures for forwarders.

coredns_forward_max_concurrent_rejects_total

Total number of forwarded requests rejected because the concurrent request limit was reached.

coredns_forward_request_count_total

Total number of requests forwarded.

coredns_forward_request_duration_seconds_bucket

Distribution of forwarded request durations, in seconds.

coredns_forward_request_duration_seconds_count

Total number of forwarded requests measured for the duration histogram.

coredns_forward_request_duration_seconds_sum

Total duration of all measured forwarded requests, in seconds.

coredns_forward_requests_total

Total number of requests forwarded.

coredns_forward_response_rcode_count_total

Total number of responses from forwarders, by response code (RCODE).

coredns_forward_responses_total

Total number of responses received from forwarders.

coredns_forward_sockets_open

Number of sockets currently open for forwarding.

coredns_health_request_duration_seconds_bucket

Distribution of request durations to the health endpoint, in seconds.

coredns_health_request_duration_seconds_count

Total number of health endpoint requests measured for the duration histogram.

coredns_health_request_duration_seconds_sum

Total duration of all measured requests to the health endpoint, in seconds.

coredns_health_request_failures_total

Total number of failed requests to the health endpoint.

coredns_hosts_entries

Number of entries in the hosts plugin.

coredns_hosts_reload_timestamp_seconds

The timestamp of the last successful hosts file reload.

coredns_kubernetes_dns_programming_duration_seconds_bucket

Distribution of Kubernetes DNS programming durations, in seconds.

coredns_kubernetes_dns_programming_duration_seconds_count

Total number of Kubernetes DNS programming operations measured for the duration histogram.

coredns_kubernetes_dns_programming_duration_seconds_sum

Total duration of all measured Kubernetes DNS programming operations, in seconds.

coredns_local_localhost_requests_total

Total number of "localhost" requests handled by the local plugin.

coredns_panic_count_total

Total number of panics.

coredns_panics_total

Total number of panics.

coredns_plugin_enabled

Indicates which plugins are enabled via labels.

coredns_reload_failed_total

Total number of failed reloads.

coredns_reload_version_info

Version information for reloads.

coredns_template_matches_total

Total number of template matches.

up

Indicates whether the target was successfully scraped (1 for up, 0 for down).

CSI (cluster-level) (Job name: k8s-csi-cluster-pv)

Metric

Description

alibaba_cloud_storage_operator_build_info

Build info for the Alibaba Cloud storage operator.

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrape_custom_error

Number of custom scrape errors from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total scrapes by target from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Displays information about targets monitored by the Alibaba Cloud Prometheus agent.

cluster_pv_detail_num_total

The total number of Persistent Volumes (PVs) in the cluster.

cluster_pv_status_num_total

The total number of PVs in the cluster, broken down by status.

cluster_pvc_detail_num_total

The total number of Persistent Volume Claims (PVCs) in the cluster.

cluster_pvc_status_num_total

The total number of PVCs in the cluster, broken down by status.

cluster_scrape_collector_duration_seconds

The duration of scrapes performed by the cluster collector.

cluster_scrape_collector_success

The number of successful scrapes by the cluster collector.

up

Indicates whether the target is healthy. A value of 1 indicates the target is up, while a value of 0 indicates it is down.

CSI (node-level) (job name: k8s-csi-node-pv)

Metric

Description

alibaba_cloud_csi_driver_build_info

Build information for the Alibaba Cloud CSI driver.

aliyun_prometheus_agent_append_duration_seconds

Append operation duration for the Alibaba Cloud Prometheus agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrape_custom_error

Number of custom scrape errors from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by target for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Information about targets for the Alibaba Cloud Prometheus agent.

cluster_scrape_collector_duration_seconds

Scrape duration for the cluster collector, in seconds.

cluster_scrape_collector_success

Number of successful scrapes by the cluster collector.

container_fs_available_bytes

Available file system space for the container, in bytes.

container_fs_inodes_free

Number of free inodes on the container's file system.

container_fs_inodes_total

Total number of inodes on the container's file system.

container_fs_inodes_used

Number of used inodes on the container's file system.

container_fs_limit_bytes

File system size limit for the container, in bytes.

container_fs_usage_bytes

File system usage for the container, in bytes.

ephemeral_storage_pod_available_bytes

Available ephemeral storage for the Pod, in bytes.

ephemeral_storage_pod_inodes_free

Number of free inodes in the Pod's ephemeral storage.

ephemeral_storage_pod_inodes_total

Total number of inodes in the Pod's ephemeral storage.

ephemeral_storage_pod_inodes_used

Number of used inodes in the Pod's ephemeral storage.

ephemeral_storage_pod_limit_bytes

Ephemeral storage limit for the Pod, in bytes.

ephemeral_storage_pod_usage_bytes

Ephemeral storage usage for the Pod, in bytes.

node_volume_backend_posix_access_total_counter

Total number of POSIX access operations on the node volume backend.

node_volume_backend_posix_getattr_total_counter

Total number of POSIX getattr operations on the node volume backend.

node_volume_backend_posix_getmode_total_counter

Total number of POSIX getmode operations on the node volume backend.

node_volume_backend_posix_link_total_counter

Total number of POSIX link operations on the node volume backend.

node_volume_backend_posix_lookup_total_counter

Total number of POSIX lookup operations on the node volume backend.

node_volume_backend_posix_mknod_total_counter

Total number of POSIX mknod operations on the node volume backend.

node_volume_backend_posix_readdir_total_counter

Total number of POSIX readdir operations on the node volume backend.

node_volume_backend_posix_readlink_total_counter

Total number of POSIX readlink operations on the node volume backend.

node_volume_backend_posix_remove_total_counter

Total number of POSIX remove operations on the node volume backend.

node_volume_backend_posix_rename_total_counter

Total number of POSIX rename operations on the node volume backend.

node_volume_backend_posix_setattr_total_counter

Total number of POSIX setattr operations on the node volume backend.

node_volume_backend_posix_statfs_total_counter

Total number of POSIX statfs operations on the node volume backend.

node_volume_backend_read_bytes_total_counter

Total number of bytes read from the node volume backend.

node_volume_backend_read_completed_total_counter

Total number of completed read operations on the node volume backend.

node_volume_backend_read_time_milliseconds_total_counter

Total time spent on read operations on the node volume backend, in milliseconds.

node_volume_backend_write_bytes_total_counter

Total number of bytes written to the node volume backend.

node_volume_backend_write_completed_total_counter

Total number of completed write operations on the node volume backend.

node_volume_backend_write_time_milliseconds_total_counter

Total time spent on write operations on the node volume backend, in milliseconds.

node_volume_capacity_bytes_available

Available capacity of the node volume, in bytes.

node_volume_capacity_bytes_available_counter

Counter for the available capacity of the node volume, in bytes.

node_volume_capacity_bytes_total

Total capacity of the node volume, in bytes.

node_volume_capacity_bytes_total_counter

Counter for the total capacity of the node volume, in bytes.

node_volume_capacity_bytes_used

Used capacity of the node volume, in bytes.

node_volume_capacity_bytes_used_counter

Counter for the used capacity of the node volume, in bytes.

node_volume_hot_spot_head_file_top

Ranks the top files by the number of HEAD requests on the node volume.

node_volume_hot_spot_read_file_top

Ranks the top files by the number of read requests on the node volume.

node_volume_hot_spot_write_file_top

Ranks the top files by the number of write requests on the node volume.

node_volume_inode_bytes_available_counter

Counter for the available inode space on the node volume, in bytes.

node_volume_inode_bytes_total_counter

Counter for the total inode space on the node volume, in bytes.

node_volume_inode_bytes_used_counter

Counter for the used inode space on the node volume, in bytes.

node_volume_inodes_available

Number of available inodes on the node volume.

node_volume_inodes_total

Total number of inodes on the node volume.

node_volume_inodes_used

Number of used inodes on the node volume.

node_volume_io_now

Number of I/O operations currently in progress on the node volume.

node_volume_io_time_seconds_total

Total time spent on I/O operations on the node volume, in seconds.

node_volume_oss_delete_object_total_counter

Total number of OSS delete object operations on the node volume.

node_volume_oss_get_object_total_counter

Total number of OSS get object operations on the node volume.

node_volume_oss_head_object_total_counter

Total number of OSS head object operations on the node volume.

node_volume_oss_post_object_total_counter

Total number of OSS POST object operations on the node volume.

node_volume_oss_put_object_total_counter

Total number of OSS put object operations on the node volume.

node_volume_posix_access_total_counter

Total number of POSIX access operations on the node volume.

node_volume_posix_chmod_total_counter

Total number of POSIX chmod operations on the node volume.

node_volume_posix_chown_total_counter

Total number of POSIX chown operations on the node volume.

node_volume_posix_create_total_counter

Total number of POSIX create operations on the node volume.

node_volume_posix_flush_total_counter

Total number of POSIX flush operations on the node volume.

node_volume_posix_fsync_total_counter

Total number of POSIX fsync operations on the node volume.

node_volume_posix_mkdir_total_counter

Total number of POSIX mkdir operations on the node volume.

node_volume_posix_open_total_counter

Total number of POSIX open operations on the node volume.

node_volume_posix_opendir_total_counter

Total number of POSIX opendir operations on the node volume.

node_volume_posix_read_total_counter

Total number of POSIX read operations on the node volume.

node_volume_posix_readdir_total_counter

Total number of POSIX readdir operations on the node volume.

node_volume_posix_release_total_counter

Total number of POSIX release operations on the node volume.

node_volume_posix_rename_total_counter

Total number of POSIX rename operations on the node volume.

node_volume_posix_rmdir_total_counter

Total number of POSIX rmdir operations on the node volume.

node_volume_posix_truncate_total_counter

Total number of POSIX truncate operations on the node volume.

node_volume_posix_write_total_counter

Total number of POSIX write operations on the node volume.

node_volume_read_bytes_total

Total bytes read from the node volume.

node_volume_read_bytes_total_counter

Counter for the total bytes read from the node volume.

node_volume_read_completed_total

Total completed read operations on the node volume.

node_volume_read_completed_total_counter

Counter for the total completed read operations on the node volume.

node_volume_read_merged_total

Total merged read operations on the node volume.

node_volume_read_queue_time_milliseconds_total

Total queue time for read requests on the node volume, in milliseconds.

node_volume_read_rtt_time_milliseconds_total

Total round-trip time for read requests on the node volume, in milliseconds.

node_volume_read_sent_bytes_total

Total bytes sent for read requests on the node volume.

node_volume_read_time_milliseconds_total

Total time spent on read operations on the node volume, in milliseconds.

node_volume_read_time_milliseconds_total_counter

Counter for the total time spent on read operations on the node volume, in milliseconds.

node_volume_read_timeouts_total

Total read timeouts on the node volume.

node_volume_read_transmissions_total

Total read transmissions on the node volume.

node_volume_vg_free_bytes

Free space in the node volume group (VG), in bytes.

node_volume_vg_size_bytes

Total size of the node volume group (VG), in bytes.

node_volume_write_bytes_total

Total bytes written to the node volume.

node_volume_write_bytes_total_counter

Counter for the total bytes written to the node volume.

node_volume_write_completed_total

Total completed write operations on the node volume.

node_volume_write_completed_total_counter

Counter for the total completed write operations on the node volume.

node_volume_write_merged_total

Total merged write operations on the node volume.

node_volume_write_queue_time_milliseconds_total

Total queue time for write requests on the node volume, in milliseconds.

node_volume_write_recv_bytes_total

Total bytes received for write requests on the node volume.

node_volume_write_rtt_time_milliseconds_total

Total round-trip time for write requests on the node volume, in milliseconds.

node_volume_write_time_milliseconds_total

Total time spent on write operations on the node volume, in milliseconds.

node_volume_write_time_milliseconds_total_counter

Counter for the total time spent on write operations on the node volume, in milliseconds.

node_volume_write_timeouts_total

Total write timeouts on the node volume.

node_volume_write_transmissions_total

Total write transmissions on the node volume.

up

Indicates whether the target is healthy. A value of 1 means the target is healthy and reachable; 0 means it is down.

GPU-Exporter (Job Name: gpu-exporter)

Metric

Description

DCGM_CUSTOM_ALLOCATE_MODE

Indicates the operating mode of the node. Possible values are:

DCGM_CUSTOM_CONTAINER_CP_ALLOCATED

The percentage of a single GPU's total computing power allocated to a container. The value ranges from 0 to 1. A value of 0 means the container uses an exclusive or shared GPU with a request for video memory only, imposing no limit on its computing power. For example, if a GPU provides 100 units of computing power and 30 are allocated to a container, the ratio is 0.3.

DCGM_CUSTOM_CONTAINER_MEM_ALLOCATED

The amount of video memory allocated to the container.

DCGM_CUSTOM_DEV_FB_ALLOCATED

The percentage of a GPU's total framebuffer memory that is allocated. The value ranges from 0 to 1.

DCGM_CUSTOM_DEV_FB_TOTAL

The total framebuffer memory of the GPU.

DCGM_CUSTOM_ILLEGAL_PROCESS_DECODE_UTIL

Decoder utilization by unauthorized processes.

DCGM_CUSTOM_ILLEGAL_PROCESS_ENCODE_UTIL

Encoder utilization by unauthorized processes.

DCGM_CUSTOM_ILLEGAL_PROCESS_MEM_COPY_UTIL

Memory copy utilization by unauthorized processes.

DCGM_CUSTOM_ILLEGAL_PROCESS_MEM_USED

Video memory used by unauthorized processes.

DCGM_CUSTOM_ILLEGAL_PROCESS_SM_UTIL

Streaming Multiprocessor (SM) utilization by unauthorized processes.

DCGM_CUSTOM_PROCESS_DECODE_UTIL

The decoder utilization by a GPU process.

DCGM_CUSTOM_PROCESS_ENCODE_UTIL

The encoder utilization by a GPU process.

DCGM_CUSTOM_PROCESS_MEM_COPY_UTIL

The memory copy utilization by a GPU process.

DCGM_CUSTOM_PROCESS_MEM_USED

The amount of video memory used by a GPU process.

DCGM_CUSTOM_PROCESS_SM_UTIL

The Streaming Multiprocessor (SM) utilization by a GPU process.

DCGM_FI_DEV_APP_MEM_CLOCK

The memory application clock frequency.

DCGM_FI_DEV_APP_SM_CLOCK

The Streaming Multiprocessor (SM) application clock frequency.

DCGM_FI_DEV_BAR1_FREE

The amount of free BAR1 memory.

DCGM_FI_DEV_BAR1_TOTAL

The total size of the device's Base Address Register 1 (BAR1), which is used to map GPU memory into the system's address space.

DCGM_FI_DEV_BAR1_USED

The amount of used BAR1 memory.

DCGM_FI_DEV_BOARD_LIMIT_VIOLATION

The duration of board limit violations.

DCGM_FI_DEV_CLOCK_THROTTLE_REASONS

A bitmask of reasons for clock throttling.

DCGM_FI_DEV_COUNT

The number of devices.

DCGM_FI_DEV_DEC_UTIL

The decoder utilization.

DCGM_FI_DEV_ENC_UTIL

The encoder utilization.

DCGM_FI_DEV_FB_FREE

The amount of free framebuffer memory.

DCGM_FI_DEV_FB_USED

The amount of used framebuffer memory. This value corresponds to the Used value in the Memory-Usage section of the nvidia-smi command output.

DCGM_FI_DEV_GPU_TEMP

The GPU temperature.

DCGM_FI_DEV_GPU_UTIL

The percentage of time over a sample period (such as 1s or 1/6s, depending on the GPU) during which one or more kernels were active. This metric indicates that GPU resources were in use, but does not measure the workload's intensity.

DCGM_FI_DEV_LOW_UTIL_VIOLATION

The duration of low-utilization limit violations.

DCGM_FI_DEV_MEM_CLOCK

The memory clock frequency.

DCGM_FI_DEV_MEM_COPY_UTIL

The memory bandwidth utilization. For example, an NVIDIA V100 GPU has a maximum memory bandwidth of 900 GB/s. If the current memory bandwidth is 450 GB/s, the utilization is 50%.

DCGM_FI_DEV_MEMORY_TEMP

The memory temperature.

DCGM_FI_DEV_NVLINK_BANDWIDTH_TOTAL

The total NVLink bandwidth.

DCGM_FI_DEV_PCIE_REPLAY_COUNTER

The count of PCIe transmission retries caused by data errors.

DCGM_FI_DEV_POWER_USAGE

The power usage.

DCGM_FI_DEV_POWER_VIOLATION

The duration of power limit violations.

DCGM_FI_DEV_PSTATE

The device power state (P-state).

DCGM_FI_DEV_RELIABILITY_VIOLATION

The duration of board reliability limit violations.

DCGM_FI_DEV_RETIRED_DBE

The number of pages retired due to double-bit errors (DBE).

DCGM_FI_DEV_RETIRED_PENDING

The number of pages pending retirement, which are pages in GPU memory marked as unusable due to errors.

DCGM_FI_DEV_RETIRED_SBE

The number of pages retired due to single-bit errors (SBE).

DCGM_FI_DEV_SM_CLOCK

The Streaming Multiprocessor (SM) clock frequency.

DCGM_FI_DEV_SYNC_BOOST_VIOLATION

The duration of sync boost limit violations.

DCGM_FI_DEV_THERMAL_VIOLATION

The duration of thermal limit violations.

DCGM_FI_DEV_TOTAL_ENERGY_CONSUMPTION

The total energy consumed since the driver was loaded.

DCGM_FI_DEV_VIDEO_CLOCK

The video clock frequency.

DCGM_FI_DEV_XID_ERRORS

The error code of the most recent XID error that occurred within a sampling period.

DCGM_FI_PROF_DRAM_ACTIVE

The fraction of cycles that the DRAM is active (sending or receiving data), which represents memory bandwidth utilization.

This value is an average over an interval, not an instantaneous reading.

A higher value indicates higher device memory utilization.

A value of 1.0 (100%) means a DRAM instruction was executed every cycle, though a peak of approximately 0.8 (80%) is the practical maximum.

A value of 0.2 (20%) means data was read from or written to device memory during 20% of the cycles in the measurement interval.

DCGM_FI_PROF_GR_ENGINE_ACTIVE

The percentage of time over an interval that the graphics or compute engine was active. This value is an average across all graphics and compute engines. The engine is considered active when a graphics or compute context is bound to a thread and is in a busy state.

DCGM_FI_PROF_NVLINK_RX_BYTES

The rate of data received over NVLink, excluding protocol headers.

This is an average rate over the measurement interval, not an instantaneous value.

For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer was a constant stream or a burst. The theoretical maximum bandwidth for NVLink Gen2 is 25 GB/s per link in each direction.

DCGM_FI_PROF_NVLINK_TX_BYTES

The rate of data transmitted over NVLink (outbound), excluding protocol headers.

DCGM_FI_PROF_PCIE_RX_BYTES

The rate of data received over the PCIe bus, including protocol headers and data payload.

This is an average rate over the measurement interval, not an instantaneous value.

For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer was a constant stream or a burst. The theoretical maximum bandwidth for PCIe Gen3 is 985 MB/s per lane.

DCGM_FI_PROF_PCIE_TX_BYTES

The rate of data transmitted over the PCIe bus, including protocol headers and data payload.

This is an average rate over the measurement interval, not an instantaneous value.

For example, transferring 1 GB of data in 1 second results in a rate of 1 GB/s, regardless of whether the transfer was a constant stream or a burst. The theoretical maximum bandwidth for PCIe Gen3 is 985 MB/s per lane.

DCGM_FI_PROF_PIPE_FP16_ACTIVE

The fraction of cycles that the FP16 (half-precision) pipe is active.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher utilization of FP16 Cores.

A value of 1.0 (100%) means an FP16 instruction was executed every two cycles (for Volta-based GPUs, for example) throughout the interval.

A value of 0.2 (20%) could mean any of the following:

20% of SMs ran their FP16 Cores at 100% utilization throughout the interval.

100% of SMs ran their FP16 Cores at 20% utilization throughout the interval.

100% of SMs ran their FP16 Cores at 100% utilization for one-fifth of the interval.

Other combinations.

DCGM_FI_PROF_PIPE_FP32_ACTIVE

The fraction of cycles that the Fused Multiply-Add (FMA) pipe is active. This pipe handles FP32 (single-precision) and integer operations.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher utilization of FP32 Cores.

A value of 1.0 (100%) means an FP32 instruction was executed every two cycles (for Volta-based GPUs, for example) throughout the interval.

A value of 0.2 (20%) could mean any of the following:

20% of SMs ran their FP32 Cores at 100% utilization throughout the interval.

100% of SMs ran their FP32 Cores at 20% utilization throughout the interval.

100% of SMs ran their FP32 Cores at 100% utilization for one-fifth of the interval.

Other combinations.

DCGM_FI_PROF_PIPE_FP64_ACTIVE

The fraction of cycles that the FP64 (double-precision) pipe is active.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher utilization of FP64 Cores.

A value of 1.0 (100%) means an FP64 instruction was executed every four cycles (for Volta-based GPUs, for example) throughout the interval.

A value of 0.2 (20%) could mean any of the following:

20% of SMs ran their FP64 Cores at 100% utilization throughout the interval.

100% of SMs ran their FP64 Cores at 20% utilization throughout the interval.

100% of SMs ran their FP64 Cores at 100% utilization for one-fifth of the interval.

Other combinations.

DCGM_FI_PROF_PIPE_TENSOR_ACTIVE

The fraction of cycles that the Tensor (HMMA/IMMA) pipe is active.

This value is an average over a time interval, not an instantaneous value.

A higher value indicates higher utilization of the Tensor Cores.

A value of 1.0 (100%) means a Tensor instruction was issued every other cycle, as one instruction takes two cycles to complete.

A value of 0.2 (20%) could mean any of the following:

20% of SMs ran their Tensor Cores at 100% utilization throughout the interval.

100% of SMs ran their Tensor Cores at 20% utilization throughout the interval.

100% of SMs ran their Tensor Cores at 100% utilization for one-fifth of the interval.

Other combinations.

DCGM_FI_PROF_SM_ACTIVE

The percentage of time over an interval that at least one warp was active on a Streaming Multiprocessor (SM). This value is an average across all SMs and is not sensitive to the number of threads per block. A warp is considered active after it has been scheduled and allocated resources, regardless of whether it is computing or waiting for a dependency (such as a memory request). A value below 0.5 indicates inefficient GPU utilization, while a value above 0.8 is desirable.

DCGM_FI_PROF_SM_OCCUPANCY

The ratio of resident warps on an SM to the maximum number of resident warps supported by that SM. This value is an average across all SMs over a time interval. Higher occupancy does not necessarily mean higher GPU utilization. For memory bandwidth-bound workloads (indicated by a high DCGM_FI_PROF_DRAM_ACTIVE value), higher occupancy suggests more efficient GPU usage.

nvidia_gpu_allocated_num_devices

Number of allocated GPU devices. Warning: This metric is deprecated.

nvidia_gpu_memory_allocated_bytes

Total allocated GPU memory. Warning: This metric is deprecated and replaced by DCGM_CUSTOM_DEV_FB_ALLOCATED.

nvidia_gpu_sharing_memory

Memory allocated for GPU sharing. Warning: This metric is deprecated and replaced by DCGM_CUSTOM_DEV_FB_ALLOCATED.

up

Indicates whether the scrape target is healthy. A value of 1 means the target is up and reachable, while 0 indicates it is down.

Cost-Exporter (Job name: alibaba-cloud-cost-exporter)

Metric

Description

deducted_by_cash_coupons

The coupon deduction on an instance's bill.

deducted_by_prepaid_card

The prepaid card deduction on an instance's bill.

invoice_discount

The discount on an instance's bill.

list_price

The list price for the instance.

node_current_price

The current price of the node.

node_payAsYouGo_price

The Pay-As-You-Go price for the node.

node_payByPeriod_price

The Subscription price for the node.

node_spot_price

The equivalent Spot Instance price for the node.

outstanding_amount

The outstanding amount on the instance's bill.

payent_amount

The cash payment on the instance's bill.

pretax_amount

The pretax amount on the instance's bill.

pretax_gross_amount

The pretax gross amount on the instance's bill.

usage

The resource usage for the instance.

up

Indicates if the target is healthy. 1 means up and reachable; 0 means down.

Ingress (Job Name: arms-ack-ingress, ingress-ask-default)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrape_custom_error

Number of custom scrape errors for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by target for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Information about Alibaba Cloud Prometheus agent targets.

nginx_ingress_controller_admission_config_size

Size of the admission configuration.

nginx_ingress_controller_admission_render_duration

Duration of the admission rendering process.

nginx_ingress_controller_admission_render_ingresses

Number of ingress resources rendered for admission.

nginx_ingress_controller_admission_roundtrip_duration

Duration of admission round-trip processing.

nginx_ingress_controller_admission_tested_duration

Duration of the admission test.

nginx_ingress_controller_admission_tested_ingresses

Number of ingress resources tested for admission.

nginx_ingress_controller_build_info

Build information.

nginx_ingress_controller_bytes_sent_bucket

Distribution of bytes sent.

nginx_ingress_controller_bytes_sent_count

Total number of bytes-sent observations.

nginx_ingress_controller_bytes_sent_sum

Total bytes sent.

nginx_ingress_controller_check_errors

Total check errors.

nginx_ingress_controller_check_success

Total successful checks.

nginx_ingress_controller_config_hash

Hash of the running configuration.

nginx_ingress_controller_config_last_reload_successful

Indicates if the last configuration reload was successful (1 for success, 0 for failure).

nginx_ingress_controller_config_last_reload_successful_timestamp_seconds

Timestamp of the last successful configuration reload, in seconds.

nginx_ingress_controller_connect_duration_seconds_bucket

Distribution of connection establishment time, in seconds.

nginx_ingress_controller_connect_duration_seconds_count

Total number of connection establishment time observations.

nginx_ingress_controller_connect_duration_seconds_sum

Total connection establishment time, in seconds.

nginx_ingress_controller_errors

Total errors.

nginx_ingress_controller_header_duration_seconds_bucket

Distribution of header processing time, in seconds.

nginx_ingress_controller_header_duration_seconds_count

Total number of header processing time observations.

nginx_ingress_controller_header_duration_seconds_sum

Total header processing time, in seconds.

nginx_ingress_controller_ingress_upstream_latency_seconds

Distribution of upstream latency, in seconds.

nginx_ingress_controller_ingress_upstream_latency_seconds_count

Total number of upstream latency observations.

nginx_ingress_controller_ingress_upstream_latency_seconds_sum

Total upstream latency, in seconds.

nginx_ingress_controller_leader_election_status

Current status of the leader election process.

nginx_ingress_controller_nginx_process_connections

Current number of connections for the nginx process.

nginx_ingress_controller_nginx_process_connections_total

Total number of connections for the nginx process.

nginx_ingress_controller_nginx_process_cpu_seconds_total

Total CPU time used by the nginx process, in seconds.

nginx_ingress_controller_nginx_process_num_procs

Number of nginx processes.

nginx_ingress_controller_nginx_process_oldest_start_time_seconds

Start time of the oldest nginx process, in seconds.

nginx_ingress_controller_nginx_process_read_bytes_total

Total number of bytes read by the nginx process.

nginx_ingress_controller_nginx_process_requests_total

Total number of requests handled by the nginx process.

nginx_ingress_controller_nginx_process_resident_memory_bytes

Resident memory size of the nginx process, in bytes.

nginx_ingress_controller_nginx_process_virtual_memory_bytes

Virtual memory size of the nginx process, in bytes.

nginx_ingress_controller_nginx_process_write_bytes_total

Total number of bytes written by the nginx process.

nginx_ingress_controller_orphan_ingress

Current number of orphaned ingress resources.

nginx_ingress_controller_request_duration_seconds_bucket

Distribution of request duration, in seconds.

nginx_ingress_controller_request_duration_seconds_count

Total number of request duration observations.

nginx_ingress_controller_request_duration_seconds_sum

Total request duration, in seconds.

nginx_ingress_controller_request_size_bucket

Distribution of request sizes.

nginx_ingress_controller_request_size_count

Total number of request size observations.

nginx_ingress_controller_request_size_sum

Total request size.

nginx_ingress_controller_requests

Total number of requests.

nginx_ingress_controller_response_duration_seconds_bucket

Distribution of response duration, in seconds.

nginx_ingress_controller_response_duration_seconds_count

Total number of response duration observations.

nginx_ingress_controller_response_duration_seconds_sum

Total response duration, in seconds.

nginx_ingress_controller_response_size_bucket

Distribution of response sizes.

nginx_ingress_controller_response_size_count

Total number of response size observations.

nginx_ingress_controller_response_size_sum

Total response size.

nginx_ingress_controller_ssl_certificate_info

Information about the SSL certificate.

nginx_ingress_controller_ssl_expire_time_seconds

Expiration time of the SSL certificate, in seconds.

nginx_ingress_controller_success

Total successful operations.

up

Indicates if a target is healthy. A value of 1 means the target is up and reachable; 0 means it is down.

Koordinator (job name: kube-system/koordlet-metrics-podmonitor, koord-manager-metrics-service)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus agent (seconds).

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes performed by the Alibaba Cloud Prometheus agent, broken down by target.

aliyun_prometheus_agent_target_info

Target information for the Alibaba Cloud Prometheus agent.

koord_manager_recommender_recommendation_workload_target

Recommended resource specifications for a workload, generated by the resource profiling feature.

koordlet_container_resource_limits

Resource limit for a container.

koordlet_container_resource_requests

Resource request for a container.

koordlet_node_priority_resource_reclaimable

Amount of reclaimable resources on a node, categorized by priority.

koordlet_node_resource_allocatable

Allocatable resources on a node.

slo_manager_recommender_recommendation_workload_target

Recommended resource specifications for a workload, generated by the resource profiling feature. (deprecated)

up

Indicates target health. 1 means the target is up and reachable; 0 means it is down.

ACK Dedicated etcd component (Job name: etcd)

Metric

Description

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus agent, in seconds.

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrape_custom_error

Total number of custom scrape errors from the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_scrapes_by_target_total

Total number of scrapes by target for the Alibaba Cloud Prometheus agent.

aliyun_prometheus_agent_target_info

Information about the Alibaba Cloud Prometheus agent's targets.

cpu_utilization_core

CPU utilization in cores.

etcd_cluster_version

Version of the etcd cluster.

etcd_debugging_auth_revision

The revision of the etcd auth store for debugging.

etcd_debugging_disk_backend_commit_rebalance_duration_seconds_bucket

Latency distribution of disk backend commit rebalancing for debugging (in seconds).

etcd_debugging_disk_backend_commit_rebalance_duration_seconds_count

Total count of disk backend commit rebalancing operations for debugging.

etcd_debugging_disk_backend_commit_rebalance_duration_seconds_sum

Total duration of disk backend commit rebalancing operations for debugging (in seconds).

etcd_debugging_disk_backend_commit_spill_duration_seconds_bucket

Latency distribution of disk backend commit spilling for debugging (in seconds).

etcd_debugging_disk_backend_commit_spill_duration_seconds_count

Total count of disk backend commit spilling operations for debugging.

etcd_debugging_disk_backend_commit_spill_duration_seconds_sum

Total duration of disk backend commit spilling operations for debugging (in seconds).

etcd_debugging_disk_backend_commit_write_duration_seconds_bucket

Latency distribution of disk backend commit write operations for debugging (in seconds).

etcd_debugging_disk_backend_commit_write_duration_seconds_count

Total count of disk backend commit write operations for debugging.

etcd_debugging_disk_backend_commit_write_duration_seconds_sum

Total duration of disk backend commit write operations for debugging (in seconds).

etcd_debugging_lease_granted_total

Total number of leases granted for debugging.

etcd_debugging_lease_renewed_total

Total number of leases renewed for debugging.

etcd_debugging_lease_revoked_total

Total number of leases revoked for debugging.

etcd_debugging_lease_ttl_total_bucket

Distribution of lease Time-To-Live (TTL) for debugging (in seconds).

etcd_debugging_lease_ttl_total_count

Total count of lease TTLs for debugging.

etcd_debugging_lease_ttl_total_sum

Total duration of lease TTLs for debugging (in seconds).

etcd_debugging_mvcc_compact_revision

The revision of the last MVCC compaction for debugging.

etcd_debugging_mvcc_current_revision

The current revision of the MVCC store for debugging.

etcd_debugging_mvcc_db_compaction_keys_total

Total number of keys compacted in the MVCC database for debugging.

etcd_debugging_mvcc_db_compaction_last

The timestamp of the last MVCC database compaction for debugging.

etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_bucket

Latency distribution of MVCC database compaction pauses for debugging (in milliseconds).

etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_count

Total count of MVCC database compaction pauses for debugging.

etcd_debugging_mvcc_db_compaction_pause_duration_milliseconds_sum

Total duration of MVCC database compaction pauses for debugging (in milliseconds).

etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_bucket

Latency distribution of MVCC database compactions for debugging (in milliseconds).

etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_count

Total count of MVCC database compaction operations for debugging.

etcd_debugging_mvcc_db_compaction_total_duration_milliseconds_sum

Total duration of MVCC database compaction operations for debugging (in milliseconds).

etcd_debugging_mvcc_db_total_size_in_bytes

Total size of the MVCC database for debugging (in bytes).

etcd_debugging_mvcc_delete_total

Total number of MVCC delete operations for debugging.

etcd_debugging_mvcc_events_total

Total number of MVCC events for debugging.

etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_bucket

Latency distribution of MVCC index compaction pauses for debugging (in milliseconds).

etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_count

Total count of MVCC index compaction pauses for debugging.

etcd_debugging_mvcc_index_compaction_pause_duration_milliseconds_sum

Total duration of MVCC index compaction pauses for debugging (in milliseconds).

etcd_debugging_mvcc_keys_total

Total number of keys in the MVCC store for debugging.

etcd_debugging_mvcc_pending_events_total

Total number of pending MVCC events for debugging.

etcd_debugging_mvcc_put_total

Total number of MVCC put operations for debugging.

etcd_debugging_mvcc_range_total

Total number of MVCC range requests for debugging.

etcd_debugging_mvcc_slow_watcher_total

Total number of slow watchers in the MVCC store for debugging.

etcd_debugging_mvcc_total_put_size_in_bytes

Total size of all MVCC put operations for debugging (in bytes).

etcd_debugging_mvcc_txn_total

Total number of MVCC transactions for debugging.

etcd_debugging_mvcc_watch_stream_total

Total number of MVCC watch streams for debugging.

etcd_debugging_mvcc_watcher_total

Total number of watchers in the MVCC store for debugging.

etcd_debugging_server_lease_expired_total

Total number of expired server leases for debugging.

etcd_debugging_snap_save_marshalling_duration_seconds_bucket

Latency distribution of snapshot save marshalling operations for debugging (in seconds).

etcd_debugging_snap_save_marshalling_duration_seconds_count

Total number of snapshot save marshalling operations for debugging.

etcd_debugging_snap_save_marshalling_duration_seconds_sum

Total duration of snapshot save marshalling operations for debugging (in seconds).

etcd_debugging_snap_save_total_duration_seconds_bucket

Latency distribution of snapshot save operations for debugging (in seconds).

etcd_debugging_snap_save_total_duration_seconds_count

Total count of snapshot save operations for debugging.

etcd_debugging_snap_save_total_duration_seconds_sum

Total duration of snapshot save operations for debugging (in seconds).

etcd_debugging_store_expires_total

Total number of expired keys in the store for debugging.

etcd_debugging_store_reads_total

Total number of read operations on the store for debugging.

etcd_debugging_store_watch_requests_total

Total number of watch requests on the store for debugging.

etcd_debugging_store_watchers

Number of watchers on the store for debugging.

etcd_debugging_store_writes_total

Total number of write operations on the store for debugging.

etcd_disk_backend_commit_duration_seconds_bucket

Latency distribution of disk backend commits (in seconds).

etcd_disk_backend_commit_duration_seconds_count

Total count of disk backend commit operations.

etcd_disk_backend_commit_duration_seconds_sum

Total duration of disk backend commit operations (in seconds).

etcd_disk_backend_defrag_duration_seconds_bucket

Latency distribution of disk backend defragmentation (in seconds).

etcd_disk_backend_defrag_duration_seconds_count

Total count of disk backend defragmentation operations.

etcd_disk_backend_defrag_duration_seconds_sum

Total duration of disk backend defragmentation operations (in seconds).

etcd_disk_backend_snapshot_duration_seconds_bucket

Latency distribution of disk backend snapshots (in seconds).

etcd_disk_backend_snapshot_duration_seconds_count

Total count of disk backend snapshot operations.

etcd_disk_backend_snapshot_duration_seconds_sum

Total duration of disk backend snapshot operations (in seconds).

etcd_disk_defrag_inflight

Number of in-flight disk defragmentation operations.

etcd_disk_wal_fsync_duration_seconds_bucket

Latency distribution of WAL fsyncs (in seconds).

etcd_disk_wal_fsync_duration_seconds_count

Total count of WAL fsync operations.

etcd_disk_wal_fsync_duration_seconds_sum

Total duration of WAL fsync operations (in seconds).

etcd_disk_wal_write_bytes_total

Total bytes written to the WAL.

etcd_grpc_proxy_cache_hits_total

Total number of cache hits in the gRPC proxy.

etcd_grpc_proxy_cache_keys_total

Total number of keys in the gRPC proxy cache.

etcd_grpc_proxy_cache_misses_total

Total number of cache misses in the gRPC proxy.

etcd_grpc_proxy_events_coalescing_total

Total number of coalesced events in the gRPC proxy.

etcd_grpc_proxy_watchers_coalescing_total

Total number of coalesced watchers in the gRPC proxy.

etcd_mvcc_db_open_read_transactions

Number of open read transactions in the MVCC database.

etcd_mvcc_db_total_size_in_bytes

Total size of the MVCC database on disk (in bytes).

etcd_mvcc_db_total_size_in_use_in_bytes

Actual size of the MVCC database in use (in bytes).

etcd_mvcc_delete_total

Total number of MVCC delete operations.

etcd_mvcc_hash_duration_seconds_bucket

Latency distribution of MVCC hash operations (in seconds).

etcd_mvcc_hash_duration_seconds_count

Total count of MVCC hash operations.

etcd_mvcc_hash_duration_seconds_sum

Total duration of MVCC hash operations (in seconds).

etcd_mvcc_hash_rev_duration_seconds_bucket

Latency distribution of MVCC hash revision operations (in seconds).

etcd_mvcc_hash_rev_duration_seconds_count

Total count of MVCC hash revision operations.

etcd_mvcc_hash_rev_duration_seconds_sum

Total duration of MVCC hash revision operations (in seconds).

etcd_mvcc_put_total

Total number of MVCC put operations.

etcd_mvcc_range_total

Total number of MVCC range requests.

etcd_mvcc_txn_total

Total number of MVCC transactions.

etcd_network_active_peers

Number of active peers.

etcd_network_client_grpc_received_bytes_total

Total bytes received from clients via gRPC.

etcd_network_client_grpc_sent_bytes_total

Total bytes sent to clients via gRPC.

etcd_network_disconnected_peers_total

Total number of disconnected peers.

etcd_network_peer_received_bytes_total

Total bytes received from peers.

etcd_network_peer_received_failures_total

Total number of receive failures from peers.

etcd_network_peer_round_trip_time_seconds_bucket

Latency distribution of peer round-trip time (in seconds).

etcd_network_peer_round_trip_time_seconds_count

Total count of peer round-trip time measurements.

etcd_network_peer_round_trip_time_seconds_sum

Total duration of peer round-trip times (in seconds).

etcd_network_peer_sent_bytes_total

Total bytes sent to peers.

etcd_network_peer_sent_failures_total

Total number of send failures to peers.

etcd_network_server_stream_failures_total

Total number of server stream failures.

etcd_network_snapshot_receive_inflights_total

Number of snapshots currently being received.

etcd_network_snapshot_receive_success

Total number of successful snapshot receives.

etcd_network_snapshot_receive_total_duration_seconds_bucket

Latency distribution of snapshot receives (in seconds).

etcd_network_snapshot_receive_total_duration_seconds_count

Total count of snapshot receive operations.

etcd_network_snapshot_receive_total_duration_seconds_sum

Total duration of snapshot receive operations (in seconds).

etcd_network_snapshot_send_inflights_total

Number of snapshots currently being sent.

etcd_network_snapshot_send_success

Total number of successful snapshot sends.

etcd_network_snapshot_send_total_duration_seconds_bucket

Latency distribution of snapshot sends (in seconds).

etcd_network_snapshot_send_total_duration_seconds_count

Total count of snapshot send operations.

etcd_network_snapshot_send_total_duration_seconds_sum

Total duration of snapshot send operations (in seconds).

etcd_server_apply_duration_seconds_bucket

Latency distribution of server apply operations (in seconds).

etcd_server_apply_duration_seconds_count

Total count of server apply operations.

etcd_server_apply_duration_seconds_sum

Total duration of server apply operations (in seconds).

etcd_server_client_requests_total

Total number of client requests to the server.

etcd_server_go_version

Go version of the etcd server.

etcd_server_has_leader

Whether this server believes a leader exists (1 if yes, 0 if no).

etcd_server_health_failures

Total number of failed health checks.

etcd_server_health_success

Total number of successful health checks.

etcd_server_heartbeat_send_failures_total

Total number of heartbeat send failures.

etcd_server_id

ID of the server.

etcd_server_is_leader

Whether this server is the leader (1 if yes, 0 if no).

etcd_server_is_learner

Whether this server is a learner (1 if yes, 0 if no).

etcd_server_leader_changes_seen_total

Total number of leader changes observed by the server.

etcd_server_learner_promote_successes

Total number of successful learner promotions.

etcd_server_proposals_applied_total

Total number of proposals applied by the server.

etcd_server_proposals_committed_total

Total number of proposals committed by the server.

etcd_server_proposals_failed_total

Total number of failed proposals.

etcd_server_proposals_pending

Number of pending proposals.

etcd_server_quota_backend_bytes

The server's backend storage quota (in bytes).

etcd_server_read_indexes_failed_total

Total number of failed read indexes.

etcd_server_slow_apply_total

Total number of slow apply operations.

etcd_server_slow_read_indexes_total

Total number of slow read index operations.

etcd_server_snapshot_apply_in_progress_total

Number of snapshot apply operations in progress.

etcd_server_version

Version of the etcd server.

etcd_snap_db_fsync_duration_seconds_bucket

Latency distribution of snapshot database fsyncs (in seconds).

etcd_snap_db_fsync_duration_seconds_count

Total number of snapshot database fsyncs.

etcd_snap_db_fsync_duration_seconds_sum

Total duration of snapshot database fsyncs (in seconds).

etcd_snap_db_save_total_duration_seconds_bucket

Latency distribution of snapshot database save operations (in seconds).

etcd_snap_db_save_total_duration_seconds_count

Total count of snapshot database save operations.

etcd_snap_db_save_total_duration_seconds_sum

Total duration of snapshot database save operations (in seconds).

etcd_snap_fsync_duration_seconds_bucket

Latency distribution of snapshot fsyncs (in seconds).

etcd_snap_fsync_duration_seconds_count

Total count of snapshot fsync operations.

etcd_snap_fsync_duration_seconds_sum

Total duration of snapshot fsyncs (in seconds).

grpc_server_handled_total

Total number of RPCs handled by the gRPC server.

grpc_server_msg_received_total

Total number of messages received by the gRPC server.

grpc_server_msg_sent_total

Total number of messages sent by the gRPC server.

grpc_server_started_total

Total number of RPCs started on the gRPC server.

memory_utilization_byte

Memory utilization in bytes.

os_fd_limit

The operating system limit for file descriptors.

os_fd_used

Number of used file descriptors.

up

Indicates whether the target is healthy and reachable: 1 for up, 0 for down.

ACK Dedicated scheduler component (job: ack-scheduler)

Metric

Description

aggregator_discovery_aggregation_count_total

Total aggregator discovery aggregations

aliyun_prometheus_agent_append_duration_seconds

Duration of append operations for the Alibaba Cloud Prometheus Agent, in seconds

aliyun_prometheus_agent_job_discovery_status

Discovery status of scrape jobs for the Alibaba Cloud Prometheus Agent

aliyun_prometheus_agent_scrape_custom_error

Total custom scrape errors from the Alibaba Cloud Prometheus Agent

aliyun_prometheus_agent_scrapes_by_target_total

Total scrapes by the Alibaba Cloud Prometheus Agent, per target

aliyun_prometheus_agent_target_info

Information about scrape targets for the Alibaba Cloud Prometheus Agent

apiserver_audit_event_total

Total APIServer audit events

apiserver_audit_requests_rejected_total

Total rejected audit requests to the APIServer

apiserver_client_certificate_expiration_seconds_bucket

Distribution of the remaining lifetime for APIServer client certificates, in seconds

apiserver_client_certificate_expiration_seconds_count

Count of APIServer client certificate expiration measurements

apiserver_client_certificate_expiration_seconds_sum

Sum of the remaining lifetime for APIServer client certificates, in seconds

apiserver_delegated_authn_request_duration_seconds_bucket

Distribution of delegated authentication latency for the APIServer, in seconds

apiserver_delegated_authn_request_duration_seconds_count

Count of delegated authentication latency measurements for the APIServer

apiserver_delegated_authn_request_duration_seconds_sum

Total delegated authentication latency for the APIServer, in seconds

apiserver_delegated_authn_request_total

Total delegated authentication requests to the APIServer

apiserver_delegated_authz_request_duration_seconds_bucket

Distribution of delegated authorization latency for the APIServer, in seconds

apiserver_delegated_authz_request_duration_seconds_count

Count of delegated authorization latency measurements for the APIServer

apiserver_delegated_authz_request_duration_seconds_sum

Total delegated authorization latency for the APIServer, in seconds

apiserver_delegated_authz_request_total

Total delegated authorization requests to the APIServer

apiserver_encryption_config_controller_automatic_reload_failures_total

Total failed automatic reloads of the APIServer encryption configuration

apiserver_encryption_config_controller_automatic_reload_success_total

Total successful automatic reloads of the APIServer encryption configuration

apiserver_envelope_encryption_dek_cache_fill_percent

Fill percentage of the APIServer envelope encryption DEK cache

apiserver_storage_data_key_generation_duration_seconds_bucket

Distribution of APIServer storage data key generation latency, in seconds

apiserver_storage_data_key_generation_duration_seconds_count

Total APIServer storage data key generation operations

apiserver_storage_data_key_generation_duration_seconds_sum

Total latency of APIServer storage data key generation, in seconds

apiserver_storage_data_key_generation_failures_total

Total data key generation failures in APIServer storage

apiserver_storage_envelope_transformation_cache_misses_total

Total cache misses for APIServer storage envelope transformations

apiserver_webhooks_x509_insecure_sha1_total

Total APIServer webhooks using an insecure SHA-1 X.509 certificate

apiserver_webhooks_x509_missing_san_total

Total APIServer webhooks with an X.509 certificate missing a SAN

authenticated_user_requests

Total requests from authenticated users

authentication_attempts

Total authentication attempts

authentication_duration_seconds_bucket

Distribution of authentication latency, in seconds

authentication_duration_seconds_count

Count of authentication latency measurements

authentication_duration_seconds_sum

Total authentication latency, in seconds

authentication_token_cache_active_fetch_count

Number of active fetches in the authentication token cache

authentication_token_cache_fetch_total

Total fetches from the authentication token cache

authentication_token_cache_request_duration_seconds_bucket

Distribution of authentication token cache request latency, in seconds

authentication_token_cache_request_duration_seconds_count

Count of authentication token cache request latency measurements

authentication_token_cache_request_duration_seconds_sum

Total authentication token cache request latency, in seconds

authentication_token_cache_request_total

Total requests to the authentication token cache

authorization_attempts_total

Total authorization attempts

authorization_duration_seconds_bucket

Distribution of authorization latency, in seconds

authorization_duration_seconds_count

Count of authorization latency measurements

authorization_duration_seconds_sum

Total authorization latency, in seconds

cardinality_enforcement_unexpected_categorizations_total

Total unexpected categorizations during cardinality enforcement

kubernetes_build_info

Kubernetes build information

kubernetes_feature_enabled

Indicates if a specific Kubernetes feature is enabled

leader_election_master_status

Indicates if the component is the current leader in the leader election

registered_metric_total

Total number of registered metrics

registered_metrics_total

Total number of registered metrics

rest_client_exec_plugin_certificate_rotation_age_bucket

Distribution of the age of rotated certificates for the REST client exec plugin

rest_client_exec_plugin_certificate_rotation_age_count

Count of rotated certificate age measurements for the REST client exec plugin

rest_client_exec_plugin_certificate_rotation_age_sum

Sum of the age of rotated certificates for the REST client exec plugin

rest_client_rate_limiter_duration_seconds_bucket

Distribution of REST client rate limiter latency, in seconds

rest_client_rate_limiter_duration_seconds_count

Count of REST client rate limiter latency measurements

rest_client_rate_limiter_duration_seconds_sum

Total REST client rate limiter latency, in seconds

rest_client_request_duration_seconds_bucket

Distribution of REST client request latency, in seconds

rest_client_request_duration_seconds_count

Count of REST client request latency measurements

rest_client_request_duration_seconds_sum

Total REST client request latency, in seconds

rest_client_request_retries_total

Total retried REST client requests

rest_client_request_size_bytes_bucket

Distribution of REST client request sizes, in bytes

rest_client_request_size_bytes_count

Count of REST client request size measurements

rest_client_request_size_bytes_sum

Sum of REST client request sizes, in bytes

rest_client_requests_total

Total REST client requests

rest_client_response_size_bytes_bucket

Distribution of REST client response sizes, in bytes

rest_client_response_size_bytes_count

Count of REST client response size measurements

rest_client_response_size_bytes_sum

Sum of REST client response sizes, in bytes

rest_client_transport_cache_entries

Number of entries in the REST client transport cache

rest_client_transport_create_calls_total

Total calls to create a REST client transport

scheduler_binding_duration_seconds_bucket

Distribution of scheduler binding latency, in seconds

scheduler_binding_duration_seconds_count

Total scheduler binding operations

scheduler_binding_duration_seconds_sum

Total latency of scheduler binding operations, in seconds

scheduler_e2e_scheduling_duration_seconds_bucket

Distribution of end-to-end scheduling latency, in seconds

scheduler_e2e_scheduling_duration_seconds_count

Count of end-to-end scheduling latency measurements

scheduler_e2e_scheduling_duration_seconds_sum

Total end-to-end scheduling latency, in seconds

scheduler_framework_extension_point_duration_seconds_bucket

Distribution of scheduler framework extension point latency, in seconds

scheduler_framework_extension_point_duration_seconds_count

Count of scheduler framework extension point latency measurements

scheduler_framework_extension_point_duration_seconds_sum

Total scheduler framework extension point latency, in seconds

scheduler_goroutines

Number of scheduler goroutines

scheduler_pending_pods

Number of pending pods in the scheduler queue

scheduler_plugin_evaluation_total

Total scheduler plugin evaluations

scheduler_plugin_execution_duration_seconds_bucket

Distribution of scheduler plugin execution latency, in seconds

scheduler_plugin_execution_duration_seconds_count

Count of scheduler plugin execution latency measurements

scheduler_plugin_execution_duration_seconds_sum

Total scheduler plugin execution latency, in seconds

scheduler_pod_preemption_victims_bucket

Distribution of the number of pods chosen as preemption victims

scheduler_pod_preemption_victims_count

Count of preemption victim measurements

scheduler_pod_preemption_victims_sum

Total number of pods chosen as preemption victims

scheduler_pod_scheduling_attempts_bucket

Distribution of the number of scheduling attempts for a pod

scheduler_pod_scheduling_attempts_count

Count of pod scheduling attempt measurements

scheduler_pod_scheduling_attempts_sum

Total number of pod scheduling attempts

scheduler_pod_scheduling_duration_seconds_bucket

Distribution of pod scheduling latency, in seconds

scheduler_pod_scheduling_duration_seconds_count

Count of pod scheduling latency measurements

scheduler_pod_scheduling_duration_seconds_sum

Total pod scheduling latency, in seconds

scheduler_pod_scheduling_sli_duration_seconds_bucket

Distribution of pod scheduling SLI latency, in seconds

scheduler_pod_scheduling_sli_duration_seconds_count

Count of pod scheduling SLI latency measurements

scheduler_pod_scheduling_sli_duration_seconds_sum

Total pod scheduling SLI latency, in seconds

scheduler_preemption_attempts_total

Total preemption attempts by the scheduler

scheduler_preemption_victims_bucket

Distribution of the number of pods chosen as preemption victims

scheduler_preemption_victims_count

Count of preemption victim measurements

scheduler_preemption_victims_sum

Total number of pods chosen as preemption victims

scheduler_queue_incoming_pods_total

Total incoming pods to the scheduler queue

scheduler_schedule_attempts_total

Total scheduling attempts by the scheduler

scheduler_scheduler_cache_size

Size of the scheduler cache

scheduler_scheduler_goroutines

Number of scheduler goroutines

scheduler_scheduling_algorithm_duration_seconds_bucket

Distribution of scheduling algorithm latency, in seconds

scheduler_scheduling_algorithm_duration_seconds_count

Count of scheduling algorithm latency measurements

scheduler_scheduling_algorithm_duration_seconds_sum

Total scheduling algorithm latency, in seconds

scheduler_scheduling_algorithm_predicate_evaluation_seconds_bucket

Distribution of scheduling algorithm predicate evaluation latency, in seconds

scheduler_scheduling_algorithm_predicate_evaluation_seconds_count

Count of scheduling algorithm predicate evaluation latency measurements

scheduler_scheduling_algorithm_predicate_evaluation_seconds_sum

Total scheduling algorithm predicate evaluation latency, in seconds

scheduler_scheduling_algorithm_preemption_evaluation_seconds_bucket

Distribution of scheduling algorithm preemption evaluation latency, in seconds

scheduler_scheduling_algorithm_preemption_evaluation_seconds_count

Count of scheduling algorithm preemption evaluation latency measurements

scheduler_scheduling_algorithm_preemption_evaluation_seconds_sum

Total scheduling algorithm preemption evaluation latency, in seconds

scheduler_scheduling_algorithm_priority_evaluation_seconds_bucket

Distribution of scheduling algorithm priority evaluation latency, in seconds

scheduler_scheduling_algorithm_priority_evaluation_seconds_count

Count of scheduling algorithm priority evaluation latency measurements

scheduler_scheduling_algorithm_priority_evaluation_seconds_sum

Total scheduling algorithm priority evaluation latency, in seconds

scheduler_scheduling_attempt_duration_seconds_bucket

Distribution of scheduling attempt latency, in seconds

scheduler_scheduling_attempt_duration_seconds_count

Count of scheduling attempt latency measurements

scheduler_scheduling_attempt_duration_seconds_sum

Total scheduling attempt latency, in seconds

scheduler_scheduling_duration_seconds

Scheduling operation duration, in seconds

scheduler_scheduling_duration_seconds_count

Count of scheduling latency measurements

scheduler_scheduling_duration_seconds_sum

Total scheduling latency, in seconds

scheduler_total_preemption_attempts

Total number of preemption attempts by the scheduler

scheduler_unschedulable_pods

Number of unschedulable pods in the scheduler queue

scheduler_volume_scheduling_duration_seconds_bucket

Distribution of volume scheduling latency, in seconds

scheduler_volume_scheduling_duration_seconds_count

Count of volume scheduling latency measurements

scheduler_volume_scheduling_duration_seconds_sum

Total volume scheduling latency, in seconds

scheduler_volume_scheduling_stage_error_total

Total errors during the volume scheduling stage

scrape_duration_seconds

Scrape duration, in seconds

scrape_samples_post_metric_relabeling

Samples remaining after metric relabeling

scrape_samples_scraped

Total samples scraped from the target

scrape_series_added

New series added in a scrape

up

Indicates the health of the scrape target (1 for up, 0 for down)

workqueue_adds_total

Total items added to the workqueue

workqueue_depth

Current depth of the workqueue

workqueue_longest_running_processor_seconds

Runtime of the longest-running workqueue processor, in seconds

workqueue_queue_duration_seconds_bucket

Distribution of time items wait in the workqueue before processing, in seconds

workqueue_queue_duration_seconds_count

Count of workqueue latency measurements

workqueue_queue_duration_seconds_sum

Sum of time items wait in the workqueue before processing, in seconds

workqueue_retries_total

Total workqueue retries

workqueue_unfinished_work_seconds

Age of the oldest unfinished work item in the workqueue, in seconds

workqueue_work_duration_seconds_bucket

Distribution of time spent processing workqueue items, in seconds

workqueue_work_duration_seconds_count

Count of workqueue processing latency measurements

workqueue_work_duration_seconds_sum

Sum of time spent processing workqueue items, in seconds

References