本文介绍KAFKA指标的详细信息。
KAFKA指标包含以下部分：
Kafka-Topics
| 参数 | 指标 | 描述 |
|---|---|---|
| UnderReplicated | Kafka_Broker_kafka_cluster_Partition_UnderReplicated | - |
| UnderMinIsr | Kafka_Broker_kafka_cluster_Partition_UnderMinIsr | - |
| BytesInPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 单位：Byte。 |
| BytesOutPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 单位：Byte。 |
| MessagesInPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | 单位：Byte。 |
| TotalFetchRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate | - |
| TotalProduceRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate | - |
| FailedFetchRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate | - |
| FailedProduceRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate | - |
| FetchMessageConversionsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate | - |
| ProduceMessageConversionsPerSe | Kafka_Topic_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate | - |
Request TIme
| 参数 | 指标 | 描述 |
|---|---|---|
| Total time in ms to serve the FetchFollower request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=Produce。单位：ms。 |
| Total time in ms to serve the FetchFollower request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=FetchFollower。单位：ms。 |
| Total time in ms to serve the Fetch request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=Fetch。单位：ms。 |
| Total time in ms to serve the FetchConsumer request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time the Produce request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=Produce。单位：ms。 |
| Time the FetchConsumer request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time the FetchFollower request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=FetchFollower。单位：ms。 |
| Time the Produce request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=Produce。单位：ms。 |
| Time the FetchConsumer request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time the FetchFollower request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=FetchFollower。单位：ms。 |
| Time the Produce request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=Produce。单位：ms。 |
| Time the FetchConsumer request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time the FetchFollower request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time the FetchFollower request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=FetchFollower。单位：ms。 |
| Time the Produce request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=Produce。单位：ms。 |
| Time the FetchConsumer request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time to send the response for FetchConsumer request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=FetchConsumer。单位：ms。 |
| Time to send the response for FetchFollower request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=FetchFollower。单位：ms。 |
| Time to send the response for Produce request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=Produce。单位：ms。 |
Status
| 参数 | 指标 |
|---|---|
| LeaderCount | Kafka_Broker_kafka_server_ReplicaManager_LeaderCount |
| PartitionCount | Kafka_Broker_kafka_server_ReplicaManager_PartitionCount |
| OfflineLogDirectoryCount | Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount |
| UnderReplicatedPartitions | Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions |
| OfflineReplicaCount | Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount |
| UnderMinIsrPartitionCount | Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount |
Request Rate
| 参数 | 指标 | 描述 |
|---|---|---|
| TotalFetchRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate | - |
| TotalProduceRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate | - |
| FailedFetchRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate | - |
| RequestsPerSec-Fetch | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=Fetch |
| RequestsPerSec-FetchConsumer | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=FetchConsumer |
| RequestsPerSec-FetchFollower | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=FetchFollower |
| RequestsPerSec-Produce | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=Produce |
| FailedProduceRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate | - |
MessageConversion
| 参数 | 指标 |
|---|---|
| FetchMessageConversionsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate |
| ProduceMessageConversionsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate |
Performance
| 参数 | 指标 | 描述 |
|---|---|---|
| RequestHandlerAvgIdlePercent | Kafka_Broker_kafka_server_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate | 单位：%。 |
| IsrShrinksPerSec | Kafka_Broker_kafka_server_ReplicaManager_IsrShrinksPerSec_OneMinuteRate | - |
| IsrExpandsPerSec | Kafka_Broker_kafka_server_ReplicaManager_IsrExpandsPerSec_OneMinuteRate | - |
| RequestQueueUsagePercent | Kafka_Broker_kafka_network_RequestChannel_RequestQueueUsagePercent | 单位：%。 |
| NetworkProcessorAvgIdlePercent | Kafka_Broker_kafka_network_SocketServer_NetworkProcessorAvgIdlePercent | 单位：%。 |
| LogFlushRateAndTimeMs | Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_99thPercentile | 单位：ms。 |
Storage
| 参数 | 指标 | 描述 |
|---|---|---|
| - | Kafka_Broker_kafka_log_Log_Size | topic。单位：MiB。 |
| disk-usages-max-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-max-percent | 单位：%。 |
| disk-usages-mean-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-mean-percent | 单位：%。 |
| disk-usages-min-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-min-percent | 单位：%。 |
ZK session
| 参数 | 指标 |
|---|---|
| ZooKeeperDisconnectsPerSec | Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperDisconnectsPerSec_OneMinuteRate |
| ZooKeeperExpiresPerSec | Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperExpiresPerSec_OneMinuteRate |
JVM
| 参数 | 指标 | 描述 |
|---|---|---|
| G1-Old-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionTime | 单位：ms。 |
| G1-Young-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionCount | - |
| G1-Young-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionTime | 单位：ms。 |
| G1-Young-CollectionCount | Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionCount | - |
Throughput
| 参数 | 指标 | 描述 |
|---|---|---|
| BytesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 单位：Byte。 |
| BytesOutPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 单位：Byte。 |
| MessagesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | - |
Kafka-Home
| 参数 | 描述 | 描述 |
|---|---|---|
| ActiveControllerCount | Kafka_Broker_kafka_controller_KafkaController_ActiveControllerCount | - |
| OfflinePartitionsCount | Kafka_Broker_kafka_controller_KafkaController_OfflinePartitionsCount | - |
| GlobalPartitionCount | Kafka_Broker_kafka_controller_KafkaController_GlobalPartitionCount | - |
| GlobalTopicCount | Kafka_Broker_kafka_controller_KafkaController_GlobalTopicCount | - |
| GlobalTopicCount | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 单位：Byte。 |
| BytesOutPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 单位：Byte。 |
| MessagesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | - |
| UnderReplicatedPartitions | Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions | - |
| OfflineReplicaCount | Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount | - |
| UnderMinIsrPartitionCount | Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount | - |