本文为您介绍Kafka指标的详细信息。

Kafka指标包含以下部分：

Kafka-HOME

参数 指标 描述
ActiveControllerCount Kafka_Broker_kafka_controller_KafkaController_ActiveControllerCount 当某个Broker上该指标为1时，该Broker为Controller节点。
GlobalTopicCount Kafka_Broker_kafka_controller_KafkaController_GlobalTopicCount 集群总Topic个数。
GlobalPartitionCount Kafka_Broker_kafka_controller_KafkaController_GlobalPartitionCount 集群总Partition个数。
UnderMinIsrPartitionCount Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount 低于Min Isr partition的个数。
OfflineLogDirectoryCount Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount Directory Offline个数。
OfflinePartitionsCount Kafka_Broker_kafka_controller_KafkaController_OfflinePartitionsCount Offline的Partition个数。
UnderReplicatedPartitions Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions 处于未同步状态Partition个数。
BytesOutPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate 每秒流量出口字节数。
BytesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate 每秒流量入口字节数。
MessagesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate 每秒流量入口条数。

Kafka-Broker

Status

参数 指标 描述
LeaderCount Kafka_Broker_kafka_server_ReplicaManager_LeaderCount Leader个数。
PartitionCount Kafka_Broker_kafka_server_ReplicaManager_PartitionCount Partition个数。
OfflineLogDirectoryCount Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount Directory Offline个数。
OfflineReplicaCount Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount Offline Replica个数。
UnderReplicatedPartitions Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions 处于未同步状态的Partition个数。
UnderMinIsrPartitionCount Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount 低于Min Isr partition的个数。

Throughput

参数 指标 描述
BytesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate Broker每秒流量入口字节数。
BytesOutPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate Broker每秒流量出口字节数。
MessagesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate Broker每秒流量入口条数。

Performance

参数 指标 描述
IsrShrinksPerSec Kafka_Broker_kafka_server_ReplicaManager_IsrShrinksPerSec_OneMinuteRate ISR缩减频率。
IsrExpandsPerSec Kafka_Broker_kafka_server_ReplicaManager_IsrExpandsPerSec_OneMinuteRate ISR膨胀频率。
RequestHandlerAvgIdlePercent Kafka_Broker_kafka_server_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate Request请求处理线程的空闲比。
NetworkProcessorAvgIdlePercent Kafka_Broker_kafka_network_SocketServer_NetworkProcessorAvgIdlePercent 网络处理线程的空闲比。
RequestQueueUsagePercent Kafka_Broker_kafka_network_RequestChannel_RequestQueueUsagePercent RequestQueue队列的使用率。
LogFlushRateAndTimeMs Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_OneMinuteRate 磁盘刷盘的速率。
Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_99thPercentile 磁盘刷盘消耗的时间，单位：ms。

Storage

参数 指标 描述
Size Kafka_Broker_kafka_log_Log_Size Partition存储的大小。
disk-usages-max-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_max_percent 该Broker各个磁盘使用率的最大值。
disk-usages-mean-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_mean_percent 该Broker各个磁盘使用率的平均值。
disk-usages-min-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_min_percent 该Broker各个磁盘使用率的最小值。

Request Rate

参数 指标 描述
TotalFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate Broker每秒Fetch请求次数。
TotalProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate Broker每秒Produce请求次数。
FailedFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate Broker每秒失败的Fetch请求次数。
FailedProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate Broker每秒失败的Produce请求次数。
RequestsPerSec-Produce Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Produce每秒请求的字节数。
RequestsPerSec-Fetch Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Fetch请求数。
RequestsPerSec-FetchFollower Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Follower Fetch请求数。
RequestsPerSec-FetchConsumer Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Consumer Fetch请求数。

Request Time

参数 指标 描述
RequestMetrics-TotalTimeMs-Produce-99th Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile Produce Request处理时长，单位：ms。
RequestMetrics-TotalTimeMs-Fetch-99th Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile Fetch Request处理时长，单位：ms。

MessageConversion

参数 指标 描述
FetchMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate Broker每秒Fetch Request导致的消息版本转换的条数。
ProduceMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate Broker每秒Produce Request导致的消息版本转换的条数。

ZK session

参数 指标 描述
ZooKeeperDisconnectsPerSec Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperDisconnectsPerSec_OneMinuteRate Zookeeper客户端断开频率。
ZooKeeperExpiresPerSec Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperExpiresPerSec_OneMinuteRate Zookeeper客户端Session过期频率。

JVM

参数 指标 描述
G1-Old-CollectionTime Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionTime 老年代垃圾回收器收集时长。
G1-Old-CollectionCount Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionCount 老年代垃圾回收器收集次数。
G1-Young-CollectionTime Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionTime 年轻代垃圾回收器收集时长。
G1-Young-CollectionCount Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionCount 年轻代垃圾回收器收集次数。

Kafka-Topic

Status

参数 指标 描述
UnderReplicated Kafka_Broker_kafka_cluster_Partition_UnderReplicated 该Topic-Partition是否在非同步状态。
UnderMinIsr Kafka_Broker_kafka_cluster_Partition_UnderMinIsr 该Topic-Partition是否处于小于MinIsr状态。

Throughput

参数 指标 描述
BytesInPerSec kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate Topic每秒流量入口字节数。
BytesOutPerSec kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate Topic每秒流量出口字节数。
MessagesInPerSec kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate Topic每秒流量入口条数。

Request Rate

参数 指标 描述
TotalFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate Topic每秒Fetch请求次数。
TotalProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate Topic每秒Produce请求次数。
FailedFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate Topic每秒失败Fetch请求次数。
FailedProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate Topic每秒失败Produce请求次数。

MessageConversion

参数 指标 描述
FetchMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate Topic每秒Fetch Request导致的消息版本转换的条数。
ProduceMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate Topic每秒Produce Request导致的消息版本转换的条数。

Storage

参数 指标 描述
Size Kafka_Broker_kafka_log_Log_Size Partition存储的大小。