KAFKA指標(biāo)
本文介紹KAFKA指標(biāo)的詳細(xì)信息。
KAFKA指標(biāo)包含以下部分：
Kafka-Topics
參數(shù) | 指標(biāo) | 描述 |
UnderReplicated | Kafka_Broker_kafka_cluster_Partition_UnderReplicated | - |
UnderMinIsr | Kafka_Broker_kafka_cluster_Partition_UnderMinIsr | - |
BytesInPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 單位：Byte。 |
BytesOutPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 單位：Byte。 |
MessagesInPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | 單位：Byte。 |
TotalFetchRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate | - |
TotalProduceRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate | - |
FailedFetchRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate | - |
FailedProduceRequestsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate | - |
FetchMessageConversionsPerSec | Kafka_Topic_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate | - |
ProduceMessageConversionsPerSe | Kafka_Topic_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate | - |
Request TIme
參數(shù) | 指標(biāo) | 描述 |
Total time in ms to serve the Produce request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=Produce。單位：ms。 |
Total time in ms to serve the FetchFollower request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=FetchFollower。單位：ms。 |
Total time in ms to serve the Fetch request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=Fetch。單位：ms。 |
Total time in ms to serve the FetchConsumer request | Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time the Produce request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=Produce。單位：ms。 |
Time the FetchConsumer request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time the FetchFollower request waits in the request queue. | Kafka_Broker_kafka_network_RequestMetrics_RequestQueueTimeMs_99thPercentile | request=FetchFollower。單位：ms。 |
Time the Produce request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=Produce。單位：ms。 |
Time the FetchConsumer request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time the FetchFollower request is processed at the leader | Kafka_Broker_kafka_network_RequestMetrics_LocalTimeMs_99thPercentile | request=FetchFollower。單位：ms。 |
Time the Produce request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=Produce。單位：ms。 |
Time the FetchConsumer request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time the FetchFollower request waits for the follower. This is non-zero for produce requests when acks=all | Kafka_Broker_kafka_network_RequestMetrics_RemoteTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time the FetchFollower request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=FetchFollower。單位：ms。 |
Time the Produce request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=Produce。單位：ms。 |
Time the FetchConsumer request waits in the response queue | Kafka_Broker_kafka_network_RequestMetrics_ResponseQueueTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time to send the response for FetchConsumer request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=FetchConsumer。單位：ms。 |
Time to send the response for FetchFollower request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=FetchFollower。單位：ms。 |
Time to send the response for Produce request | Kafka_Broker_kafka_network_RequestMetrics_ResponseSendTimeMs_99thPercentile | request=Produce。單位：ms。 |
Status
參數(shù) | 指標(biāo) |
LeaderCount | Kafka_Broker_kafka_server_ReplicaManager_LeaderCount |
PartitionCount | Kafka_Broker_kafka_server_ReplicaManager_PartitionCount |
OfflineLogDirectoryCount | Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount |
UnderReplicatedPartitions | Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions |
OfflineReplicaCount | Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount |
UnderMinIsrPartitionCount | Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount |
Request Rate
參數(shù) | 指標(biāo) | 描述 |
TotalFetchRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate | - |
TotalProduceRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate | - |
FailedFetchRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate | - |
RequestsPerSec-Fetch | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=Fetch |
RequestsPerSec-FetchConsumer | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=FetchConsumer |
RequestsPerSec-FetchFollower | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=FetchFollower |
RequestsPerSec-Produce | Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate | request=Produce |
FailedProduceRequestsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate | - |
MessageConversion
參數(shù) | 指標(biāo) |
FetchMessageConversionsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate |
ProduceMessageConversionsPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate |
Performance
參數(shù) | 指標(biāo) | 描述 |
RequestHandlerAvgIdlePercent | Kafka_Broker_kafka_server_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate | 單位：%。 |
IsrShrinksPerSec | Kafka_Broker_kafka_server_ReplicaManager_IsrShrinksPerSec_OneMinuteRate | - |
IsrExpandsPerSec | Kafka_Broker_kafka_server_ReplicaManager_IsrExpandsPerSec_OneMinuteRate | - |
RequestQueueUsagePercent | Kafka_Broker_kafka_network_RequestChannel_RequestQueueUsagePercent | 單位：%。 |
NetworkProcessorAvgIdlePercent | Kafka_Broker_kafka_network_SocketServer_NetworkProcessorAvgIdlePercent | 單位：%。 |
LogFlushRateAndTimeMs | Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_99thPercentile | 單位：ms。 |
Storage
參數(shù) | 指標(biāo) | 描述 |
- | Kafka_Broker_kafka_log_Log_Size | topic。單位：MiB。 |
disk-usages-max-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-max-percent | 單位：%。 |
disk-usages-mean-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-mean-percent | 單位：%。 |
disk-usages-min-percent | Kafka_Broker_kafka_server_ReplicaManager_disk-usages-min-percent | 單位：%。 |
ZK session
參數(shù) | 指標(biāo) |
ZooKeeperDisconnectsPerSec | Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperDisconnectsPerSec_OneMinuteRate |
ZooKeeperExpiresPerSec | Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperExpiresPerSec_OneMinuteRate |
JVM
參數(shù) | 指標(biāo) | 描述 |
G1-Old-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionTime | 單位：ms。 |
G1-Young-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionCount | - |
G1-Young-CollectionTime | Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionTime | 單位：ms。 |
G1-Young-CollectionCount | Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionCount | - |
Throughput
參數(shù) | 指標(biāo) | 描述 |
BytesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 單位：Byte。 |
BytesOutPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 單位：Byte。 |
MessagesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | - |
Kafka-Home
參數(shù) | 描述 | 描述 |
ActiveControllerCount | Kafka_Broker_kafka_controller_KafkaController_ActiveControllerCount | - |
OfflinePartitionsCount | Kafka_Broker_kafka_controller_KafkaController_OfflinePartitionsCount | - |
GlobalPartitionCount | Kafka_Broker_kafka_controller_KafkaController_GlobalPartitionCount | - |
GlobalTopicCount | Kafka_Broker_kafka_controller_KafkaController_GlobalTopicCount | - |
GlobalTopicCount | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate | 單位：Byte。 |
BytesOutPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate | 單位：Byte。 |
MessagesInPerSec | Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate | - |
UnderReplicatedPartitions | Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions | - |
OfflineReplicaCount | Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount | - |
UnderMinIsrPartitionCount | Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount | - |