首页 文章

Kafka使用Burrow进行监控

提问于
浏览
0

使用Burrow监视Kafka时

1)主题分区中给定消费者群体的Burrow开始和结束偏移量是什么意思?我找不到任何关于此的文件 .

什么是匹配的 Kafka 术语? Kafka 术语:最后提交偏移,当前偏移,高水位标记偏移,对数结束偏移 . Burrow的开始和结束偏移图是什么?这是Kafka Current Offset和kafka Highwater mark offset吗?

例如 .

http://localhost:8000/v2/kafka/local/consumer/MyGroup-1-4/lag {"error":假,"message":"consumer group status returned","status":{"cluster":"local","group":"MyGroup-1-4","status":"ERR","complete":假,"partitions":[{"topic":"MyTopicTest-1","partition":1,"status":"OK","start":{"offset": 28,"timestamp":1468769616468,"lag":0},"end":{"offset":34,"timestamp":1468805045000,"lag":0}},{"topic":"MyTopicTest-1","partition":3,"status":"STOP","start":{"offset":32,"timestamp": 1468803763000,"lag":0},"end":{"offset":32,"timestamp":1468804303000,"lag":0}},{"topic":"MyTopicTest-1","partition":4,"status":"OK","start":{"offset":32,"timestamp":1468804003000,"lag": 0},"end":{"offset":33,"timestamp":1468804783000,"lag":0}},{"topic":"MyTopicTest-1","partition":5,"status":"STOP","start":{5066506:32,"timestamp":1468803763000,"lag":0},"end" :{"offset":32,"timestamp":1468804303000,"lag":0}},{"topic":"MyTopicTest-1","partition":6,"status":"OK","start":{"offset":33,5 06520:1468804423000,"lag":0},"end":{"offset":34,"timestamp":1468805045000,"lag":0}},{"topic":"MyTopicTest-1","partition":7,"status":"OK","start":{"offset":27,"timestamp":1468769387995, "lag":0},"end":{"offset":33,"timestamp":1468804783000,"lag":0}},{"topic":"MyTopicTest-1","partition":9,"status":"OK","start":{"offset":27,"timestamp":1468769433946,"lag":0} ,"end":{"offset":33,"timestamp":1468804783000,"lag":0}}],"partition_count":10,"maxlag":null,"totallag":0},"request":{"url":"/v2/kafka/local/consumer/MyGroup-1-4/lag","host":"****","cluster":"local","group":"MyGroup-1-4" ,"topic":“”}}

2)某些状态标记为已停止 . 用于将状态标记为STOPPED的挖掘规则是:如果现在的时间与最近的偏移的时间之间的差异大于窗口中最近的偏移和最旧的偏移之间的差异,则消费者处于ERROR状态并且分区标记为已停止 . 但是,如果消费者偏移量和分区的当前代理偏移量相等,则不认为该分区出错 .

现在几点”?是延迟请求发送到Burrow的时间

1 回答

  • 0

    1) What do the Burrow start and end offset for a given consumer group in a topic partition mean? I could not find any documentation on this.
    这两个偏移意味着 logcheck evaluation window 中的开始和结束偏移(消费者承诺的偏移) . 默认窗口将存储10个偏移,用于评估消费者滞后 . 请参考下图和链接 .
    Burrow: Kafka Consumer Monitoring Reinvented
    enter image description here

    2, What is "time now"? Is it the time at which the lag request was sent to Burrow?
    "time now"表示当前"lagcheck interval" . 您可以在Example 5中获得更详细的示例 .

    存储的第一个偏移量与存储的最后一个偏移量之间的时间差为540秒,现在与存储的最后一个偏移量之间的时间差为660秒 . 消费者已经停止提交偏移,这意味着它已经失败或已经停止 .

相关问题