江苏龙网

  1. 首页 > 生活 > >

Kafka manager, Burrow等几款Kafka Monitor的流行程度咋样( 二 )



2. kafka monitor的话，本质上是启动一个topic，启动一个produce service，启动一个consumer service，然后端到端，测试相应的jmx数据。如胡夕大神所说，并不是很友好，需要做一些修改来满足自己的需求。比如我增加了broker-consumer的延迟数据采集
Kafka manager, Burrow等几款Kafka Monitor的流行程度咋样

3.JMXTrans + InfluxDB + Grafana
总的来说就是
采集JMX数据
入库
定制可视化界面
Kafka manager, Burrow等几款Kafka Monitor的流行程度咋样



关于集群性能的监控，还是需要知道自己到底想关注那些指标，具体的指标含义可以参考这里：
https://kafka.apache.org/documentation/#monitoring

■网友
转一篇Dennis Jaheruddin18年在stackoverflow上的回答：
LensesLenses (ex Landoop) enhances Kafka with User Interface, streaming SQL engine and cluster monitoring. It enables faster monitoring of Kafka data pipelines.They provide a free all-in-one docker (Lenses Box) which can serve a single broker for up to 25M messages. Note that this is recommended for development environments.Cloudera SMMStreams Messaging Manager is the solution for monitoring and managing clusters running Cloudera or Hortonworks kafka. It also comes with replication capability.ConfluentAnother option is Confluent Enterprise which is a Kafka distribution for production environments. It also includes Control Centre, which is a management system for Apache Kafka that enables cluster monitoring and management from a User Interface.Yahoo Kafka ManagerKafka Manager is a tool for monitoring Kafka offering less functionality compared to the aforementioned tools.KafDropKafDrop is a UI for monitoring Apache Kafka clusters. The tool displays information such as brokers, topics, partitions, and even lets you view messages. It is a lightweight application that runs on Spring Boot and requires very little configuration.LinkedIn BurrowBurrow is a monitoring companion for Apache Kafka that provides consumer lag checking as a service without the need for specifying thresholds. It monitors committed offsets for all consumers and calculates the status of those consumers on demand. An HTTP endpoint is provided to request status on demand, as well as provide other Kafka cluster information. There are also configurable notifiers that can send status out via email or HTTP calls to another service.Kafka ToolKafka Tool is a GUI application for managing and using Apache Kafka clusters. It provides an intuitive UI that allows one to quickly view objects within a Kafka cluster as well as the messages stored in the topics of the cluster. It contains features geared towards both developers and administrators.If you cannot afford licenses, then go for Yahoo Kafka Manager, LinkedIn Burrow or KafDrop. Confluent\u0026#39;s and Landoop\u0026#39;s products are the best out there, but unfortunately, they require licensing.For more details, you can refer to my blog post Overview of UI Monitoring tools for Apache Kafka Clusters.更多有关Kafka监控的组件可以参考这个链接：


推荐阅读


上一篇：学习哪些知识技能可以让我们的生活过得更好

下一篇：在学Java，今后想成为一个独立开发者，想问这样有发展性可言吗