Kafka: Get broker host from ZooKeeper

by

That is the way of what one of my colleagues did to get a list of Kafka brokers. I think it’s a correct way when you want to get a broker list dynamically.

Here is an example code that shows how to get the list.

public class KafkaBrokerInfoFetcher {

    public static void main(String[] args) throws Exception {
        ZooKeeper zk = new ZooKeeper("localhost:2181", 10000, null);
        List<String> ids = zk.getChildren("/brokers/ids", false);
        for (String id : ids) {
            String brokerInfo = new String(zk.getData("/brokers/ids/" + id, false, null));
            System.out.println(id + ": " + brokerInfo);
        }
    }
}

Running the code onto the cluster consisting of three brokers results in

1: {"jmx_port":-1,"timestamp":"1428512949385","host":"192.168.0.11","version":1,"port":9093}
2: {"jmx_port":-1,"timestamp":"1428512955512","host":"192.168.0.11","version":1,"port":9094}
3: {"jmx_port":-1,"timestamp":"1428512961043","host":"192.168.0.11","version":1,"port":9095}

More Related Contents:

  1. removing a kafka consumer group in zookeeper
  2. How to create a Topic in Kafka through Java
  3. Kafka SASL zookeeper authentication
  4. How can I send large messages with Kafka (over 15MB)?
  5. Streamparse wordcount example
  6. Using Kafka as a (CQRS) Eventstore. Good idea?
  7. How Can we create a topic in Kafka from the IDE using API
  8. Difference between session.timeout.ms and max.poll.interval.ms for Kafka >= 0.10.1
  9. What determines Kafka consumer offset?
  10. How to read records in JSON format from Kafka using Structured Streaming?
  11. Is there a way to purge the topic in Kafka?
  12. How to write spark streaming DF to Kafka topic
  13. Writing Custom Kafka Serializer
  14. Kafka server configuration – listeners vs. advertised.listeners
  15. Distributed sequence number generation?
  16. Increase the number of messages read by a Kafka consumer in a single poll
  17. When does the Apache Kafka client throw a “Batch Expired” exception?
  18. What is a simple, effective way to debug custom Kafka connectors?
  19. Kafka how to read from __consumer_offsets topic
  20. How to change the number of replicas of a Kafka topic?
  21. In Apache Kafka why can’t there be more consumer instances than partitions?
  22. Delete topic in Kafka 0.8.1.1
  23. Why I cannot connect to Kafka from outside?
  24. Dynamically connecting a Kafka input stream to multiple output streams
  25. How to integrate Oracle and Kafka
  26. Kafka Consumer CommitFailedException
  27. Can a Kafka consumer(0.8.2.2) read messages in batch
  28. How can I delete a topic in Apache Kafka? [duplicate]
  29. How to change start offset for topic?
  30. Kafka 0.11 how to reset offsets

Leave a Comment