As of v0.9.0, Kafka ships with a suite of tools in the /bin one of which is the kafka-consumer-groups.sh tool. This will delete a consumer group. ./kafka-consumer-groups.sh –zookeeper <zookeeper_url> –delete –group <group-name>
That is the way of what one of my colleagues did to get a list of Kafka brokers. I think it’s a correct way when you want to get a broker list dynamically. Here is an example code that shows how to get the list. public class KafkaBrokerInfoFetcher { public static void main(String[] args) throws … Read more
OK, this is a very old question, which I’m first seeing now. You’ll need to differentiate between sequence numbers and unique IDs that are (optionally) loosely sortable by a specific criteria (typically generation time). True sequence numbers imply knowledge of what all other workers have done, and as such require shared state. There is no … Read more
I found the issue by increasing the log level to DEBUG. Basically follow the steps below. I don’t use SSL but you will integrate it without any issue. Following are my configuration files: server.properties security.inter.broker.protocol=SASL_PLAINTEXT sasl.mechanism.inter.broker.protocol=PLAIN sasl.enabled.mechanisms=PLAIN authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer allow.everyone.if.no.acl.found=true auto.create.topics.enable=false broker.id=0 listeners=SASL_PLAINTEXT://localhost:9092 advertised.listeners=SASL_PLAINTEXT://localhost:9092 num.network.threads=3 num.io.threads=8 socket.send.buffer.bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600 advertised.host.name=localhost num.partitions=1 num.recovery.threads.per.data.dir=1 log.flush.interval.messages=30000000 log.flush.interval.ms=1800000 log.retention.minutes=30 log.segment.bytes=1073741824 … Read more
Edit – Zookeeper is not required in newer version of Kafka. Please see answer by @Neeleshkumar Srinivasan Mannur for API version 0.11.0+ Original answer I fixed it.. After a long research.. ZkClient zkClient = new ZkClient(“localhost:2181”, 10000, 10000); AdminUtils.createTopic(zkClient, myTopic, 10, 1, new Properties()); From the above code, ZkClient will create a topic but this … Read more