Is it possible to add partitions to an existing topic in Kafka 0.8.2

by

Looks like you can use this script instead:

bin/kafka-topics.sh --zookeeper zk_host:port/chroot --alter --topic my_topic_name 
   --partitions 40

In the code it looks like they do same thing:

 AdminUtils.createOrUpdateTopicPartitionAssignmentPathInZK(topic, partitionReplicaList, zkClient, true)

kafka-topics.sh executes this piece of code as well as AddPartitionsCommand used by kafka-add-partition script.

However you have to be aware of re-partitioning when using key:

Be aware that one use case for partitions is to semantically partition
data, and adding partitions doesn’t change the partitioning of existing data so this may disturb consumers if they rely on that
partition. That is if data is partitioned by hash(key) % number_of_partitions then this partitioning will potentially be
shuffled by adding partitions but Kafka will not attempt to
automatically redistribute data in any way.

More Related Contents:

  1. Connect to Kafka running in Docker
  2. How can I send large messages with Kafka (over 15MB)?
  3. How to create a Topic in Kafka through Java
  4. How Can we create a topic in Kafka from the IDE using API
  5. What determines Kafka consumer offset?
  6. Writing Custom Kafka Serializer
  7. Java, How to get number of messages in a topic in apache kafka
  8. How to Delete a topic in apache kafka [duplicate]
  9. When does the Apache Kafka client throw a “Batch Expired” exception?
  10. What is a simple, effective way to debug custom Kafka connectors?
  11. How to get kafka consume lag in java program
  12. Handling exceptions in Kafka streams
  13. Is it possible to access message headers with Kafka Streams?
  14. Dynamically connecting a Kafka input stream to multiple output streams
  15. How to create Custom serializer in kafka?
  16. Kafka Consumer CommitFailedException
  17. Can a Kafka consumer(0.8.2.2) read messages in batch
  18. How can I delete a topic in Apache Kafka? [duplicate]
  19. Solving a “communications link failure” with JDBC and MySQL [duplicate]
  20. Get driving directions using Google Maps API v2
  21. How to specify the default error page in web.xml?
  22. How to convert a Java 8 Stream to an Array?
  23. Getting Spring Application Context
  24. JavaBean wrapping with JavaFX Properties
  25. Creating BSON object from JSON string
  26. Java ArrayIndexOutOfBounds Exception
  27. Why does Java permit escaped unicode characters in the source code?
  28. Fatal error by Java runtime environment
  29. Using accelerometer, gyroscope and compass to calculate device’s movement in 3D world
  30. Mocking behaviour resets after each test with PowerMock

Leave a Comment