Use Confluent Hub without Confluent Platform installation

by

Specify –component-dir and –worker-configs explicitly

You’ll have to pass both options to include the Homebrew location of Kafka Connect’s plugin.path setting (where Confluent Hub would install to) and your connect-distributed.properties (so that the plugin path can be setup if it isn’t already)

e.g. (on a Mac, after brew install kafka)

confluent-hub install <name> \
   --component-dir /usr/local/Cellar/kafka/plugins \
   --worker-configs /usr/local/etc/kafka/connect-distributed.properties

This command should download and extract the connector zip into /usr/local/Cellar/kafka/plugins and modify the connect-distributed.properties file to include that path in its plugin.path property

Here is an example using a Kafka Connect docker image that I’ve built

More Related Contents:

  1. Connect to Kafka running in Docker
  2. How to send final kafka-streams aggregation result of a time windowed KTable?
  3. Streamparse wordcount example
  4. Difference between session.timeout.ms and max.poll.interval.ms for Kafka >= 0.10.1
  5. Is there a way to purge the topic in Kafka?
  6. How does an offset expire for an Apache Kafka consumer group?
  7. How to commit manually with Kafka Stream?
  8. Increase the number of messages read by a Kafka consumer in a single poll
  9. What is a simple, effective way to debug custom Kafka connectors?
  10. Kafka how to read from __consumer_offsets topic
  11. How to change the number of replicas of a Kafka topic?
  12. Delete message after consuming it in KAFKA
  13. Understanding Kafka Topics and Partitions
  14. When to use RabbitMQ over Kafka? [closed]
  15. Delete topic in Kafka 0.8.1.1
  16. Kafka Stream Suppress session-windowed-aggregation
  17. How to change start offset for topic?
  18. Kafka 0.11 how to reset offsets
  19. How can I send large messages with Kafka (over 15MB)?
  20. Using Kafka as a (CQRS) Eventstore. Good idea?
  21. How Can we create a topic in Kafka from the IDE using API
  22. What determines Kafka consumer offset?
  23. How to write spark streaming DF to Kafka topic
  24. Writing Custom Kafka Serializer
  25. Kafka server configuration – listeners vs. advertised.listeners
  26. When does the Apache Kafka client throw a “Batch Expired” exception?
  27. Why I cannot connect to Kafka from outside?
  28. Dynamically connecting a Kafka input stream to multiple output streams
  29. How to integrate Oracle and Kafka
  30. How can I delete a topic in Apache Kafka? [duplicate]

Leave a Comment