apache-kafka-connect

Use Confluent Hub without Confluent Platform installation

Specify –component-dir and –worker-configs explicitly You’ll have to pass both options to include the Homebrew location of Kafka Connect’s plugin.path setting (where Confluent Hub would install to) and your connect-distributed.properties (so that the plugin path can be setup if it isn’t already) e.g. (on a Mac, after brew install kafka) confluent-hub install <name> \ –component-dir … Read more

What is a simple, effective way to debug custom Kafka connectors?

I will try to reply to your question in a broad way. A simple way to do Connector development could be as follows: Structure and build your connector source code by looking at one of the many Kafka Connectors available publicly (you’ll find an extensive list available here: https://www.confluent.io/product/connectors/ ) Download the latest Confluent Open … Read more