Comments on: How To Set Up Kafka Without Zookeeper using Docker Compose? https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/ Kotlin & Backend Tutorials - Learn Through Practice. Wed, 16 Apr 2025 04:50:05 +0000 hourly 1 By: Aurel https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-65 Thu, 11 May 2023 18:40:01 +0000 https://codersee.com/?p=5503746#comment-65 Hi, I’m using this tutorial in conjunction with https://blog.codersee.com/apache-kafka-with-spring-boot-and-kotlin/
So I am following the SpringBoot Kotlin tutorial and I’m failing to connect to the broker, as the application fails to start with the following:
2023-05-11T19:36:04.909+01:00 WARN 47848 — [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient : [Consumer clientId=consumer-0-1, groupId=0] Connection to node -1 (localhost/127.0.0.1:9001) could not be established. Broker may not be available.
2023-05-11T19:36:04.909+01:00 WARN 47848 — [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient : [Consumer clientId=consumer-0-1, groupId=0] Bootstrap broker localhost:9001 (id: -1 rack: null) disconnected
2023-05-11T19:36:05.837+01:00 INFO 47848 — [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient : [Consumer clientId=consumer-0-1, groupId=0] Node -1 disconnected.

]]> By: Piotr https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-64 Fri, 20 Jan 2023 16:17:21 +0000 https://codersee.com/?p=5503746#comment-64 In reply to Saurav Dagar.

It should be fine 🙂

]]> By: Saurav Dagar https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-63 Thu, 19 Jan 2023 08:47:56 +0000 https://codersee.com/?p=5503746#comment-63 Hi,

Thanks Piotr for the solution. I tired the running docker-compose after pruning all the containers. But still getting the same issue.

One change I have made in ur run_workaround.sh:
echo “kafka-storage format –ignore-formatted -t NqnEdODVKkiLTfJvqd1uqQ== -c /etc/kafka/kafka.properties” >> /etc/confluent/docker/ensure

CHANGED TO

echo “kafka-storage format –ignore-formatted -t $(kafka-storage random-uuid) -c /etc/kafka/kafka.properties” >> /etc/confluent/docker/ensure

I am not sure whether it is fine or not?

Please help.

]]> By: Piotr https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-62 Thu, 19 Jan 2023 07:02:33 +0000 https://codersee.com/?p=5503746#comment-62 In reply to Saurav.

Hi!

If this is environment you don’t care about, I would personally go with docker compose down and prune all the containers, networking and volumes.

Otherwise,
– docker-compose down
– backup kafka-logs directory using cp kafka-logs -r kafka-logs-bak
– delete the kafka-logs/meta.properties file
– docker-compose up -d

If meta.properties delete does not help, then please check out if this is not related to old containers or something like that

]]> By: Saurav https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-61 Thu, 19 Jan 2023 06:54:32 +0000 https://codersee.com/?p=5503746#comment-61 Getting this error while running the docker-compose.yaml.

kafka3 | [2023-01-19 06:52:27,859] ERROR [RaftManager nodeId=3] Unexpected error INCONSISTENT_CLUSTER_ID in VOTE response: InboundResponse(correlationId=2849, data=VoteResponseData(errorCode=104, topics=[]), sourceId=2) (org.apache.kafka.raft.KafkaRaftClient)
kafka1 | [2023-01-19 06:52:27,859] ERROR [RaftManager nodeId=3] Unexpected error INCONSISTENT_CLUSTER_ID in VOTE response: InboundResponse(correlationId=2849, data=VoteResponseData(errorCode=104, topics=[]), sourceId=2) (org.apache.kafka.raft.KafkaRaftClient)
kafka2 | [2023-01-19 06:52:27,859] ERROR [RaftManager nodeId=3] Unexpected error INCONSISTENT_CLUSTER_ID in VOTE response: InboundResponse(correlationId=2849, data=VoteResponseData(errorCode=104, topics=[]), sourceId=2) (org.apache.kafka.raft.KafkaRaftClient)

Please help in resolving it.
Thanks!

]]> By: Piotr https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-60 Wed, 05 Oct 2022 05:50:58 +0000 https://codersee.com/?p=5503746#comment-60 In reply to gomipapa.

Thank you for your kind feedback!
I’m really happy that you find this useful 😀

]]> By: gomipapa https://blog.codersee.com/how-to-set-up-kafka-without-zookeeper-using-docker-compose/#comment-59 Wed, 05 Oct 2022 05:49:08 +0000 https://codersee.com/?p=5503746#comment-59 This is a really good article.
It was very helpful, and thanks for the great article.

]]>