All Questions
Tagged with apache-zookeeper apache-kafka
1,148
questions
0
votes
0
answers
11
views
Unexpected Kafka request of type METADATA during SASL handshake while trying to connect with kafka server by a consumer
I'm trying to setup SASL plain authentication in kafka. But when I try to read a message or send a message, the Kafka Server logs the following error:
INFO [SocketServer listenerType=ZK_BROKER, nodeId=...
- 3
-1
votes
0
answers
27
views
Kafka Streams with SASL Authenitattion
I am trying to secure my Kafka streams application (Java Springboot) with SASL_PLAINTEXT mechanism.
This is my docker-compose file
version: '3'
services:
zookeeper:
container_name: zookeeper
...
- 262
0
votes
0
answers
29
views
Custom Dockerfile and docker-compose.yml file for Kafka and Zookeeper containers doesn't produce and consume messages
I'm trying to create a custom Dockerfile and docker-compose.yml files for Kafka and Zookeeper services, in order to understand how to configure it, and how those services are communicated between each ...
0
votes
0
answers
21
views
kafka broker restart failed without me knowing why
I'm facing an issue with my 3-node Kafka cluster, and perhaps you can help me troubleshoot.
Several times a day, I notice that my Kafka service restarts on my servers, and I'm struggling to understand ...
0
votes
0
answers
35
views
Clone a Kafka / ZooKeeper cluster for testing
I have started at a new company, and they only have two environments, one is a test environment and the other is a Prod environment. In the test environment, lots of development teams are using this ...
0
votes
0
answers
50
views
Authenticate Kafka with SASL using JAAS error
I'm trying to setup Kafka and Zookeeper with SASL authentication. My goal is to be able to enable authentication for Kafka so I can manage it with Kafka UI. However, I have been struggling and cannot ...
1
vote
0
answers
53
views
Kafka with Zookeeper connections issue on EKS
I am quite new to Kafka.
I want to deploy Kafka with Zookeeper on EKS cluster. [without Kraft]
I am using bitnami helm charts for the same.
Here are followed steps:
Step1:
I have deployed zookeeper ...
- 76
0
votes
0
answers
16
views
Kafka Infrastructure Set Up
I am new to Kafka, I have got a requirement to receive around 9000 messages per second, size of each message is around 20 KB.
Can someone suggest, what are the ideal number of VMs required for: ...
- 127
0
votes
1
answer
41
views
Kafka consumerdoesn't receive messages in docker
I am creating a very basic consumer/producer setup for Kafka. I am using both Zookeper and Kafka with a Docker compose. Both seem to be connecting but when it comes to produce or consume, nothing ...
- 314
0
votes
0
answers
35
views
INFO [Controller id=0, targetBrokerId=0] Disconnecting from node 0 due to socket connection setup timeout
I am running my Kafka and Zookeeper on EC2, this is my ZK properties:
# the directory where the snapshot is stored.
dataDir=/tmp/zookeeper
# the port at which the clients will connect
clientPort=2181
...
- 11
0
votes
0
answers
27
views
Does Cmak still connects to zookeeper and not brokers? Can someone help me with the steps/configuration for cmak to connect to SSL zookeeper?
I am having cmak in our environment. Can someone help me with the steps or configuration to connect cmak to SSL zookeeper
Tried creating a client SSL for zookeeper and add the zk client configuration. ...
0
votes
0
answers
37
views
Docker Kafka and Zookeeper Issue
I am new to docker and when i am trying to run kafka and zookeeper,
i see these issues,
in zookeeper:
2024-04-29 15:50:44,031 [myid:1] - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/...
0
votes
0
answers
39
views
After updating to Confluent 7.5 brokers can no longer connect to Zookeeper
The goal is to update the Kafka cluster to version 7.6 in order to migrate to Karft.
A few key facts about the cluster:
No Docker / Podman
3 ZooKeeper (single VMs in vSphere)
3 brokers (individual ...
- 71
0
votes
0
answers
39
views
I have an error when I tried to deploying kafka cluster using strimzi
enter image description here
here is .yaml file
apiVersion: kafka.strimzi.io/v1beta2
kind: Kafka
metadata:
name: kafka-cluster
namespace: kafka
spec:
kafka:
version: 3.7.0
replicas: 2
...
0
votes
0
answers
15
views
Changing kafka zookeeper.connect by adding chroot
Before we haven't set up a chroot for zookeeper, all kafka config are in root folder. So we want to add chroot for the original zookeeper.connect config, then restart the cluster.
I'm wondering what ...
- 87