All Questions
Tagged with apache-zookeeper kafka-producer-api
39
questions
0
votes
1
answer
239
views
Remote(WAN) kafka client cannot write data to kafka which is in LAN
I'm trying to configure advertised.listener to receive data from remote host.
Producer running on remote host and sends data to kafka. Kafka running in our LAN. Also there is a port mapping: ...
- 5
3
votes
1
answer
4k
views
KafkaException: No key found on line 1 at kafka.tools.ConsoleProducer$LineMessageReader.readMessage
In few words, I started Kafka, created succesfully a topic, started a producer with key enabled. So far so good. I send a simple message and I get
root@kafka:/# kafka-console-producer --broker-list ...
- 4,255
3
votes
2
answers
14k
views
Kafka CLI: command to list all consumer groups for a topic?
kafka-consumer-groups --bootstrap-server localhost:9092 --describe --group webapi-group
The above command gives me :
Error: Consumer group 'web-api' does not exist.
And rightly so because web-api ...
- 5,379
1
vote
0
answers
854
views
What is KAFKA_LISTENER option?
I'm studying kafka.
To test producing messages, I wrote this docker-compose file.
version: "2"
services:
zookeeper:
image: zookeeper
ports:
- 2181:2181
kafka1:
image: ...
- 1,206
1
vote
0
answers
280
views
Kafka-Node not detecting kafka broker
I'm currently using Kafka-node in my application but I cant manage to connect it to the Kafka broker I have brought up before hand.
Firstly, I bring up the kafka broker with the wurstmeister/kafka ...
- 990
0
votes
2
answers
1k
views
How to set Zookeeper IP address in ConsumerGroup instead of Kafka-Host IP address?
I have to set zookeeper IP address in ConsumerGroup instead of Kafka-Host IP address. Because I have set replication factor as 3 and 3 brokers were created. So, if one host fails then the another one ...
- 41
5
votes
2
answers
6k
views
Consumer and producer failing with error: "Connection to 0 was disconnected before the response was read"
I have a cluster of 3 Kafka brokers with replication factor of 3 for all topics. Since last few days I am facing this issue, suddenly(few times in a day) consumers and producers are stuck while ...
- 137
2
votes
1
answer
1k
views
kafka does not have messages that producer sent
I use spring framework and kafka that has 3 brokers clustered. I found out that consumer did not consume some messages (let say 0.01 percent between all sent messages) so in producer code I log ...
- 2,088
4
votes
2
answers
10k
views
Delete __Consumer_offset Topic form Kafka
I'm trying to delete Kafka topic __Consumer_offset as it is causing a lot of confusion for my brokers.
When i do so, it says this topic can't be marked for deletion.
i'm using the zookeeper cli to ...
- 61
0
votes
1
answer
881
views
Kafka producer fails to produce message via Bootstrap server. how to set broker host?
Getting timeout Exception with Kafka Producer API.
Manual process of Producing Kafka Message
We SSH to kafka Server: x.x.x.x
Over there we enter below command for producer
/kafka/bin/kafka-console-...
1
vote
3
answers
183
views
Unable to send message from Producer to Consumer
kafka-console-consumer.bat --bootstrap-server localhost:2181 --topic baeldung
kafka-console-producer.bat --broker-list localhost:9092 --topic baeldung
Message is not going from producer to consumer.
1
vote
2
answers
4k
views
Delete all messages from Kafka topic
I have seen similar questions related to this, But didn't find the correct answer. I just want to delete messages from Kafka topic instead of changing the retention timeout.
I have installed kafka_2....
- 632
2
votes
1
answer
3k
views
Kafka producer and consumer on separate computers aren't communicating
I'm using kafka_2.11-1.1.0. This is my server.properties file:
broker.id=1
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max....
- 41
21
votes
1
answer
54k
views
How to send message to a particular partition in Kafka?
I have created a topic that has many partitions. Using the console producer I want to send messages to particular partitions and view the through the console consumer.
On the console producer I have ...
- 632
1
vote
0
answers
1k
views
Group consumer cannot consume messages if kafka service on specific node in test cluster is down
I have three servers:
blade1 (192.168.112.31),
blade2 (192.168.112.32) and
blade3 (192.168.112.33).
On each of servers kafka_2.11-1.0.0 is installed.
On blade 3 (192.168.112.33:2181) zookeeper is ...
- 1,303