Questions tagged [apache-zookeeper]
Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.
apache-zookeeper
312
questions
47
votes
6
answers
51k
views
How to create a Topic in Kafka through Java
I want to create a topic in Kafka (kafka_2.8.0-0.8.1.1) through java. It is working fine if I create a topic in command prompt, and If I push message through java api. But I want to create a topic ...
- 3,463
23
votes
2
answers
57k
views
Kafka SASL zookeeper authentication
I am facing the following error while enabling SASL on Zookeeper and broker authentication.
[2017-04-18 15:54:10,476] DEBUG Size of client SASL token: 0
(org.apache.zookeeper.server.ZooKeeperServer)
...
- 1,009
126
votes
14
answers
94k
views
Distributed sequence number generation?
I've generally implemented sequence number generation using database sequences in the past.
e.g. Using Postgres SERIAL type http://www.neilconway.org/docs/sequences/
I'm curious though as how to ...
- 63.2k
47
votes
4
answers
121k
views
removing a kafka consumer group in zookeeper
I'm using kafka_2.9.2-0.8.1.1 with zookeeper 3.4.6.
Is there a utility that can automatically remove a consumer group from zookeeper? Or can I just remove everything under /consumers/[group_id] in ...
- 11.1k
25
votes
16
answers
69k
views
Apache Zookeeper error on windows - Couldnot find or load main class QuorumPeerMain
I just downloaded Kafka 2.8.0 from Apache website, and I am trying to setup using the instructions given on the website. But when I try to start zookeper server, I am getting below error:
Error: ...
- 18k
415
votes
8
answers
129k
views
Explaining Apache ZooKeeper
I am trying to understand ZooKeeper, how it works and what it does. Is there any application which is comparable to ZooKeeper?
If you know, then how would you describe ZooKeeper to a layman?
I have ...
- 8,466
44
votes
6
answers
30k
views
Is it possible to start a zookeeper server instance in process, say for unit tests?
Calling org.apache.zookeeper.server.quorum.QuorumPeerMain.main() isn't working.
- 8,221
27
votes
5
answers
34k
views
Kafka: Get broker host from ZooKeeper
For particular reasons I need to use both - ConsumerGroup (a.k.a. high-level consumer) and SimpleConsumer (a.k.a. low-level consumer) to read from Kafka. For ConsumerGroup I use ZooKeeper-based config ...
- 28.2k
176
votes
13
answers
117k
views
Is Zookeeper a must for Kafka? [closed]
In Kafka, I would like to use only a single broker, single topic and a single partition having one producer and multiple consumers (each consumer getting its own copy of data from the broker). Given ...
- 2,189
59
votes
14
answers
79k
views
Zookeeper error: Cannot open channel to X at election address
I have installed zookeeper in 3 different aws servers. The following is the configuration in all the servers
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/var/zookeeper
clientPort=2181
server.1=x.x....
- 46.4k
19
votes
3
answers
24k
views
How to recover Zookeeper from java.io.EOFException after a server crash?
How to recover from the following error that started happening after a server crash?
Zookeeper won’t start and the following message is showing repeatedly on the log.
2017-05-27 01:02:08,072 [myid:]...
- 345
3
votes
1
answer
1k
views
exception after submitting topology
I'm new in storm and trying to submit a topology and found this
in supervisor
I found this in log file of workers
[ERROR] Async loop died!
java.lang.RuntimeException: org.apache.thrift7.transport....
user3188912
63
votes
7
answers
130k
views
Kafka + Zookeeper: Connection to node -1 could not be established. Broker may not be available
I am running in my locahost both Zookeeper and Kafka (1 instance each).
I create succesfully a topic from kafka:
./bin/kafka-topics.sh --zookeeper localhost:2181 --create --replication-factor 1 --...
- 11.1k
44
votes
3
answers
25k
views
Why do Kafka consumers connect to zookeeper, and producers get metadata from brokers?
Why is it that consumers connect to zookeeper to retrieve the partition locations? And kafka producers have to connect to one of the brokers to retrieve metadata.
My point is, what exactly is the use ...
- 487
41
votes
19
answers
83k
views
Kafka Broker doesn't find cluster id and creates new one after docker restart
I've created docker with kafka broker and zookeeper to start it with run script.
If I do fresh start it starts normally and runs ok (Windows -> WSL -> two tmux windows, one session). If I shut down ...
- 1,747