Questions tagged [apache-zookeeper]
Apache ZooKeeper is a distributed service that provides configuration information storage, naming, synchronization, coordination, and group services.
apache-zookeeper
3,715
questions
415
votes
8
answers
129k
views
Explaining Apache ZooKeeper
I am trying to understand ZooKeeper, how it works and what it does. Is there any application which is comparable to ZooKeeper?
If you know, then how would you describe ZooKeeper to a layman?
I have ...
- 8,466
183
votes
4
answers
58k
views
Data Modeling with Kafka? Topics and Partitions
One of the first things I think about when using a new service (such as a non-RDBMS data store or a message queue) is: "How should I structure my data?".
I've read and watched some introductory ...
- 32.4k
176
votes
13
answers
117k
views
Is Zookeeper a must for Kafka? [closed]
In Kafka, I would like to use only a single broker, single topic and a single partition having one producer and multiple consumers (each consumer getting its own copy of data from the broker). Given ...
- 2,189
126
votes
14
answers
94k
views
Distributed sequence number generation?
I've generally implemented sequence number generation using database sequences in the past.
e.g. Using Postgres SERIAL type http://www.neilconway.org/docs/sequences/
I'm curious though as how to ...
- 63.2k
122
votes
13
answers
63k
views
Real World Use of Zookeeper [closed]
I've been looking at Zookeeper recently and wondered whether anybody was using it currently and what they were specifically using it for storing.
The most common use case is for configuration ...
115
votes
17
answers
326k
views
Is there a way to delete all the data from a topic or delete the topic before every run?
Is there a way to delete all the data from a topic or delete the topic before every run?
Can I modify the KafkaConfig.scala file to change the logRetentionHours property? Is there a way the messages ...
- 1,777
106
votes
18
answers
342k
views
List all Kafka 0.10 topics using - -zookeeper flag without access to Zookeeper
I'm using kafka 0.10 without zookeeper. I want to get kafka topics list. This command is not working since we're not using zookeeper:
bin/kafka-topics.sh --list --zookeeper localhost:2181. How can I ...
- 1,259
95
votes
13
answers
251k
views
How to check if ZooKeeper is running or up from command prompt?
I exploring a few options to how Zookeeper is up and running
I would like to know how can I find the below.
hostname and port for my zookeeper instance---I checked the zoo.cfg and I could only find ...
- 1,228
88
votes
6
answers
83k
views
zookeeper is not a recognized option when executing kafka-console-consumer.sh
I'm learning how to use Kafka on this website link(except I'm using port 2182 in zookeeper), but it shows:
zookeeper is not a recognized option
after executing:
sudo ./bin/kafka-console-consumer.sh ...
- 28k
80
votes
11
answers
62k
views
ZooKeeper alternatives? (cluster coordination service) [closed]
ZooKeeper is a highly available coordination service for data centers. It originated in the Hadoop project. One can implement locking, fail over, leader election, group membership and other ...
- 2,899
78
votes
21
answers
140k
views
classpath is empty. please build the project first
I was trying to run Kafka on Windows machine and when I try to start the zookeeper I am facing this weird error:
classpath is empty. please build the project first e.g. by running 'gradlew jarall'
- 3,699
67
votes
12
answers
62k
views
Running into LeaderNotAvailableException when using Kafka 0.8.1 with Zookeeper 3.4.6
I installed the stable version of kafka (0.8.1 with 2.9.2 Scala) as per their website and am running it with a 3 node zookeeper ensemble (3.4.6). I tried to create a test topic but keep seeing that ...
- 671
66
votes
6
answers
34k
views
supervisord stopping child processes
One of the problems, I face with supervisord is that when I have a command which in turn spawns another process, supervisord is not able to kill it.
For example I have a java process which when runs ...
- 5,154
63
votes
7
answers
130k
views
Kafka + Zookeeper: Connection to node -1 could not be established. Broker may not be available
I am running in my locahost both Zookeeper and Kafka (1 instance each).
I create succesfully a topic from kafka:
./bin/kafka-topics.sh --zookeeper localhost:2181 --create --replication-factor 1 --...
- 11.1k
60
votes
3
answers
58k
views
Zookeeper & Kafka error KeeperErrorCode=NodeExists
I have written a kafka consumer and producer that worked fine until today.
This morning, when I started zookeeper and kafka, my consumer was not able to read messages, and I found this in the ...
- 669