All Questions
Tagged with apache-zookeeper distributed-computing
74
questions
0
votes
0
answers
19
views
Does zookeeper preserver order when moving sessions?
In the zookeeper book it says:
When a client creates a ZooKeeper handle using a specific language
binding, it establishes a session with the service. The client
initially connects to any server in ...
- 89
0
votes
1
answer
96
views
Is it a good idea to have masters and workers running on the same node in a small Spark cluster for HA?
I need to set up an Apache Spark cluster in Standalone mode for a production environment. For this task, I only have three available nodes. Each node has:
128GB RAM
24 CPU cores
There is no example ...
0
votes
0
answers
354
views
How to use ZooKeeper to distribute work across a cluster of servers
I'm studying up for system design interviews and have run into this pattern in several different problems. Imagine I have a large volume of work that needs to be repeatedly processed at some cadence. ...
- 580
1
vote
1
answer
327
views
Confused about the consistency guarantee of zookeeper (Sequential vs Eventual Consistency)
As I understand, Zookeeper enforces "sequential consistency" which states any execution is the same as if all read/write ops were executed in some global ordering. Basically, a client may ...
- 105
0
votes
1
answer
502
views
Apache Zookeeper server not starting on Windows
I installed a stable version of Apache Zookeeper-3.4.12, made the changes in the conf folder by changing the name of the configuration file to 'zoo.cfg'. Updated the path of the Datadir from Temp to ...
- 11
2
votes
2
answers
524
views
Consensus Service vs Lock Service?
Going through the Google's Chubby Paper,
Like a lock service, a consensus service would
allow clients to make progress safely even with only one
active client process; a similar technique has been ...
- 408
0
votes
1
answer
563
views
How does zookeeper know zookeeper client host/port
I am trying to understand basics of Apache zookeeper. Zookeeper server(standalone/quorum) runs on a host(s)/port(s) and like below the zookeeper client would mention the details.
The constructor that ...
- 336
0
votes
1
answer
399
views
How to start zookeeper ensemble using Curator TestingServer
I am just trying to start a zookeeper ensemble (Leader - follower) with java implementation using the Curator frame work or zookeeper.
Initially i have checked with binary mode and it was working fine ...
- 1,621
2
votes
1
answer
2k
views
Zookeeper for Consistent hashing?
Can we use zookeeper for implementing consistent hashing? I want to maintain my hashring of servers with zookeeper so that their health can be monitored and the logic of mapping a given key to ...
- 125
1
vote
0
answers
169
views
How to keep znode and its backup's data consistency with zookeeper
When I use zookeeper to build java application, a worker znode records key/value from client in memory . A worker has a backup znode. after the worker node fails, the backup node replace him. How to ...
- 13
4
votes
1
answer
582
views
How does Zookeeper manage node roles in other clusters?
My understanding is that Zookeeper is often used to solve the problem of "keeping track of which node plays a particular role" in a distributed system (e.g. master node in a DB or in a ...
- 12.5k
1
vote
0
answers
36
views
How to assure that some processing is made in single instances
Let's assume that I want to call some processing on set of students.
Let's say we've got students S = [ s1, s2, ..., s10 ]and three service instances I = [ i1, i2, i3 ].
I want to make sure that ...
1
vote
3
answers
2k
views
Zookeeper's 3888 listen on localhost if using hostname instead of IP
If in zookepeer's config I set the servers as:
clientPort=2181
server.1=kafka-test-01:2888:3888
server.2=kafka-test-02:2888:3888
server.3=kafka-test-03:2888:3888
where kafka-test-0X is an instance, ...
user4093955
2
votes
1
answer
461
views
Quorum vs majority in Zookeper
I've been reading a lot about Zookeeper and one thing that I didn't understand yet is the naming convention. I couldn't find anything about it in the documentation and all stackoverflow questions and ...
- 1,516
0
votes
1
answer
420
views
How do other messaging systems deal with the problems that Zookeeper in Kafka solves?
Zookeeper is a coordination service that handles the problem such as -
If one node in a cluster goes down, zookeeper will look for another node
Handle serialized access to a shared resource
Race ...
- 341