All Questions
Tagged with apache-zookeeper high-availability
38
questions
0
votes
1
answer
37
views
Apache Flink HA - Selected leader wrong URL
having Flink cluster 1.19.0 with HA, asking zk "leader/resource_manager/connection_info" it shows the IP of the leader: neither localhost nor 127.0.0.1. It's the network accesible IP value.
...
- 85
1
vote
0
answers
570
views
Apache Flink and the Zookeeper high availability doesn't work as expected
I have deployed an standalone flink( 1.15.0) cluster with 3 masters and i am using Zookeeper(3.5.0) to provide high availability. Here i share my flink.yml configuration:
high-availability: zookeeper
...
1
vote
0
answers
155
views
Why could split-brain situation happen in Resourcemanager HA using ZooKeeper
I was wondering why we need the extra ACL fencer to avoid split-brain situation in Resourcemanager HA using ZooKeeper. Because I thought when active RM thinks that it is still active with temporarily ...
- 274
0
votes
0
answers
48
views
How to build a scene where zookeeper jitter cause to multiple rapid elections
I have two program, fc(failoverController) and web(webServer). And I use zookeeper to ensure high reliability.
fc will deploy on two server, two fc use apache-curator LeaderSelector to elect master, ...
- 311
0
votes
1
answer
71
views
Does a Mesos slave needs to be contacted by a Mesos master?
Can Apache Mesos 'slave' nodes be located on a separate network than the Mesos 'master' nodes? Similarly (for high-availability (HA) deploys), can the Apache Zookeeper nodes used in Mesos 'master' ...
- 14k
1
vote
1
answer
2k
views
How to properly configure HDFS high availability using Zookeeper?
I'm a student of big data. I'm coming to you today for a question about the high availability of HDFS using Zookeeper. I am aware that there has already been bcp of topic dealing with this subject, I ...
- 41
1
vote
1
answer
1k
views
kafka and zookepeer high availability configuration
I want to set up a high availability kafka-zookeper in my ecosystem. I have 2 data centers and 3 physical servers in each data center.
Dc1
Server 1 - 1st Kafka Broker
Server 2 - 2nd Kafka Broker
...
- 249
13
votes
1
answer
5k
views
Leader election with: Etcd vs Zookeeper vs Hazelcast
We are choosing the best option for implementing a leader election for our service (written in Java) comprised of multiple (e.g., 3) instances for high availability. Our goal is to have only a single ...
- 367
1
vote
0
answers
419
views
Zookeeper Standalone to Quorum without downtime
I have a zookeeper which is running standalone for some reason and now we want it to run it as a quorum as it should be. Is there any way to make this upgrade without any downtime and without any data ...
- 2,010
2
votes
2
answers
1k
views
What is the consistency of Postgresql HA cluster with Patroni?
What is the consistency of Postgresql HA cluster with Patroni?
My understanding is that because the fail-over is using a consensus (etc or zookeeper) the system will stay consistent under network ...
- 2,916
1
vote
1
answer
150
views
Active master not accepting new applications if one of the masters added to zookeeper is down
I am facing a very weird issue while enabling high availability(HA) in spark stand alone cluster.
I have configured 3 spark masters and registered them in zookeeper by following below steps:
Create ...
- 739
2
votes
0
answers
429
views
ZooKeeper Failover controller crashes when the Hadoop NameNode goes down
We are setting up a Hadoop Cluster in our development environment. While we were testing the fail over of the NameNode we noticed that the Zookeeper Failover controller would sometimes crash. In one ...
- 21
3
votes
0
answers
417
views
How to manage failover in ZooKeeper across datacenters using observers
I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
- 2,450
7
votes
1
answer
4k
views
How to deploy zookeeper across multiple data centers and failover?
I would like to know about the existing approaches that are available when running Zookeeper across data centers?
One approach that I found after doing some research is to have observers. That ...
- 4,448
1
vote
0
answers
459
views
spark application in standalone mode with multiple master
I created 1 application on spark. This application works as a http server and is combined with a cassandra db.
In my case the application is running all the time on one master by the spark-submit ...
- 175