All Questions
Tagged with apache-zookeeper linux
46
questions
0
votes
1
answer
528
views
Apache Kafka + how to defected Kafka clusters with Kraft mode or Kafka with zookeeper mode
We have dozens different Kafka clusters labs
Some of them are with Kraft mode and most of them are ordinary Kafka cluster with zookeeper
Since we run smoke tests scripts based on python/perl/bash on ...
- 1,817
0
votes
0
answers
75
views
YARN + yarn resource manager stores a ton of znodes related to running/old applications in zookeeper
We have HDP production Hadoop cluster , include 2 active / standby resource managers services
Some details from our cluster
HDP version - 2.6.5
OS Linux machines version - 7.9
Number of node ...
- 2,550
0
votes
1
answer
718
views
zoo + snapshot files are created very frequently
under folder - /var/hadoop/zookeeper/version-2/
we can see that Zookeeper transaction logs and snapshot files are created very frequently (multiple files in every minute) and that fills up the ...
- 1,817
4
votes
2
answers
5k
views
HBase Shell - org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet
I am trying to set up distributed HBase on 3 nodes. I have already set up hadoop, YARN ZooKeeper and now HBase but when I launch hbase shell and run the simplest command for example status or list I ...
- 191
0
votes
1
answer
387
views
Variable is not used in my zookeeper systemd service
I wanted to use Prometheus JMX exporter for Apache Zookeeper which was installed from Kafka package installation. I did according https://alex.dzyoba.com/blog/jmx-exporter/ so I use variable ...
- 23
0
votes
1
answer
318
views
Organize co-working for Kafka and Zookeeper using systemd
I've installed Kafka on a VM and want to launch it on VM startup and turn it off on shutdown.
It would be a quite simple task, but Kafka relies on working Zookeeper service.
Dependency on startup can ...
- 45
0
votes
1
answer
636
views
Open a port of a docker zookeeper container
I'm installing zookeeper on my container.
What I've done is:
root@46966b33c3a1:/opt:> wget https://downloads.apache.org/zookeeper/zookeeper-3.6.2/apache-zookeeper-3.6.2-bin.tar.gz
root@46966b33c3a1:...
- 1,285
1
vote
2
answers
530
views
Unable to start multiple Zookeeper services on Kafka dev box
I'm trying to start 3 zookeeper services on the same host on my development computer.
This is obviously not something I'll do in production, I'm doing this to explore fault tolerance and Kafka ...
- 675
0
votes
2
answers
303
views
kafka configuration + zookeeper cli + get the right info for kafka host
As all know when is need to print the kafka broker id’s we can use the following cli
zookeeper-shell.sh zoo_server1:2181 <<< "ls /brokers/ids"
this cli print the following
WATCHER::
...
- 2,550
1
vote
1
answer
1k
views
Why won't Kafka connect to Zookeeper?
I'm using a rasbery pi with Rasbian. I want to use Kafka to stream data from a camera to my phone. I downloaded this package from the Kafka website that contains Zookeeper and Kafka:
https://www....
- 11
3
votes
1
answer
3k
views
Kafka using Docker for production clusters
We need to build a Kafka production cluster with 3-5 nodes in cluster ,
We have the following options:
Kafka in Docker containers (Kafka cluster include zookeeper and schema registry on each node)
...
- 2,550
1
vote
0
answers
1k
views
why we get - likely client has closed socket - from zookeeper logs
we have 3 zookeeper servers ( redhat 7.4 ) that serve many applications
from each of the zookeeper servers logs , we can see many messages as the following:
2019-09-12 17:56:00,393 [myid:0] - WARN [...
- 2,550
0
votes
1
answer
297
views
How do I troubleshoot the installation of Apache Accumulo on Linux?
I am trying to install open source Accumulo on RHEL 7.x. I have two GB of swap space. I have installed Java 1.8, Hadoop 3, and Zookeeper. I have run the bootstrap_config.sh script for Accumulo 1.9.2.
...
- 13
0
votes
1
answer
5k
views
Error "This server is not the leader for that topic-partition" while running Kafka performance traffic
Update Aug 15, 2018
I executed strace to monitor system call mprotect, and found it was blocked for several seconds indeed.
strace -f -e trace=mprotect,mmap,munmap -T -t -p `pidof java` 2>&...
- 1
10
votes
1
answer
37k
views
Kafka - Broker: Group coordinator not available
I have the following structure:
zookeeper: 3.4.12
kafka: kafka_2.11-1.1.0
server1: zookeeper + kafka
server2: zookeeper + kafka
server3: zookeeper + kafka
Created topic with replication factor 3 and ...
- 147