All Questions
Tagged with apache-zookeeper hadoop
340
questions
0
votes
0
answers
75
views
YARN + yarn resource manager stores a ton of znodes related to running/old applications in zookeeper
We have HDP production Hadoop cluster , include 2 active / standby resource managers services
Some details from our cluster
HDP version - 2.6.5
OS Linux machines version - 7.9
Number of node ...
- 2,550
0
votes
0
answers
171
views
zookeeper connection timeout by error: Could not open client transport for any of the Server URI's in ZooKeeper
I want to connect to zookeeper on default port (2181) and discover hive metastor by jdbc-url:
jdbc:hive2://host:port/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
but i got error:
...
- 17
0
votes
2
answers
193
views
hdfs reformat name node failed by error Unable to check if JNs are ready for formatting
I want to start fresh hdfs cluster, I start zookeeper and yarn with command :
./zkServer.sh start && start-yarn.sh
after above command I started journalnode on each 5 node with command:
hdfs --...
- 1
0
votes
0
answers
35
views
Accumulo not sourcing accumulo-site.xml during initialization
I'm facing an issue with Apache Accumulo where it seems to be not sourcing the accumulo-site.xml file during initialization. I have made sure that the accumulo-site.xml file exists in the correct ...
0
votes
1
answer
166
views
Role of Zookeeper in Hadoop
I understand based on the slides that in the context of Hadoop that Zookeeper is used for storing information of Master, and status of different tasks, which worker is working on which partition AND ...
- 1,738
0
votes
1
answer
960
views
java.lang.IllegalArgumentException: Does not contain a valid host:port authority: http at org.apache.hadoop.net.NetUtils.createSocketAddr
Note that i have deployed statefulsets of 2 namenodes, 2 datanodes and 3 journalnodes for Apache Hadoop 3.3.3 HA on kubernetes.
but namenode is throwing the following error.
$ hdfs --config /opt/...
- 2,377
1
vote
0
answers
155
views
Why could split-brain situation happen in Resourcemanager HA using ZooKeeper
I was wondering why we need the extra ACL fencer to avoid split-brain situation in Resourcemanager HA using ZooKeeper. Because I thought when active RM thinks that it is still active with temporarily ...
- 274
1
vote
0
answers
402
views
hadoop3.3.1 start-yarn.sh failed
When I try to use Hadoop3.3.1, HDFS has been successfully run. When performing YARN services, I encountered the following issues, and the configuration file information is an error message as follows:
...
- 13
4
votes
2
answers
5k
views
HBase Shell - org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet
I am trying to set up distributed HBase on 3 nodes. I have already set up hadoop, YARN ZooKeeper and now HBase but when I launch hbase shell and run the simplest command for example status or list I ...
- 191
0
votes
1
answer
206
views
Why does a datanode doesn´t disappear in the hadoop web site when the datanode job is killed?
I have a 3 node HA cluster in a CentOS 8 VM. I am using ZK 3.7.0 and Hadoop 3.3.1.
In my cluster I have 2 namenodes, node1 is the active namenode and node2 is the standby namenode in case that node1 ...
- 117
0
votes
1
answer
257
views
java.io.IOException: Waiting for startup of standalone server | MiniZooKeeperCluster
I am trying to write some unit tests using HBaseTestingUtility. When I say startMiniCluster() on HBaseTestingUtility,
private HBaseTestingUtility hBaseTestingUtility = new HBaseTestingUtility(my_conf);...
- 1,455
0
votes
1
answer
242
views
ZK hbase replication node grows exponentially though hbase datas properly replication for peers
In the hbase-1.4.10, I have enabled replication for all tables and configured the peer_id. the list_peers provide the below result:
hbase(main):001:0> list_peers
PEER_ID CLUSTER_KEY ...
- 2,049
2
votes
0
answers
214
views
java.lang.UnsatisfiedLinkError when I start hbase
There are three node3(node1,node2,node3) in my cluster.I have installed hadoop-2.5.2,zookeeper-3.5.4-cdh5.10.0,jdk-7u67-linux-x64 on my Centos server ,they all work well.
Then I install hbase-0.98.6-...
- 21
0
votes
1
answer
484
views
HBase fully distributed mode [Zookeeper error while executing HBase shell]
Following these two tutorials: i.e tutorial 1 and tutorial 2, I was able to set up HBase cluster in fully-distributed mode. Initially the cluster seems to work okay.
The 'jps' output in HMaster/ Name ...
- 416
1
vote
2
answers
912
views
Distributed Hbase failed to start, with error info: Server is not running yet
I am trying to set up a distributed Hbase based on Hadoop, with one namenode on my Ubuntu 20.04 and three datanodes on localhost and two VMs. All went well when I started Hadoop and Hbase, jps info on ...
- 15