All Questions
Tagged with apache-zookeeper amazon-web-services
47
questions
0
votes
1
answer
347
views
accessing the zookeeper deployment that comes with AWS MSK
In my current (local) deployment of an application, I have Apache Kafka and Zookeeper deployed.
Now I want to put my application in the cloud, and see that AWS MSK is an option. This (currently, at ...
- 4,516
-1
votes
1
answer
86
views
when service discovery is down how microservices communicate with each other
How microservice A communicate with microservice B when service registry is down?
i tried communicating with port id of the microservices B added in microservice A but in real time how it is possible ...
0
votes
0
answers
38
views
Security for Kafka
I am trying to implement Quorum TLS by following the instructions in https://zookeeper.apache.org/doc/r3.5.7/zookeeperAdmin.html#Quorum+TLS, but I keep on encountering the following errors after doing ...
- 1
1
vote
3
answers
1k
views
Can I use Kafka in KRaft mode on AWS MSK?
I would like to use Kafka in KRaft mode instead of Zookeeper on AWS, since Kraft mode seems to be the future of Kafka. As I understand, basic solution from AWS for Kafka is AWS MSK. But in MSK ...
- 383
0
votes
1
answer
381
views
Kafka Multi broker setup with ec2 machine: Timed out waiting for a node assignment. Call: createTopics
I am trying to setup kafka with 3 broker nodes and 1 zookeeper node in AWS EC2 instances. I have following server.properties for every broker:
kafka-1:
broker.id=0
listeners=PLAINTEXT_1://ec2-**-***-**...
- 31
1
vote
1
answer
120
views
How to Create and save a script on AWS, using Cloudformation ? trying to launch kafka - zookeeper node
Before I begin just letting you know I ma pretty new to the whole thing of cloudformation and coding in general
I have been trying to write a cloud formation template to launch an instance with a ...
- 13
1
vote
1
answer
1k
views
Collections Not Found Error : Apache Solr
I have set up a multinode zookeeper and Apache Solr 8.1 cluster on AWS. I followed all the instructions that were there on the official site and was successful in indexing data and querying from it. ...
- 358
0
votes
1
answer
1k
views
Recommended AWS EC2 instance type for Zookeeper?
Do you have any suggestions about instance type for zookeeper deployed on aws?
Btw, I use zookeeper mainly for ClickHouse, which means zookeeper is used to transmit metadata and log things (with ...
- 83
2
votes
1
answer
2k
views
How do I move all Kafka topics to working brokers?
I have a development environment with one Zookeeper and one Kafka broker on AWS.
I created a topic (foo) on a broker (1001) that is now destroyed. As a result, the leader for this topic is not ...
- 36k
9
votes
1
answer
9k
views
AWS MSK - Timeout when creating Kafka topic with ACL turned-on
I'm using AWS MSK and I want to enable ACLs but I'm unable to create a topic when ACLs are turned-on. I'm using the command-line tools for all the operations. Here's a summary of what I'm doing:
...
- 353
3
votes
1
answer
3k
views
NiFi Cluster on AWS using ECS and external Zookeeper
I'm trying to set up a NiFi Cluster on AWS using ECS with External Zookeeper.
Have created a ECS Cluster for Zookeeper with 3 EC2 instance and running zookeeper ensemble. This external Zookeeper is ...
- 561
3
votes
0
answers
534
views
Managed cloud alternative to zookeeper
We are running zookeeper today for configuration management. In many cases, this is the only service we are running ourselves. We are able to find a managednoffering for almost everything from aws RDS,...
- 555
13
votes
1
answer
698
views
KAFKA broker throwing Wrong request type 18 and Wrong request type 16
System:
EC2 Instance Type: m5.2xlarge
OS: Ubuntu 14.04.5 LTS
Kernel Version: 4.4.0-1022-aws
vCPU: 8 Cores
Memory: 32Gib
Java Version: 1.8.0_171
We are running KAFKA in cluster mode with two ...
- 131
0
votes
0
answers
376
views
Kafka isn't connecting over the internet
I've tried setting up Zookeeper on an AWS EC2 Windows 10 instance and then connecting Kafka 2.11-1.1.0 from both the instance and a separate computer.
Within the virtual desktop, I ran:
bin\windows\...
- 41
10
votes
2
answers
2k
views
Difference between Zookeeper and a managed replicated database service
I just came across Zookeeper and am wondering as to what's the difference between Zookeeper and an available, consistent, durable, distributed, replicated database service like AWS DynamoDB or even ...
- 269