All Questions
Tagged with prometheus-alertmanager kubernetes
136
questions
-1
votes
0
answers
19
views
Script to Deploy Grafana Dashboard with PromQL and Alert Queries [closed]
I'm looking to build a script that can deploy a Grafana dashboard with PromQL queries and alert queries all in one go. The idea is to automate the deployment process so that I can simply call the ...
0
votes
1
answer
70
views
AlertManager fail starting up on kube-prometheus-9.0.3 [closed]
kubectl logs alertmanager-kube-prometheus-alertmanager-x -n monitoring
Error from server (BadRequest): container "alertmanager" in pod "alertmanager-kube-prometheus-alertmanager-x" ...
- 135
0
votes
2
answers
438
views
Is there a way to set up alert with Prometheus storage retention size
Is there a way to set a prometheus alert on storage.tsdb.retention.size, lets say if the retention size has been hit, i want an alert sent out.
- 1,966
0
votes
0
answers
138
views
How to query Kubernetes node CPU levels
I have the following PromQL query to get the CPU percentages of the nodes in my Kubernetes cluster.
100 - (avg by (instance) (rate(node_cpu_seconds_total{mode!="idle|wait|iowait"}[5m])) * ...
- 3,585
0
votes
1
answer
49
views
Limit email count which is getting fired by alertmanager
Can someone provide some suggestions on limiting the email alerting count to send only one email instead of 100 duplicate emails when a particular metric condition is triggered and alert starts to ...
- 39
0
votes
1
answer
142
views
How implement query which scrape metric only from currently live pod
I have a quite common scenario where a pod was just redeployed and so given a metric I see both from dead pod and new one.
Now I would like to implement an alert just for example about the number of ...
- 583
0
votes
0
answers
68
views
Prometheus alert expression to check the status of a service having 3 pods
The following expression shows that the service "name" has 3 pods
sum by (namespace, created_by_name) (kube_pod_info)
{created_by_name="name", namespace="ns"} ...
- 1
0
votes
1
answer
133
views
2 different prometheus server to scrapping different data but shows combined in their /targets
I have 2 different prometheus server (with its set of alertmanager, pushgateway, nodeExporter and kube-state-metrics)
When I port forward either of these 2 servers, in their respective /targets - I ...
- 434
0
votes
0
answers
825
views
Prometheus query alert if average memory/CPU utilization is trending up
The actual requirement is if CPU/memory increases(trending up) continuously due to a memory leak and finally one day container may blast and recreate right due to memory/CPU exhausted
Before ...
- 31
0
votes
1
answer
350
views
Prometheus: How to run unit tests against PrometheusRule kubernetes manifests
I wish to use promtool to run unit tests against alerts that I have setup e.g.
promtool test rules alert-test.yaml
Here's an example test file:
# alert-test.yaml
rule_files:
- 'my-alert.yaml'
tests:
...
- 103
1
vote
0
answers
512
views
How to provide default values for values in a Prometheus timeseries that are null
Me and my team want to write a PromQL query that is true every time a new Helm Chart is deployed in our K8S cluster, which we can use to create an alert. We are scraping Kube metrics, and are scraping ...
1
vote
0
answers
116
views
Facing an issue with applying configuration for Alertmanager to send rmail notification on kubernetes(EKS) cluster when alert rules are triggered
🙋♂️Hello everyone, I'm currently working on configuration for Alertmanager to send email notifications , and I've encountered a problem. I've set up an EKS cluster and installed the Prometheus ...
0
votes
1
answer
1k
views
AlertmanagerConfig not sending alerts to email receiver
I have a deployment of a pod that continuously goes into CrashLoopBackoff state. I have setup an alert forthis event but the alert is not firing on the configured receiver. The alert is only firing ...
- 961
0
votes
0
answers
466
views
Can we pass rules to Prometheus Alert Manager without using Prometheus rules ? Any alternatives to the Prometheus Rules?
I am trying to find a way to use Prometheus Alert Manager without using Prometheus rules.
Can we create Alert Rules in any alternative way without making use of Prometheus and integrate it with Alert ...
- 11
0
votes
1
answer
617
views
How do I verify a configuration change on a bitnami/kube-prometheus deployment?
I have an existing deploy of bitnami/kube-prometheus deployed via :
helm upgrade --install prometheus -n monitoring -f .\input\prom-values.yaml bitnami/kube-prometheus
I have made some changes to ...
- 961