Questions tagged [prometheus-alertmanager]
The Alertmanager handles alerts sent by client applications such as the Prometheus server. It takes care of deduplicating, grouping, and routing them to the correct receiver integration such as email, PagerDuty, or OpsGenie. It also takes care of silencing and inhibition of alerts.
prometheus-alertmanager
44
questions
5
votes
1
answer
8k
views
Create an alert on alertmanager using curl
I came across this need and could not find a simple answer:
I have a Prometheus + Alertmanager setup and want to test
the alertmanager third party integrations.
So I wanted to create a dummy alert ...
17
votes
4
answers
42k
views
How to silence Prometheus Alertmanager using config files?
I'm using the official stable/prometheus-operator chart do deploy Prometheus with helm.
It's working good so far, except for the annoying CPUThrottlingHigh alert that is firing for many pods (...
13
votes
5
answers
30k
views
Prometheus alertmanager send notifications to multiple slack channel
We have two different teams working on different applications.I would like send alert notifications to different slack channels via using same alerts expressions. I found some examples but not ...
12
votes
2
answers
16k
views
Alert when docker container pod is in Error or CarshLoopBackOff kubernetes
I have my kubernetes cluster setup on AWS where I am trying to monitor several pods, using cAdvisor + Prometheus + Alert manager. What I want to do it launch an email alert (with service/container ...
0
votes
0
answers
59
views
Alert with Prometheus
I have a cluster where metrics from each namespace comes with a rash and I want to optimize a query with some regex to bring all namespaces to alert.
This is my configure of job:
- job: my_job
---...
19
votes
2
answers
34k
views
scrape interval and evaluation interval in prometheus
My scrape interval and evaluation interval are way off from each other as whown below (15s vs 4m). When I feed metrics to the endpoint, I find that the rules are evaluated every 4m which is expected. ...
19
votes
3
answers
100k
views
Multiple Targets on prometheus
I've configured prometheus on Centos, version details are follows.
prometheus-2.5.0.linux-386
I've added two targets on the prometheus.yml configuration file, all the servers node exporters are ...
13
votes
3
answers
17k
views
how to install latest version of prometheus/promtool in ubuntu?
I downloaded my prometheus version is 2.3.2
wget https://github.com/prometheus/prometheus/releases/download/v2.3.2/prometheus-2.3.2.linux-amd64.tar.gz
untared and prometheus already running as ...
12
votes
5
answers
26k
views
Can't load prometheus.yml config file with docker (prom/prometheus)
I am trying to load prometheus with docker using the following custom conf file: danilo@machine:/prometheus-data/prometheus.yml:
global:
scrape_interval: 15s # By default, scrape targets every ...
11
votes
7
answers
16k
views
How to snooze prometheus alert for specific time
I have faced some issues with Prometheus memory alert. If I take the backup of Gitlab then memory usage going up to 95%. I want to snooze memory alert for a specific time.
e.g. If I am taking a ...
8
votes
3
answers
5k
views
How to detect a new metrics with Prometheus alerting rule
Say I have a metrics request_failures for users. For each user I add a unique label value to the metrics. So for user u1, when a request failed twice, I get the following metrics:
request_failures{...
8
votes
1
answer
32k
views
How to get a pod's labels in Prometheus when pulling the metrics from Kube State Metrics
I have a Prometheus pod running along with my Kube-State-Metrics (KSM) pod. The KSM collects all the metrics from all the pods across all the namespaces in the cluster. Prometheus simply scrapes the ...
8
votes
4
answers
24k
views
How to configure alerts in Prometheus for diskspace
We have prometheus running on Win Server box, and WMI exporter on a separate box(client).
Able to read client metrics in Prometheus. Now the requirement is the moment Diskspace =>90 % , send an email ...
7
votes
1
answer
4k
views
Is the fingerprint field in Alertmanager unique?
I am developing a dashboard, which receives all Alertmanager readings and processes them. I looked for a unique field in the request payload to create a unique external alert id in my database. The ...
7
votes
1
answer
13k
views
How do I use the hour() function of PromQL?
I am trying to set up an alert in the alert.rules file of Prometheus that fires only during specific periods of time.
I've already tested the code block below without time restrictions inside the expr-...