Skip to main content

Questions tagged [prometheus-alertmanager]

The Alertmanager handles alerts sent by client applications such as the Prometheus server. It takes care of deduplicating, grouping, and routing them to the correct receiver integration such as email, PagerDuty, or OpsGenie. It also takes care of silencing and inhibition of alerts.

prometheus-alertmanager
5 votes
1 answer
8k views

Create an alert on alertmanager using curl

I came across this need and could not find a simple answer: I have a Prometheus + Alertmanager setup and want to test the alertmanager third party integrations. So I wanted to create a dummy alert ...
Henrique Capozzi's user avatar
17 votes
4 answers
42k views

How to silence Prometheus Alertmanager using config files?

I'm using the official stable/prometheus-operator chart do deploy Prometheus with helm. It's working good so far, except for the annoying CPUThrottlingHigh alert that is firing for many pods (...
Eduardo Baitello's user avatar
13 votes
5 answers
30k views

Prometheus alertmanager send notifications to multiple slack channel

We have two different teams working on different applications.I would like send alert notifications to different slack channels via using same alerts expressions. I found some examples but not ...
semural's user avatar
  • 4,321
12 votes
2 answers
16k views

Alert when docker container pod is in Error or CarshLoopBackOff kubernetes

I have my kubernetes cluster setup on AWS where I am trying to monitor several pods, using cAdvisor + Prometheus + Alert manager. What I want to do it launch an email alert (with service/container ...
shiv455's user avatar
  • 7,684
0 votes
0 answers
59 views

Alert with Prometheus

I have a cluster where metrics from each namespace comes with a rash and I want to optimize a query with some regex to bring all namespaces to alert. This is my configure of job: - job: my_job ---...
Thais's user avatar
  • 1
19 votes
2 answers
34k views

scrape interval and evaluation interval in prometheus

My scrape interval and evaluation interval are way off from each other as whown below (15s vs 4m). When I feed metrics to the endpoint, I find that the rules are evaluated every 4m which is expected. ...
TheMonkWhoSoldHisCode's user avatar
19 votes
3 answers
100k views

Multiple Targets on prometheus

I've configured prometheus on Centos, version details are follows. prometheus-2.5.0.linux-386 I've added two targets on the prometheus.yml configuration file, all the servers node exporters are ...
user avatar
13 votes
3 answers
17k views

how to install latest version of prometheus/promtool in ubuntu?

I downloaded my prometheus version is 2.3.2 wget https://github.com/prometheus/prometheus/releases/download/v2.3.2/prometheus-2.3.2.linux-amd64.tar.gz untared and prometheus already running as ...
anand babu's user avatar
12 votes
5 answers
26k views

Can't load prometheus.yml config file with docker (prom/prometheus)

I am trying to load prometheus with docker using the following custom conf file: danilo@machine:/prometheus-data/prometheus.yml: global: scrape_interval: 15s # By default, scrape targets every ...
Danilo Caetano's user avatar
11 votes
7 answers
16k views

How to snooze prometheus alert for specific time

I have faced some issues with Prometheus memory alert. If I take the backup of Gitlab then memory usage going up to 95%. I want to snooze memory alert for a specific time. e.g. If I am taking a ...
Abhijit's user avatar
  • 111
8 votes
3 answers
5k views

How to detect a new metrics with Prometheus alerting rule

Say I have a metrics request_failures for users. For each user I add a unique label value to the metrics. So for user u1, when a request failed twice, I get the following metrics: request_failures{...
Jay Xue's user avatar
  • 81
8 votes
1 answer
32k views

How to get a pod's labels in Prometheus when pulling the metrics from Kube State Metrics

I have a Prometheus pod running along with my Kube-State-Metrics (KSM) pod. The KSM collects all the metrics from all the pods across all the namespaces in the cluster. Prometheus simply scrapes the ...
BlueChips23's user avatar
  • 1,901
8 votes
4 answers
24k views

How to configure alerts in Prometheus for diskspace

We have prometheus running on Win Server box, and WMI exporter on a separate box(client). Able to read client metrics in Prometheus. Now the requirement is the moment Diskspace =>90 % , send an email ...
Abraham Dhanyaraj Arumbaka's user avatar
7 votes
1 answer
4k views

Is the fingerprint field in Alertmanager unique?

I am developing a dashboard, which receives all Alertmanager readings and processes them. I looked for a unique field in the request payload to create a unique external alert id in my database. The ...
mhyousefi's user avatar
  • 1,174
7 votes
1 answer
13k views

How do I use the hour() function of PromQL?

I am trying to set up an alert in the alert.rules file of Prometheus that fires only during specific periods of time. I've already tested the code block below without time restrictions inside the expr-...
Lavair's user avatar
  • 926

15 30 50 per page