Deploy PMM Server with enabled alerting and configured Pager Duty notification channel

Hi everyone,

Where are the config files located to enable Integrated Alerting and set up a notification channel with Pager Duty?

Hello Kostua,

To enable PMM Integrated alerting and to create/configure notification channels:

Basically 4 steps that need to be performed:

1 Activate Integrated Alerting
2 Set up a communication channel
3 Add a notification channel
4 Add an alert rule

Note that this feature is currently in technical preview…and it may appear differently depending on which PMM server version you are using

Hope this is helpful
Harry

1 Like

Are you looking for the config files inside the filesystem or just how to enable? If it’s how to enable the instructions above will allow you to use the UI to set everything up (SMTP and Slack integrations are done in PMM → Settings → Communication channels, while Pagerduty and generic webhooks are done in Integrated alerting → Notification channels).

If you’re looking at the filesystem there are elements that are actually stored in a config file (/etc/alertmanager.yml) but that’s just the communication channels from the settings page…the individual notification channels I believe are stored in the config DB and you probably don’t want to make manual edits there but can use the API (https:///swagger) to do it programmatically vs through the UI.

1 Like

I’m looking at how I can automate these manual steps:

1 Activate Integrated Alerting
2 Set up a communication channel
3 Add a notification channel
4 Add an alert rule

1 Like

Gotcha! You can do 100% of the UI stuff via the API…but since this is not GA yet you have to change contexts to see the guides.

Go to https://<pmm-server-ip-or-hostname>/swagger
at the top you’ll see the default JSON (swagger.json) is targeted, change that to swagger-dev.json and click explore.

The Call’s you’ll be most interested in are:
POST /v1/Settings/Change (enable alerting, set up SMTP/Slack communication channel)
POST /v1/management/ia/channels/* (Notification channels)
POST /v1/management/ia/Rules/* (Alert Rules)

Should get you started! There are lots of guides online for establishing sessions, logging in and then making the calls. We are also revamping our own documentation to make it more developer friendly but that’s still a work in progress!

1 Like

@steve.hoffman, thanks a lot, man!

2 Likes