Percona Monitoring and Manager is connected to about 130 hosts and approximately 150 PostgreSQL services. A very large number of metrics arrive over 12 hours. By default, in the PMM Grafana, the setting is for the last 12 hours, across all hosts, with auto-refresh every 1 minute. These settings cause the queries to include a massive number of records, and ClickHouse loads all CPU cores and the SSD, leading to the PMM server freezing. How can these default settings be changed for everyone? Also, so that a specific server from the list is selected by default for retrieving metrics, instead of “ALL”.
# Minimum dashboard refresh interval. When set, this will restrict users to set the refresh interval of a dashboard lower than given interval. Per default this is 5 seconds.
# The interval string is a possibly signed sequence of decimal numbers, followed by a unit suffix (ms, s, m, h, d), e.g. 30s or 1m.
min_refresh_interval = 5m
by logging into docker container and
under /usr/share/grafana/conf/defaults.ini
And then restart grafana
supervisorctl restart grafana
defaultTimeOffset = 1h
Are you using the PMM servers as per the requirements?