- “MySQL General” -> “Process States” show “No datapoints” for bad server, for other servers there is data.
- can you check share output of following commands:
curl https://BAD-SERVER-IP:42002/metrics-mr --insecure | grep mysql_info_schema_threads
mysql -e "SELECT COALESCE(command,''),COALESCE(state,''),count(*),sum(time) FROM information_schema.processlist WHERE ID != connection_id() GROUP BY command,state ORDER BY null;"
2. can you check share output of following commands:
aleksey@aleksey-filippov:~$ curl https://bad_server:42002/metrics-mr --insecure | grep mysql_info_schema_threads
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 117k 0 1058 0 0 349 0 0:05:43 0:00:03 0:05:40 349# HELP mysql_info_schema_threads The number of threads (connections) split by current state.
# TYPE mysql_info_schema_threads gauge
mysql_info_schema_threads{state="after create"} 0
mysql_info_schema_threads{state="altering table"} 0
mysql_info_schema_threads{state="analyzing"} 0
mysql_info_schema_threads{state="checking permissions"} 0
mysql_info_schema_threads{state="checking table"} 0
mysql_info_schema_threads{state="cleaning up"} 0
mysql_info_schema_threads{state="closing tables"} 0
mysql_info_schema_threads{state="converting heap to myisam"} 0
mysql_info_schema_threads{state="copying to tmp table"} 0
mysql_info_schema_threads{state="creating sort index"} 0
mysql_info_schema_threads{state="creating table"} 0
mysql_info_schema_threads{state="creating tmp table"} 0
mysql_info_schema_threads{state="deleting"} 0
mysql_info_schema_threads{state="end"} 0
mysql_info_schema_threads{state="executing"} 0
mysql_info_schema_threads{state="execution of init_command"} 0
mysql_info_schema_threads{state="flushing tables"} 0
mysql_info_schema_threads{state="freeing items"} 0
mysql_info_schema_threads{state="fulltext initialization"} 0
mysql_info_schema_threads{state="idle"} 62
mysql_info_schema_threads{state="init"} 0
mysql_info_schema_threads{state="killed"} 0
mysql_info_schema_threads{state="logging slow query"} 0
mysql_info_schema_threads{state="login"} 0
mysql_info_schema_threads{state="manage keys"} 0
mysql_info_schema_threads{state="opening tables"} 0
mysql_info_schema_threads{state="optimizing"} 0
mysql_info_schema_threads{state="other"} 0
mysql_info_schema_threads{state="preparing"} 0
mysql_info_schema_threads{state="reading from net"} 0
mysql_info_schema_threads{state="removing duplicates"} 0
mysql_info_schema_threads{state="removing tmp table"} 0
mysql_info_schema_threads{state="reopen tables"} 0
mysql_info_schema_threads{state="repair by sorting"} 0
mysql_info_schema_threads{state="repair done"} 0
mysql_info_schema_threads{state="repair with keycache"} 0
mysql_info_schema_threads{state="replication master"} 0
mysql_info_schema_threads{state="rolling back"} 0
mysql_info_schema_threads{state="searching rows for update"} 0
mysql_info_schema_threads{state="sending data"} 1
mysql_info_schema_threads{state="sorting for group"} 0
mysql_info_schema_threads{state="sorting for order"} 0
mysql_info_schema_threads{state="sorting index"} 0
mysql_info_schema_threads{state="sorting result"} 0
mysql_info_schema_threads{state="statistics"} 0
mysql_info_schema_threads{state="updating"} 1
mysql_info_schema_threads{state="waiting for lock"} 0
mysql_info_schema_threads{state="waiting for table flush"} 0
mysql_info_schema_threads{state="waiting for tables"} 0
mysql_info_schema_threads{state="waiting on cond"} 0
mysql_info_schema_threads{state="writing to net"} 0
# HELP mysql_info_schema_threads_seconds The number of seconds threads (connections) have used split by current state.
# TYPE mysql_info_schema_threads_seconds gauge
mysql_info_schema_threads_seconds{state="after create"} 0
mysql_info_schema_threads_seconds{state="altering table"} 0
mysql_info_schema_threads_seconds{state="analyzing"} 0
mysql_info_schema_threads_seconds{state="checking permissions"} 0
mysql_info_schema_threads_seconds{state="checking table"} 0
mysql_info_schema_threads_seconds{state="cleaning up"} 0
mysql_info_schema_threads_seconds{state="closing tables"} 0
mysql_info_schema_threads_seconds{state="converting heap to myisam"} 0
mysql_info_schema_threads_seconds{state="copying to tmp table"} 0
mysql_info_schema_threads_seconds{state="creating sort index"} 0
mysql_info_schema_threads_seconds{state="creating table"} 0
mysql_info_schema_threads_seconds{state="creating tmp table"} 0
mysql_info_schema_threads_seconds{state="deleting"} 0
mysql_info_schema_threads_seconds{state="end"} 0
mysql_info_schema_threads_seconds{state="executing"} 0
mysql_info_schema_threads_seconds{state="execution of init_command"} 0
mysql_info_schema_threads_seconds{state="flushing tables"} 0
mysql_info_schema_threads_seconds{state="freeing items"} 0
mysql_info_schema_threads_seconds{state="fulltext initialization"} 0
mysql_info_schema_threads_seconds{state="idle"} 4067
mysql_info_schema_threads_seconds{state="init"} 0
mysql_info_schema_threads_seconds{state="killed"} 0
mysql_info_schema_threads_seconds{state="logging slow query"} 0
mysql_info_schema_threads_seconds{state="login"} 0
mysql_info_schema_threads_seconds{state="manage keys"} 0
mysql_info_schema_threads_seconds{state="opening tables"} 0
mysql_info_schema_threads_seconds{state="optimizing"} 0
mysql_info_schema_threads_seconds{state="other"} 0
mysql_info_schema_threads_seconds{state="preparing"} 0
mysql_info_schema_threads_seconds{state="reading from net"} 0
mysql_info_schema_threads_seconds{state="removing duplicates"} 0
mysql_info_schema_threads_seconds{state="removing tmp table"} 0
mysql_info_schema_threads_seconds{state="reopen tables"} 0
mysql_info_schema_threads_seconds{state="repair by sorting"} 0
mysql_info_schema_threads_seconds{state="repair done"} 0
mysql_info_schema_threads_seconds{state="repair with keycache"} 0
mysql_info_schema_threads_seconds{state="replication master"} 0
mysql_info_schema_threads_seconds{state="rolling back"} 0
mysql_info_schema_threads_seconds{state="searching rows for update"} 0
mysql_info_schema_threads_seconds{state="sending data"} 1
mysql_info_schema_threads_seconds{state="sorting for group"} 0
mysql_info_schema_threads_seconds{state="sorting for order"} 0
mysql_info_schema_threads_seconds{state="sorting index"} 0
mysql_info_schema_threads_seconds{state="sorting result"} 0
mysql_info_schema_threads_seconds{state="statistics"} 0
mysql_info_schema_threads_seconds{state="updating"} 1
mysql_info_schema_threads_seconds{state="waiting for lock"} 0
mysql_info_schema_threads_seconds{state="waiting for table flush"} 0
mysql_info_schema_threads_seconds{state="waiting for tables"} 0
mysql_info_schema_threads_seconds{state="waiting on cond"} 0
mysql_info_schema_threads_seconds{state="writing to net"} 0
100 117k 100 117k 0 0 38924 0 0:00:03 0:00:03 --:--:-- 38937
BAD_SERVER:
mysql -e "SELECT COALESCE(command,’’),COALESCE(state,’’),count(),s um(time) FROM information_schema.processlist WHERE ID != connection_id() GROUP BY command,state ORDER BY null;"
±---------------------±-------------------±---------±----------+
| COALESCE(command,’’) | COALESCE(state,’’) | count() | sum(time) |
±---------------------±-------------------±---------±----------+
| Sleep | | 65 | 3631 |
| Query | Sending data | 1 | 1 |
| Query | update | 1 | 0 |
±---------------------±-------------------±---------±----------+
GOOD_SERVER:
mysql -e "SELECT COALESCE(command,’’),COALESCE(state,’’),count(),s um(time) FROM information_schema.processlist WHERE ID != connection_id() GROUP BY command,state ORDER BY null;"
±---------------------±-------------------±---------±----------+
| COALESCE(command,’’) | COALESCE(state,’’) | count() | sum(time) |
±---------------------±-------------------±---------±----------+
| Sleep | | 4 | 3132 |
±---------------------±-------------------±---------±----------+
do you see any issues with https://bad_server:42002/metrics-mr on http://pmm-server/prometheus/targets page?
As I can see /metrics-mr is down.
can you share output of the following command?
wget https://bad-server-ip:42002/metrics-mr --no-check-certificate
oh, sorry, I am wondering response time, not content
aleksey@aleksey-filippov:~$ wget https://mysql.db:42002/metrics-mr --no-check-certificate
–2017-04-13 12:27:17-- https://mysql.db:42002/metrics-mr
Распознаётся mysql.db (mysql.db)… 111.111.11.1
Подключение к mysql.db (mysql.db)|111.111.11.1|:42002… соединение установлено.
ПРЕДУПРЕЖДЕНИЕ: невозможно проверить сертификат mysql.db, выпущенный «O=PMM Client»:
Невозможно локально проверить подлинность запрашивающего.
ПРЕДУПРЕЖДЕНИЕ: Общее название сертификата «» не совпадает с именем запрошенного узла «mysql.db».
HTTP-запрос отправлен. Ожидание ответа… 200 OK
Длина: 119619 (117K) [text/plain]
Сохранение в: «metrics-mr»
metrics-mr 100%[================================================================================================================>] 116,82K --.-KB/s in 0,05s
2017-04-13 12:27:18 (2,36 MB/s) - «metrics-mr» сохранён [119619/119619]
should be fixed after changes in another thread https://www.percona.com/forums/questions-discussions/percona-monitoring-and-management/47839-mysql-query-responce-time-show-no-datapoints?p=48145#post48145
this graph, depends to collector