PMM server is not receiving metrics from client

[Sumit_sarova]

Recently, we received a PMM client update request. After updating the agents on all monitored nodes, the system has stopped functioning as expected. Specifically, the inbuilt dashboards are no longer displaying the required data correctly, although everything was working fine prior to the update.

To troubleshoot this issue, I have already:

• Reconfigured both the PMM server and the PMM clients.
• Followed the official documentation and troubleshooting steps available online.
• Verified the pmm-server status and inventory list, both of which indicate that all components are running properly.

Despite these efforts, the issue persists

[nurlan]

Hi @Sumit_sarova

1. can you share what version of PMM Server and PMM client are you using?
2. Is it MySQL, PostgreSQL or MongoDB?
3. Can you run pmm-admin summary and check for errors in logs
4. Can you call https://PMM_SERVER_URL/logs.zip and check errors there?
5. From which version to which you have upgraded?
6. Did you upgrade only PMM Cleints or PMM Server as well?

[Sumit_sarova]

Hi @nurlan
attaching the screenshots for your reference for version info and logs.
It is for MYSQL
PMM server was updated automatically and I manually updated the pmm-client.
can’t give any confirmation of the last version.

[nurlan]

Can you share logs for mysqld_exporter?

[Sumit_sarova]

attached the logs, as it is visible there is some connection issue and we tried to solve it,
please suggest something if you have any solution for this.

[Abhinav_Gupta]

Your mysqld_exporter is trying to ping the MySQL instance on 127.0.0.1:3306. Can you check manually if you are able to telnet 127.0.0.1 3306 or manually connect to MySQL using 127.0.0.1 on 3306? Also, check the netstat -tnlp or bind address of MySQL.

Please note that your initial PMM client for MySQL was configured for the address 10.110.128.196:3306.

[Sumit_sarova]

Hi,
we have disabled telnet so sharing the output of nc -vz, pls check.