Description:
pmm-client is enabled on the percona-mongo helm chart and the pmm-server is installed using helm chart as well. However, we see connection timeout in pmm-client
Steps to Reproduce:
- Enable pmm in percona-mongo helm chart
pmm:
enabled: true
image:
repository: percona/pmm-client
tag: 2.43.2
serverHost: mongo-monitoring.p2.internal
- Add the connection setting to the percona-mongo secret
PMM_AGENT_SERVER_INSECURE_TLS: "true"
PMM_SERVER_API_KEY: xxxx
PMM_SERVER_URL: https://mongo-monitoring.p2.internal:443
- Install the pmm server
repository: percona/pmm-server
tag: 2.44.0
- Check the logs in the pmm-client
time="2025-08-13T17:45:30.673+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T17:45:48.330+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T17:45:53.331+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T17:46:08.392+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T17:46:13.393+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T17:46:28.508+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T17:46:33.510+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T17:46:45.467+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T17:46:50.467+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
Version:
pmm-client version 2.43.2
pmm-server version 2.44.0
Logs:
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/node_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/mysqld_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/mongodb_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/postgres_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/proxysql_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/rds_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/azure_exporter" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/vmagent" component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Updating PMM Server address from \"mongo-monitoring.p2.internal\" to \"mongo-monitoring.
p2.internal:443\"." component=main
time="2025-08-13T11:17:51.233+00:00" level=info msg="Runner capacity set to 32, token capacity set to 2" component=runner
time="2025-08-13T11:17:51.233+00:00" level=info msg="Window check connection time is 1.00 hour(s)"
time="2025-08-13T11:17:51.234+00:00" level=info msg=Starting... component=client
time="2025-08-13T11:17:51.234+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=clien
t
time="2025-08-13T11:17:51.234+00:00" level=info msg="Starting local API server on http://0.0.0.0:7777/ ..." component=local-server/JSON
time="2025-08-13T11:17:51.235+00:00" level=info msg=Started. component=local-server/JSON
time="2025-08-13T11:17:56.234+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T11:17:57.149+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=clien
t
Agent ID : /agent_id/f098b397-7ede-423e-86c3-7213379a8e02
Node ID :
Node name:
PMM Server:
URL : https://mongo-monitoring.p2.internal:443/
Version:
PMM Client:
Connected : false
Connection uptime: 0
pmm-admin version: 2.43.2
pmm-agent version: 2.43.2
Agents:
Failed to get PMM Server parameters from local pmm-agent: pmm-agent is not connected to PMM Server.
Failed to get PMM Server parameters from local pmm-agent: pmm-agent is not connected to PMM Server.
time="2025-08-13T11:18:01.291+00:00" level=info msg="Stopping pmm-agent..." component=entrypoint
time="2025-08-13T11:18:01.292+00:00" level=warning msg="Got SIGTERM, shutting down..." component=main
time="2025-08-13T11:18:01.292+00:00" level=info msg=Done. component=supervisor
time="2025-08-13T11:18:01.292+00:00" level=info msg=Stopped. component=local-server/JSON
time="2025-08-13T11:18:01.292+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: context canceled." component=cli
ent
time="2025-08-13T11:18:01.292+00:00" level=error msg="Client error: failed to dial: context canceled"
time="2025-08-13T11:18:01.293+00:00" level=info msg=Done. component=local-server
time="2025-08-13T11:18:01.293+00:00" level=info msg=Done. component=main
time="2025-08-13T11:18:01.294+00:00" level=warning msg="Can't get exit code for pmm-agent. Error code: wait: no child processes" component=entrypoint
time="2025-08-13T11:18:01.294+00:00" level=info msg="Starting 'pmm-agent run'..." component=entrypoint
time="2025-08-13T11:18:01.306+00:00" level=info msg="Loading configuration file /usr/local/percona/pmm2/config/pmm-agent.yaml." component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/node_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/mysqld_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/mongodb_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/postgres_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/proxysql_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/rds_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/azure_exporter" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Using /usr/local/percona/pmm2/exporters/vmagent" component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Updating PMM Server address from \"mongo-monitoring.p2.internal\" to \"mongo-monitoring.p2.internal:443\"." component=main
time="2025-08-13T11:18:01.307+00:00" level=info msg="Runner capacity set to 32, token capacity set to 2" component=runner
time="2025-08-13T11:18:01.307+00:00" level=info msg="Window check connection time is 1.00 hour(s)"
time="2025-08-13T11:18:01.307+00:00" level=info msg=Starting... component=client
time="2025-08-13T11:18:01.307+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T11:18:01.307+00:00" level=info msg="Starting local API server on http://0.0.0.0:7777/ ..." component=local-server/JSON
time="2025-08-13T11:18:01.308+00:00" level=info msg=Started. component=local-server/JSON
time="2025-08-13T11:18:06.308+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T11:18:07.223+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
time="2025-08-13T11:18:12.224+00:00" level=error msg="Failed to connect to mongo-monitoring.p2.internal:443: timeout." component=client
time="2025-08-13T11:18:13.605+00:00" level=info msg="Connecting to https://api_key:***@mongo-monitoring.p2.internal:443/ ..." component=client
Expected Result:
Connection should be successful. I can access the UI without any issues.
Actual Result:
Connection timeout
Additional Information:
We are using self signed cert for pmm-server, I’m not sure if that’s what’s causing this issue.