PMM is not respondig

I installed PMM form OVA file and I cannot connect to PMM.
How can I check that the PMM service is correctly installed and and running ?

Hi @danb - thanks for posting to the forums, welcome back!
I’m assuming “cannot connect” means you can’t get a response when you try to load PMM via web browser: https://<PMM-IP> ? I suggest the most basic approach to bringing the services back online would be to restart the OVA instance.

Since you provisioned using OVA you will have the opportunity to ssh into the VM. use the credentials root / percona . Once logged in, you can check to see if grafana is running with ps -ef | grep grafana . You’ll also want to look at the logs under /srv/logs - in particular grafana.log and nginx.error.log will be very helpful for you to post here to the forums so we can help you troubleshoot.

If you want to avoid a lot of troubleshooting and don’t mind losing data, it might be simplest to destroy the existing instance and launch a new OVA.

2 Likes

The VM is new installation. I restarted the VM and got the following:
grafana logs

t=2021-06-14T14:23:28+0000 lvl=info msg="Starting Grafana" logger=server version=7.3.7 commit=v7.3.7-2.17.0 branch=master compiled=2021-05-05T14:27:18+0000     
t=2021-06-14T14:23:28+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini                                          
t=2021-06-14T14:23:28+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini                                                      
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/srv/grafana"                             
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/srv/logs"                                
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"              
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.server.root_url=%(protocol)s://%(domain)s:%(http_port
)s/graph"                                                                                                                                                       
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.log.mode=console"                                    
t=2021-06-14T14:23:28+0000 lvl=info msg="Config overridden from command line" logger=settings arg="default.log.console.format=console"                          
t=2021-06-14T14:23:28+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana                                                                     
t=2021-06-14T14:23:28+0000 lvl=info msg="Path Data" logger=settings path=/srv/grafana                                                                           
t=2021-06-14T14:23:28+0000 lvl=info msg="Path Logs" logger=settings path=/srv/logs                                                                              
t=2021-06-14T14:23:28+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins                                                            
t=2021-06-14T14:23:28+0000 lvl=info msg="Path Provisioning" logger=settings path=/usr/share/grafana/conf/provisioning                                           
t=2021-06-14T14:23:28+0000 lvl=info msg="App mode production" logger=settings                                                                                   
t=2021-06-14T14:23:28+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3                                                                       
t=2021-06-14T14:23:28+0000 lvl=info msg="Starting DB migrations" logger=migrator                                                                                
t=2021-06-14T14:23:28+0000 lvl=info msg="Starting plugin search" logger=plugins                                                                                 
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=grafana-worldmap-panel                                                           
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=natel-discrete-panel                                                             
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=petrslavotinek-carpetplot-panel                                                  
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-app                                                                          
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=grafana-polystat-panel                                                           
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-update                                                                       
t=2021-06-14T14:23:29+0000 lvl=warn msg="Running an unsigned backend plugin" logger=plugins pluginID=vertamedia-clickhouse-datasource pluginDir=/var/lib/grafana
/plugins/vertamedia-clickhouse-datasource/dist                                                                                                                  
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=vertamedia-clickhouse-datasource                                                 
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=yesoreyeram-boomtable-panel                                                      
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=camptocamp-prometheus-alertmanager-datasource                                    
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=grafana-piechart-panel                                                           
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=jdbranham-diagram-panel                                                          
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-check-panel-home                                                             
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-qan-app-panel                                                                
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=digiapulssi-breadcrumb-panel                                                     
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-pt-summary-datasource                                                        
t=2021-06-14T14:23:29+0000 lvl=info msg="Registering plugin" logger=plugins id=pmm-pt-summary-panel                                                             
t=2021-06-14T14:23:29+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=0.0.0.0:3000 protocol=http subUrl=/graph socket=                        
t=2021-06-14T14:23:29+0000 lvl=warn msg="Plugin uses a deprecated version of Grafana's backend plugin system which will be removed in a future release. Consider
 upgrading to a newer plugin version or reach out to the plugin repository/developer and request an upgrade." logger=plugins.backend pluginId=vertamedia-clickho
use-datasource

nginx.error.log

2021/06/14 14:29:16 [error] 984#984: *59 connect() failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: _, request: "POST /
agent.Agent/Connect HTTP/2.0", subrequest: "/auth_request", upstream: "http://127.0.0.1:7772/auth_request", host: "127.0.0.1"                                   
2021/06/14 14:29:16 [error] 984#984: *59 auth request unexpected status: 502 while sending to client, client: 127.0.0.1, server: _, request: "POST /agent.Agent/
Connect HTTP/2.0", host: "127.0.0.1"
1 Like

It finally worked for me.
I noticed that the supervisord stopped after the default timeout which is 90sec.

I modified the ‘Type’ value in /usr/lib/systemd/system/supervisord.service.
The new value is Type=simple (the default was Type=Forking)

[Unit]
Description=Process Monitoring and Control Daemon
After=rc-local.service nss-user-lookup.target
After=network.target
RequiresMountsFor=/srv

[Service]
#Type=forking (old value)
Type=simple
# we need to wait till time is synchronized
ExecStartPre=/usr/bin/sleep 10
ExecStart=/usr/bin/supervisord -c /etc/supervisord.conf

[Install]
WantedBy=multi-user.target
2 Likes