PMM upgrade (from 2.20.0 to 2.21.0) failed

Our current PMM setup is in EC2 (installed from marketplace). While recent upgrade, it halt at below message. Please advice the workaround/fix. Thanks.

TASK [Cleanup yum cache] *******************************************************
changed: [localhost]
[WARNING]: Consider using the yum module rather than running ‘yum’. If you
need to use command because yum is insufficient you can add ‘warn: false’ to
this command task or set ‘command_warnings=False’ in ansible.cfg to get rid of
this message.

PLAY RECAP *********************************************************************
localhost : ok=56 changed=26 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0

time=“2021-09-03T06:30:20Z” level=info msg=“Waiting for Grafana dashboards update to finish…”

Hi @Bilalayub,

So sorry to hear that your workflow got interrupted by that :frowning:

I hope to be able to help, but only if you have ssh access to your VM where you run PMM Server. Pls let me know if you have, I’ll drop you the steps which hopefully can get it going.

Alex

1 Like

Hi Alex,

Thanks for your email, much appreciated.

Yes I have ssh access to VM, looking forward to the steps.

Regards,
Bilal Ayub

1 Like

Hi @atymchuk , Please help to share the steps that I can try for the workaround ?

Regards,
Bilal

1 Like

Hi! Apologies for the delay with the answer :frowning: )

So, given that PMM Server gets stuck at the point when it tries to update the dashboards, here are the steps to perform:

1/ Make sure you make a snapshot of your AMI VM to a safe place from where you can restore it if anything goes wrong.

2/ cd to the following directory:

cd /usr/share/percona-dashboards

3/ locate the file import-dashboards.py and replace it with content from the repo:

https://raw.githubusercontent.com/percona/pmm-server/PMM-2.0/import-dashboards.py

4/ then restart all processes via supervisor:

supervisorctl restart all

Hope this will get you going, please let us know otherwise.

1 Like

Hi @atymchuk ,

Thank you for the workaround, It worked and resolved the issue.

Much appreciated.

Regards,

2 Likes