2nd node not able to initiate SST/IST transfer

MySQL & MariaDB Percona Server for MySQL 8.0
1

Node 2 Logs:

2021-05-07T09:06:59.470047Z 1 [Note] [MY-000000] [Galera] State transfer required:
Group state: b2849287-ae65-11eb-be10-f354e010b68f:41
Local state: 67dd6c1a-af13-11eb-8956-9b0217c0a0e3:1
2021-05-07T09:06:59.470309Z 1 [Note] [MY-000000] [WSREP] Server status change connected → joiner
2021-05-07T09:06:59.470568Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2021-05-07T09:06:59.471008Z 0 [Note] [MY-000000] [WSREP] Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role ‘joiner’ --address ‘172.20.45.141’ --datadir ‘/data/mysql/’ --basedir ‘/usr/’ --plugindir ‘/usr/lib/mysql/plugin/’ --defaults-file ‘/etc/mysql/my.cnf’ --defaults-group-suffix ‘’ --parent ‘20192’ --mysqld-version ‘8.0.22-13.1’ ‘’ )
2021-05-07T09:06:59.473140Z 0 [Note] [MY-000000] [WSREP-SST] sh: 1: wsrep_sst_xtrabackup-v2: not found
2021-05-07T09:06:59.473494Z 0 [ERROR] [MY-000000] [WSREP] Failed to read ‘ready ’ from: wsrep_sst_xtrabackup-v2 --role ‘joiner’ --address ‘172.20.45.141’ --datadir ‘/data/mysql/’ --basedir ‘/usr/’ --plugindir ‘/usr/lib/mysql/plugin/’ --defaults-file ‘/etc/mysql/my.cnf’ --defaults-group-suffix ‘’ --parent ‘20192’ --mysqld-version ‘8.0.22-13.1’ ‘’
Read: ‘(null)’
2021-05-07T09:06:59.474337Z 0 [ERROR] [MY-000000] [WSREP] Process completed with error: wsrep_sst_xtrabackup-v2 --role ‘joiner’ --address ‘172.20.45.141’ --datadir ‘/data/mysql/’ --basedir ‘/usr/’ --plugindir ‘/usr/lib/mysql/plugin/’ --defaults-file ‘/etc/mysql/my.cnf’ --defaults-group-suffix ‘’ --parent ‘20192’ --mysqld-version ‘8.0.22-13.1’ ‘’ : 2 (No such file or directory)
2021-05-07T09:06:59.474410Z 1 [ERROR] [MY-000000] [WSREP] Failed to prepare for ‘xtrabackup-v2’ SST. Unrecoverable.
2021-05-07T09:06:59.474529Z 1 [ERROR] [MY-000000] [Galera] SST request callback failed. This is unrecoverable, restart required.
2021-05-07T09:06:59.474554Z 1 [Note] [MY-000000] [Galera] ReplicatorSMM::abort()
2021-05-07T09:06:59.474576Z 1 [Note] [MY-000000] [Galera] Closing send monitor…
2021-05-07T09:06:59.474597Z 1 [Note] [MY-000000] [Galera] Closed send monitor.
2021-05-07T09:06:59.474618Z 1 [Note] [MY-000000] [Galera] gcomm: terminating thread
2021-05-07T09:06:59.474997Z 1 [Note] [MY-000000] [Galera] gcomm: joining thread
2021-05-07T09:06:59.475032Z 1 [Note] [MY-000000] [Galera] gcomm: closing backend
2021-05-07T09:06:59.475964Z 1 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node

2 Likes
3

Hi @robingaur thank you for posting to the Percona forums!
In general, in order to troubleshoot PXC issues it would be helpful to have the logs from at least the DONOR and ideally from all members of the cluster.
Looking at your log output from node 2, this is the first issue that caught my attention:

Could you check that you have this binary on your filesystem? I just provisioned an Ubuntu 20.04 using PXC 8.0.22 and this is what I have:

root@ubuntu-s-1vcpu-1gb-nyc3-01:~# stat /usr/bin/wsrep_sst_xtrabackup-v2
  File: /usr/bin/wsrep_sst_xtrabackup-v2
  Size: 87648     	Blocks: 176        IO Block: 4096   regular file
Device: fc01h/64513d	Inode: 71878       Links: 1
Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2021-05-07 15:22:16.000000000 +0000
Modify: 2021-03-15 16:38:43.000000000 +0000
Change: 2021-05-07 15:22:22.703574164 +0000
 Birth: -
1 Like
4

Seems like there was a problem with the installation. The above problem fixed after reinstallation of pxc.

2 Likes
5

Great! Glad you were able to solve it :slight_smile:

1 Like