Failed to read uuid:seqno from joiner script

1

Our cluster stopped; joiner can’t join.
Solution on other posts “wsrep_sst_method=xtrabackup-v2” doesn’t help.
Can someone gime some light? Thanks in advance.

WSREP_SST: [INFO] Removing the sst_in_progress file (20221103 15:33:55.589)
2022-11-03 15:33:55 25944 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '192.168.5.207' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --defaults-group-suffix '' --parent '25944'  '' : 32 (Broken pipe)
2022-11-03 15:33:55 25944 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
2022-11-03 15:33:55 25944 [ERROR] WSREP: SST script aborted with error 32 (Broken pipe)
2022-11-03 15:33:55 25944 [ERROR] WSREP: SST failed: 32 (Broken pipe)
2022-11-03 15:33:55 25944 [ERROR] Aborting
1 Like
2

This usually means there was a network error and the SST process was aborted. Can you provide the logs from the donor side?

1 Like
3

Thanks for your help.
From the donor:

2022-11-03 15:24:52 18424 [Note] WSREP: New cluster view: global state: ff8488b6-ea38-11ec-b971-eabf0125e254:851011566, view# 10: Primary, number of nodes: 2, my index: 0, protocol version 3
2022-11-03 15:24:52 18424 [Note] WSREP: Setting wsrep_ready to true
2022-11-03 15:24:52 18424 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 1 -> 2)
2022-11-03 15:24:52 18424 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-11-03 15:24:52 18424 [Note] WSREP: Assign initial position for certification: 851011566, protocol version: 3
2022-11-03 15:24:52 18424 [Note] WSREP: Service thread queue flushed.
2022-11-03 15:24:52 18424 [Note] WSREP: Member 1.0 (zscloud2-node2) requested state transfer from '*any*'. Selected 0.0 (zscloud3-node3)(SYNCED) as donor.
2022-11-03 15:24:52 18424 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 851011566)
2022-11-03 15:24:52 18424 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-11-03 15:24:52 18424 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '192.168.5.207:4444/xtrabackup_sst' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --defaults-group-suffix '' --mysqld-version '5.6.51-91.0-56'   '' --gtid 'ff8488b6-ea38-11ec-b971-eabf0125e254:851011566' '
2022-11-03 15:24:52 18424 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with tar (2022-11-03 15:24:52)
WSREP_SST: [INFO] Using socat as streamer (2022-11-03 15:24:52)
WSREP_SST: [INFO] Streaming the backup to joiner at 192.168.5.207 4444 (2022-11-03 15:24:52)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf $INNOEXTRA --galera-info --stream=$sfmt ${TMPDIR} 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:192.168.5.207:4444; RC=( ${PIPESTATUS[@]} ) (2022-11-03 15:24:52)
2022-11-03 15:24:54 18424 [Note] WSREP: (292e9cb6, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-11-03 15:25:39 18424 [Note] WSREP: 0.0 (zscloud3-node3): State transfer to 1.0 (zscloud2-node2) complete.
2022-11-03 15:25:39 18424 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 851011574)
2022-11-03 15:25:39 18424 [Note] WSREP: Member 0.0 (zscloud3-node3) synced with group.
2022-11-03 15:25:39 18424 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 851011574)
2022-11-03 15:25:39 18424 [Note] WSREP: Synchronized with group, ready for connections
2022-11-03 15:25:39 18424 [Note] WSREP: Setting wsrep_ready to true
2022-11-03 15:25:39 18424 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
WSREP_SST: [INFO] Total time on donor: 0 seconds (2022-11-03 15:25:39)
2022-11-03 15:25:40 18424 [Note] WSREP: forgetting a8e1aa9c (tcp://192.168.5.207:4567)
2022-11-03 15:25:40 18424 [Note] WSREP: Node 292e9cb6 state prim
2022-11-03 15:25:40 18424 [Note] WSREP: view(view_id(PRIM,292e9cb6,11) memb {
	292e9cb6,0
} joined {
} left {
} partitioned {
	a8e1aa9c,0
})
2022-11-03 15:25:40 18424 [Note] WSREP: save pc into disk
2022-11-03 15:25:40 18424 [Note] WSREP: forgetting a8e1aa9c (tcp://192.168.5.207:4567)
2022-11-03 15:25:40 18424 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
2022-11-03 15:25:40 18424 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c64aae62-5b8b-11ed-90f8-d3db8df70dda
2022-11-03 15:25:40 18424 [Note] WSREP: STATE EXCHANGE: sent state msg: c64aae62-5b8b-11ed-90f8-d3db8df70dda
2022-11-03 15:25:40 18424 [Note] WSREP: STATE EXCHANGE: got state msg: c64aae62-5b8b-11ed-90f8-d3db8df70dda from 0 (zscloud3-node3)
2022-11-03 15:25:40 18424 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 10,
	members    = 1/1 (joined/total),
	act_id     = 851011575,
	last_appl. = 851011571,
	protocols  = 0/9/3 (gcs/repl/appl),
1 Like
4 
--mysqld-version '5.6.51-91.0-56'

MySQL 5.6 is not supported. You need to upgrade to 5.7, preferably 8.0 and see if the issue remains.

1 Like