Gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1214

MySQL & MariaDB Percona Operator for MySQL
1

Hi,

I’ve delete 3 pods to restart them and now I’ve 2 in this stat :

pod-pxc-0                                         2/3     CrashLoopBackOff   3          3m10s
pod-pxc-1                                         3/3     Running            0          18m
pod-pxc-2                                         2/3     CrashLoopBackOff   7          17m

I’ve check logs from these 2 pods and I’ve this :

...
2022-10-07T12:13:44.361431Z 0 [ERROR] [MY-000000] [Galera] gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1214: Will never receive state. Need to abort.
2022-10-07T12:13:44.361455Z 0 [Note] [MY-000000] [Galera] gcomm: terminating thread
2022-10-07T12:13:44.361483Z 0 [Note] [MY-000000] [Galera] gcomm: joining thread
2022-10-07T12:13:44.361534Z 0 [Note] [MY-000000] [Galera] gcomm: closing backend
2022-10-07T12:13:45.378016Z 0 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view (view_id(NON_PRIM,6a092778-95bd,28)
memb {
	7c1f559a-b97a,0
	}
joined {
	}
left {
	}
partitioned {
	6a092778-95bd,0
	}
)
2022-10-07T12:13:45.378095Z 0 [Note] [MY-000000] [Galera] PC protocol downgrade 1 -> 0
2022-10-07T12:13:45.378108Z 0 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view ((empty))
2022-10-07T12:13:45.378309Z 0 [Note] [MY-000000] [Galera] gcomm: closed
2022-10-07T12:13:45.378331Z 0 [Note] [MY-000000] [Galera] mysqld: Terminated.
2022-10-07T12:13:45.378353Z 0 [Note] [MY-000000] [WSREP] Initiating SST cancellation
2022-10-07T12:13:45.378363Z 0 [Note] [MY-000000] [WSREP] Terminating SST process
12:13:45 UTC - mysqld got signal 11 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.

Build ID: Not Available 
Server Version: 8.0.23-14.1 Percona XtraDB Cluster (GPL), Release rel14, Revision d3b9a1d, WSREP version 26.4.3, wsrep_26.4.3

Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x46000
2022-10-07T12:13:45.379080Z 0 [ERROR] [MY-000000] [WSREP-SST] Removing /var/lib/mysql//xtrabackup_galera_info file due to signal
/usr/sbin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0x41) [0x2162191]
/usr/sbin/mysqld(handle_fatal_signal+0x3c3) [0x12ded33]
/lib64/libpthread.so.0(+0x12b20) [0x7fb797554b20]
/lib64/libc.so.6(abort+0x203) [0x7fb795423d11]
/usr/lib64/galera4/libgalera_smm.so(+0x14a75) [0x7fb7890f9a75]
/usr/lib64/galera4/libgalera_smm.so(+0x17a826) [0x7fb78925f826]
/usr/lib64/galera4/libgalera_smm.so(+0x182966) [0x7fb789267966]
/lib64/libpthread.so.0(+0x814a) [0x7fb79754a14a]
/lib64/libc.so.6(clone+0x43) [0x7fb7954fef23]
You may download the Percona XtraDB Cluster operations manual by visiting
http://www.percona.com/software/percona-xtradb-cluster/. You may find information
in the manual which will help you identify the cause of the crash.
Writing a core file using lib coredumper
PATH: (null)

anyone can help me ? thanks !

1 Like
2

Hi,

I don’t no if it’s linked to this issue because I’ve only 150Gb of data.

1 Like
3

Hi,

We need to have the outputs of the following commands and full log from mysqld to get more information about this issue.

kubectl describe pods pod-pxc-0 
kubectl describe pods pod-pxc-1
kubectl get events --sort-by=.metadata.creationTimestamp
1 Like