How do I troubleshoot and reslove this error?
Both nodes are on the same network.
2025-01-10T09:53:47.517458Z 0 [Note] [MY-000000] [Galera] Flow-control interval: [141, 141]
2025-01-10T09:53:47.517477Z 0 [Note] [MY-000000] [Galera] Shifting OPEN -> PRIMARY (TO: 86)
2025-01-10T09:53:47.517671Z 1 [Note] [MY-000000] [Galera] ####### processing CC 86, local, ordered
2025-01-10T09:53:47.517805Z 1 [Note] [MY-000000] [Galera] Maybe drain monitors from -1 upto current CC event 86 upto:-1
2025-01-10T09:53:47.517827Z 1 [Note] [MY-000000] [Galera] Drain monitors from -1 up to -1
2025-01-10T09:53:47.517841Z 1 [Note] [MY-000000] [Galera] Process first view: ec762607-ccfe-11ef-be0f-d77b76ed7836 my uuid: c8c30714-cf38-11ef-9368-d7be988cc956
2025-01-10T09:53:47.517863Z 1 [Note] [MY-000000] [Galera] Server pxc2 connected to cluster at position ec762607-ccfe-11ef-be0f-d77b76ed7836:86 with ID c8c30714-cf38-11ef-9368-d7be988cc956
2025-01-10T09:53:47.517945Z 1 [Note] [MY-000000] [WSREP] Server status change disconnected -> connected
2025-01-10T09:53:47.518106Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2025-01-10T09:53:47.518158Z 1 [Note] [MY-000000] [Galera] ####### My UUID: c8c30714-cf38-11ef-9368-d7be988cc956
2025-01-10T09:53:47.518172Z 1 [Note] [MY-000000] [Galera] Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes
2025-01-10T09:53:47.518369Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2025-01-10T09:53:47.518528Z 1 [Note] [MY-000000] [Galera] ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2025-01-10T09:53:47.518554Z 1 [Note] [MY-000000] [Galera] State transfer required:
Group state: ec762607-ccfe-11ef-be0f-d77b76ed7836:86
Local state: 00000000-0000-0000-0000-000000000000:-1
2025-01-10T09:53:47.518625Z 1 [Note] [MY-000000] [WSREP] Server status change connected -> joiner
2025-01-10T09:53:47.518641Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2025-01-10T09:53:47.518891Z 0 [Note] [MY-000000] [WSREP] Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address '161.35.173.xxx' --datadir '/var/lib/mysql/' --basedir '/usr/' --plugindir '/usr/lib64/mysql/plugin/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '1' --mysqld-version '8.0.39-30.1' --binlog 'binlog' )
2025-01-10T09:53:48.258122Z 0 [Warning] [MY-000000] [WSREP-SST] Found a stale sst_in_progress file: /var/lib/mysql//sst_in_progress
2025-01-10T09:53:48.708888Z 1 [Note] [MY-000000] [WSREP] Prepared SST request: xtrabackup-v2|161.35.173.112:4444/xtrabackup_sst//1
2025-01-10T09:53:48.708955Z 1 [Note] [MY-000000] [Galera] Check if state gap can be serviced using IST
2025-01-10T09:53:48.708976Z 1 [Note] [MY-000000] [Galera] Local UUID: 00000000-0000-0000-0000-000000000000 != Group UUID: ec762607-ccfe-11ef-be0f-d77b76ed7836
2025-01-10T09:53:48.708991Z 1 [Note] [MY-000000] [Galera] ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 86, STRv: 3
2025-01-10T09:53:48.709103Z 1 [Note] [MY-000000] [Galera] IST receiver addr using tcp://161.35.173.112:4568
2025-01-10T09:53:48.709682Z 1 [Note] [MY-000000] [Galera] State gap can't be serviced using IST. Switching to SST
2025-01-10T09:53:48.709833Z 1 [Warning] [MY-000000] [Galera] Failed to prepare for incremental state transfer: Failed to open IST listener at tcp://161.35.173.xxx:4568', asio error 'Failed to listen: bind: Cannot assign requested address: System error: 99 (Cannot assign requested address)
at /mnt/jenkins/workspace/pxc80-autobuild-RELEASE/test/rpmbuild/BUILD/Percona-XtraDB-Cluster-8.0.39/percona-xtradb-cluster-galera/galerautils/src/gu_asio_stream_react.cpp:listen():922'
at /mnt/jenkins/workspace/pxc80-autobuild-RELEASE/test/rpmbuild/BUILD/Percona-XtraDB-Cluster-8.0.39/percona-xtradb-cluster-galera/galera/src/ist.cpp:prepare():357. IST will be unavailable.
2025-01-10T09:53:48.710792Z 0 [Note] [MY-000000] [Galera] Member 1.0 (pxc2) requested state transfer from '*any*'. Selected 0.0 (pxc-cluster-node-1)(SYNCED) as donor.
2025-01-10T09:53:48.710986Z 0 [Note] [MY-000000] [Galera] Shifting PRIMARY -> JOINER (TO: 86)
2025-01-10T09:53:48.711024Z 1 [Note] [MY-000000] [Galera] Requesting state transfer: success, donor: 0
2025-01-10T09:53:48.711047Z 1 [Note] [MY-000000] [Galera] Resetting GCache seqno map due to different histories.
2025-01-10T09:53:48.711062Z 1 [Note] [MY-000000] [Galera] GCache history reset: ec762607-ccfe-11ef-be0f-d77b76ed7836:0 -> ec762607-ccfe-11ef-be0f-d77b76ed7836:86
2025-01-10T09:53:48.711852Z 0 [Warning] [MY-000000] [Galera] 0.0 (pxc-cluster-node-1): State transfer to 1.0 (pxc2) failed: No message of desired type
2025-01-10T09:53:48.711882Z 0 [ERROR] [MY-000000] [Galera] /mnt/jenkins/workspace/pxc80-autobuild-RELEASE/test/rpmbuild/BUILD/Percona-XtraDB-Cluster-8.0.39/percona-xtradb-cluster-galera/gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1310: Will never receive state. Need to abort.
2025-01-10T09:53:48.711895Z 0 [Note] [MY-000000] [Galera] gcomm: terminating thread
2025-01-10T09:53:48.711908Z 0 [Note] [MY-000000] [Galera] gcomm: joining thread
2025-01-10T09:53:48.712112Z 0 [Note] [MY-000000] [Galera] gcomm: closing backend
2025-01-10T09:53:49.716162Z 0 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
here is my conf file:
[client]
socket=/var/lib/mysql/mysql.sock
[mysqld]
pid-file = /var/run/mysqld/mysqld.pid
socket = /var/run/mysqld/mysqld.sock
datadir = /var/lib/mysql
skip_name_resolve
max_connections=4096
#server-id=2
gtid_mode = ON
#enforce_gtid_consistency = ON
pxc-encrypt-cluster-traffic=OFF
# Custom config should go here
#!includedir /etc/mysql/conf.d/
# Enable slow logs
slow_query_log=1
slow_query_log_file=/var/log/mysql/slow.log
;long_query_time=1
log_throttle_queries_not_using_indexes=1
log_queries_not_using_indexes=1
innodb_buffer_pool_size = 2G
innodb_log_file_size=256M
#wsrep
wsrep_provider=/usr/lib64/galera4/libgalera_smm.so
wsrep_cluster_name=pxc-cluster
wsrep_cluster_address=gcomm://157.245.36.xxx,161.35.173.xxx
wsrep_node_name=pxc2
wsrep_node_address=161.35.173.xxx
pxc_strict_mode=ENFORCING
wsrep_sst_method=xtrabackup-v2
wsrep_sst_auth=sstuser:perconapass
and here is my docker compose file:
services:
pxc-node2:
image: percona/percona-xtradb-cluster:8.0
container_name: pxc-node2
environment:
- MYSQL_ROOT_PASSWORD=xxxxxxxxxxxxxxxx
volumes:
- ./data:/var/lib/mysql
- ./conf/:/etc/percona-xtradb-cluster.conf.d
- ./sql-logs:/var/log/mysql
- ./cert:/etc/mysql/ssl
ports:
- "0.0.0.0:3306:3306"
- "0.0.0.0:4444:4444"
- "0.0.0.0:4567:4567"
- "0.0.0.0:4568:4568"
networks:
- pxc-network
networks:
pxc-network:
driver: bridge
name: pxc-cluster_net
I need help on how to get it working.