# Can't join second node (rsync)

**URL:** <https://forums.percona.com/t/cant-join-second-node-rsync/3947>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [December 14, 2014, 9:03pm UTC](https://forums.percona.com/t/cant-join-second-node-rsync/3947 "2014-12-14T21:03:09Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![manwe](https://avatars.discourse-cdn.com/v4/letter/m/e47c2d/32.png) [@manwe](https://forums.percona.com/u/manwe)\
**Post date:** [December 14, 2014, 9:03pm UTC](https://forums.percona.com/t/cant-join-second-node-rsync/3947/1 "2014-12-14T21:03:09Z")

</div>

After bootstrapping nodeA, nodeB fails to start because it can’t SST  
Using rsync  
Tried 5.6.21 and reverted to 5.6.20 with dsame result

2014-12-14 21:41:40 9277 [Note] WSREP: Shifting OPEN → PRIMARY (TO: 1)  
2014-12-14 21:41:40 9277 [Note] WSREP: State transfer required:  
Group state: cc13f472-83fa-11e4-8ea3-138a7ef719a7:1  
Local state: 00000000-0000-0000-0000-000000000000:-1  
2014-12-14 21:41:40 9277 [Note] WSREP: New cluster view: global state: cc13f472-83fa-11e4-8ea3-138a7ef719a7:1, view# 4: Primary, number of nodes: 2, my index: 1, protocol version 3  
2014-12-14 21:41:40 9277 [Warning] WSREP: Gap in state sequence. Need state transfer.  
2014-12-14 21:41:40 9277 [Note] WSREP: Running: 'wsrep\_sst\_rsync --role ‘joiner’ --address ‘10.10.1.62’ --auth ‘’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/my.cnf’ --parent ‘9277’ ‘’ ’  
2014-12-14 21:41:40 9277 [Note] WSREP: Prepared SST request: rsync|10.10.1.62:4444/rsync\_sst  
2014-12-14 21:41:40 9277 [Note] WSREP: wsrep\_notify\_cmd is not defined, skipping notification.  
2014-12-14 21:41:40 9277 [Note] WSREP: REPL Protocols: 6 (3, 2)  
2014-12-14 21:41:40 9277 [Note] WSREP: Service thread queue flushed.  
2014-12-14 21:41:40 9277 [Note] WSREP: Assign initial position for certification: 1, protocol version: 3  
2014-12-14 21:41:40 9277 [Note] WSREP: Service thread queue flushed.  
2014-12-14 21:41:40 9277 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (cc13f472-83fa-11e4-8ea3-138a7ef719a7): 1 (Operation not permitted)  
at galera/src/replicator\_str.cpp:prepare\_for\_IST():456. IST will be unavailable.  
2014-12-14 21:41:40 9277 [Note] WSREP: Member 1.0 (nodeB) requested state transfer from ‘_any_’. Selected 0.0 (nodeA)(SYNCED) as donor.  
2014-12-14 21:41:40 9277 [Note] WSREP: Shifting PRIMARY → JOINER (TO: 1)  
2014-12-14 21:41:40 9277 [Note] WSREP: Requesting state transfer: success, donor: 0  
2014-12-14 21:41:40 9277 [Warning] WSREP: 0.0 (nodeA): State transfer to 1.0 (nodeB) failed: -255 (Unknown error 255)  
2014-12-14 21:41:40 9277 [ERROR] WSREP: gcs/src/gcs\_group.cpp:int gcs\_group\_handle\_join\_msg(gcs\_group\_t\*, const gcs\_recv\_msg\_t\*)():722: Will never receive state. Need to abort.  
2014-12-14 21:41:40 9277 [Note] WSREP: gcomm: terminating thread  
2014-12-14 21:41:40 9277 [Note] WSREP: gcomm: joining thread  
2014-12-14 21:41:40 9277 [Note] WSREP: gcomm: closing backend  
2014-12-14 21:41:41 9277 [Note] WSREP: view(view\_id(NON\_PRIM,dcb11fa5,4) memb {  
e50b4be3,0  
} joined {  
} left {  
} partitioned {  
dcb11fa5,0  
})  
2014-12-14 21:41:41 9277 [Note] WSREP: view((empty))  
2014-12-14 21:41:41 9277 [Note] WSREP: gcomm: closed  
2014-12-14 21:41:41 9277 [Note] WSREP: /usr/sbin/mysqld: Terminated.  
141214 21:41:41 mysqld\_safe mysqld from pid file /var/lib/mysql/mysqlb.pid ended  
WSREP\_SST: [ERROR] Parent mysqld process (PID:9277) terminated unexpectedly. (20141214 21:41:42.237)  
WSREP\_SST: [INFO] Joiner cleanup. (20141214 21:41:42.239)  
WSREP\_SST: [INFO] Joiner cleanup done. (20141214 21:41:42.746)

---

<div class="post-metadata">

**Author:** ![wagnerbianchi](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/wagnerbianchi/32/802_2.png) [@wagnerbianchi](https://forums.percona.com/u/wagnerbianchi)\
**Post date:** [December 15, 2014, 6:40am UTC](https://forums.percona.com/t/cant-join-second-node-rsync/3947/2 "2014-12-15T06:40:27Z")

</div>

Can you post the MySQL configuration file from both nodes? Additionally, are you able to check if the IPTables/IP6Tables and SELinux is enable?

---

<div class="post-metadata">

**Author:** ![manwe](https://avatars.discourse-cdn.com/v4/letter/m/e47c2d/32.png) [@manwe](https://forums.percona.com/u/manwe)\
**Post date:** [December 15, 2014, 5:22pm UTC](https://forums.percona.com/t/cant-join-second-node-rsync/3947/3 "2014-12-15T17:22:34Z")

</div>

Here’s the oncifugration file of both nodes. Node A was started using “”/etc/init.d/mysql bootstrap-pxc""

[root@mysqla ~]# cat /etc/my.cnf  
[mysqld]  
datadir=/var/lib/mysql  
socket=/var/lib/mysql/mysql.sock  
user=mysql

# Disabling symbolic-links is recommended to prevent assorted security risks

symbolic-links=0

#manwe for cluster

# 

# 

wsrep\_provider=/usr/lib64/libgalera\_smm.so  
wsrep\_cluster\_address=gcomm://10.10.1.61,10.10.1.62,10.10.1.63  
wsrep\_cluster\_name=MySQLCluster  
wsrep\_node\_name=nodeA  
wsrep\_node\_address=10.10.1.61  
wsrep\_slave\_threads=8  
wsrep\_sst\_method=rsync  
binlog\_format=ROW  
default\_storage\_engine=InnoDB  
innodb\_autoinc\_lock\_mode=2

# 

# 

[mysqld\_safe]  
log-error=/var/log/mysqld.log  
pid-file=/var/run/mysqld/mysqld.pid

#########################################################################################################

[root@mysqlb ~]# cat /etc/my.cnf  
[mysqld]  
datadir=/var/lib/mysql  
socket=/var/lib/mysql/mysql.sock  
user=mysql

# Disabling symbolic-links is recommended to prevent assorted security risks

symbolic-links=0

#manwe for cluster

# 

# 

wsrep\_provider=/usr/lib64/libgalera\_smm.so  
wsrep\_cluster\_address=gcomm://10.10.1.61,10.10.1.62,10.10.1.63  
wsrep\_cluster\_name=MySQLCluster  
wsrep\_node\_name=nodeB  
wsrep\_node\_address=10.10.1.62  
wsrep\_slave\_threads=8  
wsrep\_sst\_method=rsync  
binlog\_format=ROW  
default\_storage\_engine=InnoDB  
innodb\_autoinc\_lock\_mode=2

# 

# 

[mysqld\_safe]  
log-error=/var/log/mysqld.log  
pid-file=/var/run/mysqld/mysqld.pid

#######################################################################

Regarding iptables:

[root@mysqlb ~]# iptables -L -n  
Chain INPUT (policy ACCEPT)  
target prot opt source destination  
ACCEPT all – 0.0.0.0/0 0.0.0.0/0 state RELATED,ESTABLISHED  
ACCEPT icmp – 0.0.0.0/0 0.0.0.0/0  
ACCEPT all – 0.0.0.0/0 0.0.0.0/0  
ACCEPT tcp – 0.0.0.0/0 0.0.0.0/0 state NEW tcp dpt:22  
REJECT all – 0.0.0.0/0 0.0.0.0/0 reject-with icmp-host-prohibited

Chain FORWARD (policy ACCEPT)  
target prot opt source destination  
REJECT all – 0.0.0.0/0 0.0.0.0/0 reject-with icmp-host-prohibited

Chain OUTPUT (policy ACCEPT)  
target prot opt source destination

[root@mysqla ~]# iptables -L -n  
Chain INPUT (policy ACCEPT)  
target prot opt source destination

Chain FORWARD (policy ACCEPT)  
target prot opt source destination

Chain OUTPUT (policy ACCEPT)  
target prot opt source destination

############################################################################

Regarding selinux I executed “setenforce 0” before the installation.

[root@mysqla ~]# sestatus  
SELinux status: enabled  
SELinuxfs mount: /selinux  
Current mode: permissive  
Mode from config file: enforcing  
Policy version: 24  
Policy from config file: targeted

---

<div class="post-metadata">

**Author:** ![manwe](https://avatars.discourse-cdn.com/v4/letter/m/e47c2d/32.png) [@manwe](https://forums.percona.com/u/manwe)\
**Post date:** [December 15, 2014, 6:15pm UTC](https://forums.percona.com/t/cant-join-second-node-rsync/3947/4 "2014-12-15T18:15:39Z")

</div>

Thanks to Percona’s support engineers. They solved my issue in some minutes. Changed to xtrabackup and solved a connectivity issue. Now it works.
