# Install failing on 2nd node
**URL:** https://forums.percona.com/t/install-failing-on-2nd-node/3884
**Category:** Percona XtraDB Cluster 5.x
**Created:** [November 14, 2014, 2:15pm UTC](https://forums.percona.com/t/install-failing-on-2nd-node/3884 "2014-11-14T14:15:18Z")
**Posts on this page:** 2
**Page:** 1
### Author:  [@dpwhite](https://forums.percona.com/u/dpwhite)
#### Post date: [November 14, 2014, 2:15pm UTC](https://forums.percona.com/t/install-failing-on-2nd-node/3884/1 "2014-11-14T14:15:18Z")
I’m trying to stand up a 3-node PXC, MySQL 5.6 in RHEL 6.6. I was able to start the first node (172.30.200.45) OK. When I try to start the 2nd node (172.30.200.46) I’m getting this error:
[mysql@ldvdbamycl02 bin]$ /etc/init.d/mysql start
Starting MySQL… ERROR! The server quit without updating PID file (/var/lib/mysql/ldvdbamycl02.itap.purdue.edu.pid).
============================================
The my.cnf on the 2nd node is pretty simple:
# [mysqld] socket=/tmp/mysql.sock datadir=/var/lib/mysql basedir=/opt/mysql/Percona-XtraDB-Cluster-5.6.20-rel68.0-25.7.886.Linux.x86\_64 wsrep\_provider=/opt/mysql/Percona-XtraDB-Cluster-5.6.20-rel68.0-25.7.886.Linux.x86\_64/lib/libgalera\_smm.so user=mysql log\_error=/var/log/mysql/error.log wsrep\_cluster\_address=‘gcomm://172.30.200.45,172.30.200.46,172.30.200.47’ binlog\_format=ROW default\_storage\_engine=InnoDB innodb\_autoinc\_lock\_mode=2 wsrep\_node\_address=172.30.200.46 wsrep\_sst\_method=rsync wsrep\_cluster\_name=mysqldevcluster1 wsrep\_sst\_auth=“sstuser:xxxxx”
The error log on the 2nd node looks like this:
141114 14:27:17 mysqld\_safe Starting mysqld daemon with databases from /var/lib/mysql
141114 14:27:17 mysqld\_safe WSREP: Running position recovery with --log\_error=‘/var/lib/mysql/wsrep\_recovery.KwUF7A’ --pid-file=‘/var/lib/mysql/ldvdbamycl02.itap.purdue.edu-recover.pid’
.
. (Lots of NOTES)
.
2014-11-14 14:27:20 17138 [Note] WSREP: gcomm: connecting to group ‘mysqldevcluster1’, peer ‘172.30.200.45:,172.30.200.46:,172.30.200.47:’
2014-11-14 14:27:20 17138 [Warning] WSREP: (4093e6a1, ‘tcp://0.0.0.0:4567’) address ‘tcp://172.30.200.46:4567’ points to own listening address, blacklisting
2014-11-14 14:27:20 17138 [Note] WSREP: (4093e6a1, ‘tcp://0.0.0.0:4567’) address ‘tcp://172.30.200.46:4567’ pointing to uuid 4093e6a1 is blacklisted, skipping
2014-11-14 14:27:20 17138 [Note] WSREP: (4093e6a1, ‘tcp://0.0.0.0:4567’) turning message relay requesting on, nonlive peers:
2014-11-14 14:27:21 17138 [Note] WSREP: gcomm: connected
2014-11-14 14:27:21 17138 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2014-11-14 14:27:21 17138 [Note] WSREP: Shifting CLOSED → OPEN (TO: 0)
2014-11-14 14:27:21 17138 [Note] WSREP: Opened channel ‘mysqldevcluster1’
2014-11-14 14:27:21 17138 [Note] WSREP: declaring 193c05ce at tcp://172.30.200.45:4567 stable
2014-11-14 14:27:21 17138 [Note] WSREP: Waiting for SST to complete.
2014-11-14 14:27:21 17138 [Note] WSREP: Node 193c05ce state prim
2014-11-14 14:27:21 17138 [Note] WSREP: save pc into disk
2014-11-14 14:27:21 17138 [Note] WSREP: discarding pending addr without UUID: tcp://172.30.200.47:4567
2014-11-14 14:27:21 17138 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my\_idx = 1, memb\_num = 2
2014-11-14 14:27:21 17138 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2014-11-14 14:27:21 17138 [Note] WSREP: STATE EXCHANGE: sent state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147
2014-11-14 14:27:21 17138 [Note] WSREP: STATE EXCHANGE: got state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147 from 0 (ldvdbamycl01.itap.purdue.edu)
2014-11-14 14:27:21 17138 [Note] WSREP: STATE EXCHANGE: got state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147 from 1 (ldvdbamycl02.itap.purdue.edu)
2014-11-14 14:27:21 17138 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf\_id = 3,
members = 1/2 (joined/total),
act\_id = 5,
last\_appl. = -1,
protocols = 0/6/3 (gcs/repl/appl),
group UUID = 58051e6b-6921-11e4-ab0b-a2658d23b81b
2014-11-14 14:27:21 17138 [Note] WSREP: Flow-control interval: [23, 23]
2014-11-14 14:27:21 17138 [Note] WSREP: Shifting OPEN → PRIMARY (TO: 5)
2014-11-14 14:27:21 17138 [Note] WSREP: State transfer required:
Group state: 58051e6b-6921-11e4-ab0b-a2658d23b81b:5
Local state: 00000000-0000-0000-0000-000000000000:-1
2014-11-14 14:27:21 17138 [Note] WSREP: New cluster view: global state: 58051e6b-6921-11e4-ab0b-a2658d23b81b:5, view# 4: Primary, number of nodes: 2, my index: 1, protocol version 3
2014-11-14 14:27:21 17138 [Warning] WSREP: Gap in state sequence. Need state transfer.
2014-11-14 14:27:21 17138 [Note] WSREP: Running: 'wsrep\_sst\_rsync --role ‘joiner’ --address ‘172.30.200.46’ --auth ‘sstuser:xxxxx’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/my.cnf’ --parent ‘17138’ ‘’ ’
WSREP\_SST: [ERROR] rsync daemon port ‘4444’ has been taken (20141114 14:27:21.093)
WSREP\_SST: [INFO] Joiner cleanup. (20141114 14:27:21.094)
WSREP\_SST: [INFO] Joiner cleanup done. (20141114 14:27:21.098)
2014-11-14 14:27:21 17138 [ERROR] WSREP: Failed to read ‘ready ’ from: wsrep\_sst\_rsync --role ‘joiner’ --address ‘172.30.200.46’ --auth ‘sstuser:xxxxx’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/my.cnf’ --parent ‘17138’ ‘’
Read: ‘(null)’
2014-11-14 14:27:21 17138 [ERROR] WSREP: Process completed with error: wsrep\_sst\_rsync --role ‘joiner’ --address ‘172.30.200.46’ --auth ‘sstuser:xxxxxx’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/my.cnf’ --parent ‘17138’ ‘’ : 16 (Device or resource busy)
2014-11-14 14:27:21 17138 [ERROR] WSREP: Failed to prepare for ‘rsync’ SST. Unrecoverable.
2014-11-14 14:27:21 17138 [ERROR] Aborting
.
. (more NOTEs)
.
2014-11-14 14:27:24 17138 [Note] WSREP: Closing slave action queue.
2014-11-14 14:27:24 17138 [Note] WSREP: Service disconnected.
2014-11-14 14:27:24 17138 [Note] WSREP: rollbacker thread exiting
2014-11-14 14:27:25 17138 [Note] WSREP: Some threads may fail to exit.
2014-11-14 14:27:25 17138 [Note] Binlog end
2014-11-14 14:27:25 17138 [Note] /opt/mysql/Percona-XtraDB-Cluster-5.6.20-rel68.0-25.7.886.Linux.x86\_64/bin/mysqld: Shutdown complete
Error in my\_thread\_global\_end(): 1 threads didn’t exit
141114 14:27:30 mysqld\_safe mysqld from pid file /var/lib/mysql/ldvdbamycl02.itap.purdue.edu.pid ended
==================================================
The error log on the 1st node indicates that it’s receiving something from the 2nd node:
2014-11-14 14:27:20 6163 [Note] WSREP: (193c05ce, ‘tcp://0.0.0.0:4567’) turning message relay requesting on, nonlive peers:
2014-11-14 14:27:21 6163 [Note] WSREP: declaring 4093e6a1 at tcp://172.30.200.46:4567 stable
2014-11-14 14:27:21 6163 [Note] WSREP: Node 193c05ce state prim
2014-11-14 14:27:21 6163 [Note] WSREP: save pc into disk
2014-11-14 14:27:21 6163 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my\_idx = 0, memb\_num = 2
2014-11-14 14:27:21 6163 [Note] WSREP: STATE\_EXCHANGE: sent state UUID: 40e2efd1-6c34-11e4-bb08-267a0fbc3147
2014-11-14 14:27:21 6163 [Note] WSREP: STATE EXCHANGE: sent state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147
2014-11-14 14:27:21 6163 [Note] WSREP: STATE EXCHANGE: got state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147 from 0 (ldvdbamycl01.itap.purdue.edu)
2014-11-14 14:27:21 6163 [Note] WSREP: STATE EXCHANGE: got state msg: 40e2efd1-6c34-11e4-bb08-267a0fbc3147 from 1 (ldvdbamycl02.itap.purdue.edu)
2014-11-14 14:27:21 6163 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf\_id = 3,
members = 1/2 (joined/total),
act\_id = 5,
last\_appl. = 0,
protocols = 0/6/3 (gcs/repl/appl),
group UUID = 58051e6b-6921-11e4-ab0b-a2658d23b81b
2014-11-14 14:27:21 6163 [Note] WSREP: Flow-control interval: [23, 23]
2014-11-14 14:27:21 6163 [Note] WSREP: New cluster view: global state: 58051e6b-6921-11e4-ab0b-a2658d23b81b:5, view# 4: Primary, number of nodes: 2, my index: 0, protocol version 3
2014-11-14 14:27:21 6163 [Note] WSREP: wsrep\_notify\_cmd is not defined, skipping notification.
2014-11-14 14:27:21 6163 [Note] WSREP: REPL Protocols: 6 (3, 2)
2014-11-14 14:27:21 6163 [Note] WSREP: Service thread queue flushed.
2014-11-14 14:27:21 6163 [Note] WSREP: Assign initial position for certification: 5, protocol version: 3
2014-11-14 14:27:21 6163 [Note] WSREP: Service thread queue flushed.
2014-11-14 14:27:23 6163 [Note] WSREP: (193c05ce, ‘tcp://0.0.0.0:4567’) turning message relay requesting off
2014-11-14 14:27:24 6163 [Note] WSREP: forgetting 4093e6a1 (tcp://172.30.200.46:4567)
2014-11-14 14:27:24 6163 [Note] WSREP: Node 193c05ce state prim
2014-11-14 14:27:24 6163 [Note] WSREP: save pc into disk
2014-11-14 14:27:24 6163 [Note] WSREP: forgetting 4093e6a1 (tcp://172.30.200.46:4567)
2014-11-14 14:27:24 6163 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my\_idx = 0, memb\_num = 1
2014-11-14 14:27:24 6163 [Note] WSREP: STATE\_EXCHANGE: sent state UUID: 42b34e55-6c34-11e4-903d-77406d125f6b
2014-11-14 14:27:24 6163 [Note] WSREP: STATE EXCHANGE: sent state msg: 42b34e55-6c34-11e4-903d-77406d125f6b
2014-11-14 14:27:24 6163 [Note] WSREP: STATE EXCHANGE: got state msg: 42b34e55-6c34-11e4-903d-77406d125f6b from 0 (ldvdbamycl01.itap.purdue.edu)
2014-11-14 14:27:24 6163 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf\_id = 4,
members = 1/1 (joined/total),
act\_id = 5,
last\_appl. = 0,
protocols = 0/6/3 (gcs/repl/appl),
group UUID = 58051e6b-6921-11e4-ab0b-a2658d23b81b
2014-11-14 14:27:24 6163 [Note] WSREP: Flow-control interval: [16, 16]
2014-11-14 14:27:24 6163 [Note] WSREP: New cluster view: global state: 58051e6b-6921-11e4-ab0b-a2658d23b81b:5, view# 5: Primary, number of nodes: 1, my index: 0, protocol version 3
2014-11-14 14:27:24 6163 [Note] WSREP: wsrep\_notify\_cmd is not defined, skipping notification.
2014-11-14 14:27:24 6163 [Note] WSREP: REPL Protocols: 6 (3, 2)
2014-11-14 14:27:24 6163 [Note] WSREP: Service thread queue flushed.
2014-11-14 14:27:24 6163 [Note] WSREP: Assign initial position for certification: 5, protocol version: 3
2014-11-14 14:27:24 6163 [Note] WSREP: Service thread queue flushed.
2014-11-14 14:27:29 6163 [Note] WSREP: cleaning up 4093e6a1 (tcp://172.30.200.46:4567)
====================================================
Any suggestions?
---
### Author:  [@dpwhite](https://forums.percona.com/u/dpwhite)
#### Post date: [November 14, 2014, 4:34pm UTC](https://forums.percona.com/t/install-failing-on-2nd-node/3884/2 "2014-11-14T16:34:06Z")
Nevermind. I found out that socat was already using port 4444. I killed that process and it started fine!