# 3rd node cannot be started after restart (power off and power on).

**URL:** <https://forums.percona.com/t/3rd-node-cannot-be-started-after-restart-power-off-and-power-on/5277>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [December 9, 2016, 1:56pm UTC](https://forums.percona.com/t/3rd-node-cannot-be-started-after-restart-power-off-and-power-on/5277 "2016-12-09T13:56:55Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![porunov](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/porunov/32/1154_2.png) [@porunov](https://forums.percona.com/u/porunov)\
**Post date:** [December 9, 2016, 1:56pm UTC](https://forums.percona.com/t/3rd-node-cannot-be-started-after-restart-power-off-and-power-on/5277/1 "2016-12-09T13:56:55Z")

</div>

Hello,

I have a cluster from 3 nodes. After power off of 3rd node and power on it can not be started.

Here is a status of the node:

# systemctl status mysql

● mysql.service - Percona XtraDB Cluster  
Loaded: loaded (/usr/lib/systemd/system/mysql.service; enabled; vendor preset: disabled)  
Active: activating (start-post) since Fri 2016-12-09 22:39:19 EET; 1h 48min left  
Process: 915 ExecStartPre=/usr/bin/mysql-systemd start-pre (code=exited, status=0/SUCCESS)  
Main PID: 994 (mysqld\_safe); : 995 (mysql-systemd)  
CGroup: /system.slice/mysql.service  
├─ 994 /bin/sh /usr/bin/mysqld\_safe --basedir=/usr  
├─1669 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --wsr…  
└─control  
├─ 995 /bin/bash -ue /usr/bin/mysql-systemd start-post 994  
└─5471 sleep 1

Dec 09 22:39:19 GlusterDC1\_3 systemd[1]: Starting Percona XtraDB Cluster…  
Dec 09 22:39:21 GlusterDC1\_3 mysqld\_safe[994]: 2016-12-09T20:39:21.938827Z mysqld\_safe Logging to ‘/var/log/mysqld.log’.  
Dec 09 22:39:22 GlusterDC1\_3 mysqld\_safe[994]: 2016-12-09T20:39:22.142700Z mysqld\_safe Starting mysqld daemon with databases…/mysql  
Dec 09 22:39:22 GlusterDC1\_3 mysqld\_safe[994]: 2016-12-09T20:39:22.193207Z mysqld\_safe Skipping wsrep-recover for 43de3d74-b…5 pair  
Dec 09 22:39:22 GlusterDC1\_3 mysqld\_safe[994]: 2016-12-09T20:39:22.213707Z mysqld\_safe Assigning 43de3d74-bca8-11e6-a178-57b…sition  
Hint: Some lines were ellipsized, use -l to show in full.

Here is the status of the node after 2 hours:

# systemctl status mysql

● mysql.service - Percona XtraDB Cluster  
Loaded: loaded (/usr/lib/systemd/system/mysql.service; enabled; vendor preset: disabled)  
Active: activating (start-post) since Fri 2016-12-09 21:09:27 EET; 6min ago  
Process: 6370 ExecStopPost=/usr/bin/mysql-systemd stop-post (code=exited, status=0/SUCCESS)  
Process: 6154 ExecStop=/usr/bin/mysql-systemd stop (code=exited, status=2)  
Process: 6400 ExecStartPre=/usr/bin/mysql-systemd start-pre (code=exited, status=0/SUCCESS)  
Main PID: 6441 (mysqld\_safe); : 6442 (mysql-systemd)  
CGroup: /system.slice/mysql.service  
├─6441 /bin/sh /usr/bin/mysqld\_safe --basedir=/usr  
├─6841 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --wsr…  
└─control  
├─6442 /bin/bash -ue /usr/bin/mysql-systemd start-post 6441  
└─8167 sleep 1

Dec 09 21:09:27 GlusterDC1\_3 systemd[1]: mysql.service holdoff time over, scheduling restart.  
Dec 09 21:09:27 GlusterDC1\_3 systemd[1]: Starting Percona XtraDB Cluster…  
Dec 09 21:09:28 GlusterDC1\_3 mysqld\_safe[6441]: 2016-12-09T19:09:28.030105Z mysqld\_safe Logging to ‘/var/log/mysqld.log’.  
Dec 09 21:09:28 GlusterDC1\_3 mysqld\_safe[6441]: 2016-12-09T19:09:28.050046Z mysqld\_safe Starting mysqld daemon with database…/mysql  
Dec 09 21:09:28 GlusterDC1\_3 mysqld\_safe[6441]: 2016-12-09T19:09:28.058749Z mysqld\_safe Skipping wsrep-recover for 43de3d74-…5 pair  
Dec 09 21:09:28 GlusterDC1\_3 mysqld\_safe[6441]: 2016-12-09T19:09:28.060037Z mysqld\_safe Assigning 43de3d74-bca8-11e6-a178-57…sition  
Hint: Some lines were ellipsized, use -l to show in full.

I can not connect to the node. Here is what it says:

# mysql -u root -p

Enter password:  
ERROR 2002 (HY000): Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (2)

Other 2 nodes works fine.

Does somebody know what is the problem?

Sincerely,  
Alexandr

---

<div class="post-metadata">

**Author:** ![przemek](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/przemek/32/3_2.png) [@przemek](https://forums.percona.com/u/przemek)\
**Post date:** [December 19, 2016, 4:37pm UTC](https://forums.percona.com/t/3rd-node-cannot-be-started-after-restart-power-off-and-power-on/5277/2 "2016-12-19T16:37:36Z")

</div>

As said in the newer thread, the MySQL error log would provide more information on the issue - do you have it?