3 node cluster - gracefully shutdown ALL nodes - cluster fail to start

[danielm]

Hi,

Ubuntu 12
Percona Cluster 5.6

Selinux (not applied to Ubuntu), ApArmor - disabled

Does it true that due normal (gracefully) server shutdown
(all nodes) I need to do

bootstrap-pxc

If true, how can I determine which node has latest data ?

For now I didn’t find any other method to bring cluster online.

Thanks in advanced…
Daniel

[jrivera]

Hi,

You don’t have to bootstrap each node after a graceful shutdown of all pxc nodes in a cluster. All you have to do is first identify the node with the most advanced data and then bootstrap that node and then the rest of the nodes you can start as usual.

You may refer to the following documentation:
http://www.percona.com/doc/percona-xtradb-cluster/5.5/manual/restarting_nodes.html
http://galeracluster.com/documentation-webpages/restartingacluster.html

[danielm]

Hi,

Thanks a lot for answer. Intersiting thing in my case is
all nodes have the same entry:

@wp01:/var/lib/mysql# cat grastate.dat

GALERA saved state

version: 2.1
uuid: e0e86b14-fdfe-11e3-95f7-de5f58d5c277
seqno: -1
cert_index:

@wp02:/var/lib/mysql# cat grastate.dat

GALERA saved state

version: 2.1
uuid: e0e86b14-fdfe-11e3-95f7-de5f58d5c277
seqno: -1
cert_index:

@wp03:/var/lib/mysql# cat grastate.dat

GALERA saved state

version: 2.1
uuid: e0e86b14-fdfe-11e3-95f7-de5f58d5c277
seqno: -1
cert_index:

All nodes was closed by

#shutdown -h now

[cetanhota]

Since all your nodes are showing a seqno as -1 you will need to do a wsrep-recover to see which node has the most current data. You can use wsrep-recover like this.

mysqld --wsrep-recover

Mysql will startup and then shutdown it will record the needed information in your mysqld.log file.

Look at your mysql log file to see which machine has the highest seqno. This would be the node you want to bootstrap. In your log file you will see something like this:

140721 12:00:00 [Note] WSREP: Recovered position UUID:seqno