# New Cluster locked after starting second node

**URL:** <https://forums.percona.com/t/new-cluster-locked-after-starting-second-node/2474>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [September 14, 2012, 4:06pm UTC](https://forums.percona.com/t/new-cluster-locked-after-starting-second-node/2474 "2012-09-14T16:06:21Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![shahbour](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/shahbour/32/887_2.png) [@shahbour](https://forums.percona.com/u/shahbour)\
**Post date:** [September 14, 2012, 4:06pm UTC](https://forums.percona.com/t/new-cluster-locked-after-starting-second-node/2474/1 "2012-09-14T16:06:21Z")

</div>

Hello

I am trying to move our database 270 GB to a new cluster .

To do this i installed a 3 node cluster runnign centos6 and xtradb cluster and every thing worked fine .

Then i shut down the 3 nodes and did xtradbbackup from our old server and started the first node then configured it as slave to keep data up to date and every thing worked fine.

Then i started the second node and it started to do State transfer but as soon as the transfer is done and mysql started on second node both nodes enter a dead zone i think and both got locked.

i can’t do any command on both when try to do use database on second node i got unkown command !!! , also on first node i tried to do stop slave but it stuck untill i did /etc/init.d/mysql stop on second node so it was freed and continued normally but still second node was stuck the in the shutdown process at

120914 21:20:22 [Note] WSREP: recv\_thread() joined.  
120914 21:20:22 [Note] WSREP: Closing slave action queue.

so i am very confused why the nodes works fine before copying out database but as soon as i copy our database some thing goes wrong and it is not saying what it is about.

Update:

I think i am having a split brain here , so i will try now to stop the replication to have time to start both node02 and node03 . and we will see how it goes.

Any idea how to be able to start node02 and node03 whithout having to step into split brain, knowing that when i start node02 i directly go into this state without even doing any query on the system.

Any Ideas  
BR  
Shahbour

---

<div class="post-metadata">

**Author:** ![shahbour](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/shahbour/32/887_2.png) [@shahbour](https://forums.percona.com/u/shahbour)\
**Post date:** [September 16, 2012, 2:31am UTC](https://forums.percona.com/t/new-cluster-locked-after-starting-second-node/2474/2 "2012-09-16T02:31:37Z")

</div>

Hello

I did start the three nodes but still after running the start slave by 3 min the got stuck.

I was able to do select on all three but not any insert or update.

I checked the wsrep and the were all ready and sync .

when running SHOW FULL PROCESSLIST; on the second node it showes the below ?/

Any Idea ?

mysql\> SHOW FULL PROCESSLIST;  
±—±------------±----------±-----±--------±------±-- ---------------------------------------±------------------- —±----------±--------------±----------+  
| Id | User | Host | db | Command | Time | State | Info | Rows\_sent | Rows\_examined | Rows\_read |  
±—±------------±----------±-----±--------±------±-- ---------------------------------------±------------------- —±----------±--------------±----------+  
| 1 | system user | | NULL | Sleep | 70948 | applied write set 3178572 | NULL | 0 | 0 | 1 |  
| 2 | system user | | NULL | Sleep | 2431 | wsrep aborter idle | NULL | 0 | 0 | 1 |  
| 3 | system user | | NULL | Sleep | 70948 | Delete\_rows\_log\_event::find\_row(3178571) | NULL | 0 | 0 | 1 |  
| 5 | root | localhost | NULL | Query | 0 | sleeping | SHOW FULL PROCESSLIST | 0 | 0 | 1 |  
±—±------------±----------±-----±--------±------±-- ---------------------------------------±------------------- —±----------±--------------±----------+  
4 rows in set (0.00 sec)

Any idea ?

---

<div class="post-metadata">

**Author:** ![shahbour](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/shahbour/32/887_2.png) [@shahbour](https://forums.percona.com/u/shahbour)\
**Post date:** [September 17, 2012, 1:43am UTC](https://forums.percona.com/t/new-cluster-locked-after-starting-second-node/2474/3 "2012-09-17T01:43:09Z")

</div>

Hello

It seems second node is taking too much time in running

Delete\_rows\_log\_event::find\_row(18003806)

what is this and why it is locking every thing.

BR  
Shahbour