# One node crashing

**URL:** <https://forums.percona.com/t/one-node-crashing/4034>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [February 2, 2015, 12:37am UTC](https://forums.percona.com/t/one-node-crashing/4034 "2015-02-02T00:37:42Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![greengecko](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/greengecko/32/888_2.png) [@greengecko](https://forums.percona.com/u/greengecko)\
**Post date:** [February 2, 2015, 12:37am UTC](https://forums.percona.com/t/one-node-crashing/4034/1 "2015-02-02T00:37:42Z")

</div>

I have a 4 node cluster, where 3 of the nodes are VPSes in the same data centre, and the fourth node is in the office, which is connected to the internet by fibre, and to the rest of the cluster via OpenVPN.

The VPSes are quad E5620 CPU, 32GB mem, 2TB disk. The dedicated office server is 8 thread i7-4820K CPU, 48GB mem, and runs 3 KVM VPSes as well. All have of the order of 10GB memory unused.

All are running Ubuntu 14.04 LTS, and Percona 5.6.21 ( the latest GHOST vulnerability has been patched on all servers ).

MySQL on the dedicated node has crashed twice over the weekend with the message below.

Could anyone provide any pointers on where to look while I’m working through the manual, or in the meantime indicate how to reverse the message

‘150201 06:11:25 mysqld\_safe WSREP: not restarting wsrep node automatically’ so that it does restart?

Cheers,

Steve

7:11:24 UTC - mysqld got signal 11 ;  
This could be because you hit a bug. It is also possible that this binary  
or one of the libraries it was linked against is corrupt, improperly built,  
or misconfigured. This error can also be caused by malfunctioning hardware.  
We will try our best to scrape up some info that will hopefully help  
diagnose the problem, but since we have already crashed,  
something is definitely wrong and this may fail.  
Please help us make Percona XtraDB Cluster better by reporting any  
bugs at [url][https://bugs.launchpad.net/percona-xtradb-cluster[/url]](https://bugs.launchpad.net/percona-xtradb-cluster%5B/url%5D)

key\_buffer\_size=134217728  
read\_buffer\_size=2097152  
max\_used\_connections=2  
max\_threads=153  
thread\_count=3  
connection\_count=1  
It is possible that mysqld could use up to  
key\_buffer\_size + (read\_buffer\_size + sort\_buffer\_size)\*max\_threads = 603396 K bytes of memory  
Hope that’s ok; if not, decrease some variables in the equation.

Thread pointer: 0x49f4130  
Attempting backtrace. You can use the following information to find out  
where mysqld died. If you see no messages after this, something went  
terribly wrong…  
stack\_bottom = 7fe1d403ee20 thread\_stack 0x30000  
/usr/sbin/mysqld(my\_print\_stacktrace+0x2c)[0x923b1c]  
/usr/sbin/mysqld(handle\_fatal\_signal+0x352)[0x67cac2]  
/lib/x86\_64-linux-gnu/libpthread.so.0(+0x10340)[0x7fe209627340]  
/usr/sbin/mysqld[0xb42ab0]  
/usr/sbin/mysqld(\_ZN11MDL\_context12release\_lockEP10MDL\_ticket+0x4e)[0x66e29e]  
/usr/sbin/mysqld(\_ZN18Global\_backup\_lock7releaseEP3THD+0x1c)[0x66127c]  
/usr/sbin/mysqld(\_ZN3THD7cleanupEv+0xee)[0x6ccb5e]  
/usr/sbin/mysqld(\_ZN3THD17release\_resourcesEv+0x298)[0x6cf988]  
/usr/sbin/mysqld(\_Z29one\_thread\_per\_connection\_endP3THDb+0x2a)[0x5920fa]  
/usr/sbin/mysqld(\_Z24do\_handle\_one\_connectionP3THD+0xf0)[0x6d7840]  
/usr/sbin/mysqld(handle\_one\_connection+0x39)[0x6d7ad9]  
/usr/sbin/mysqld(pfs\_spawn\_thread+0x140)[0xb41570]  
/lib/x86\_64-linux-gnu/libpthread.so.0(+0x8182)[0x7fe20961f182]  
/lib/x86\_64-linux-gnu/libc.so.6(clone+0x6d)[0x7fe208b2c00d]

Trying to get some variables.  
Some pointers may be invalid and cause the dump to abort.  
Query (0): is an invalid pointer  
Connection ID (thread ID): 196  
Status: KILL\_CONNECTION

You may download the Percona XtraDB Cluster operations manual by visiting  
[url][http://www.percona.com/software/percona-xtradb-cluster/[/url]](http://www.percona.com/software/percona-xtradb-cluster/%5B/url%5D). You may find information  
in the manual which will help you identify the cause of the crash.

---

<div class="post-metadata">

**Author:** ![przemek](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/przemek/32/3_2.png) [@przemek](https://forums.percona.com/u/przemek)\
**Post date:** [February 11, 2015, 3:31am UTC](https://forums.percona.com/t/one-node-crashing/4034/2 "2015-02-11T03:31:44Z")

</div>

Can you post here the full error log, or at least some time before it crashed?  
I wonder if this crashed node was a SST donor just before it crashed?
