# Stateful service time out if one of Node is down

**URL:** <https://forums.percona.com/t/stateful-service-time-out-if-one-of-node-is-down/7691>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [June 17, 2020, 8:01am UTC](https://forums.percona.com/t/stateful-service-time-out-if-one-of-node-is-down/7691 "2020-06-17T08:01:44Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![imranrazakhan](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/imranrazakhan/32/1345_2.png) [@imranrazakhan](https://forums.percona.com/u/imranrazakhan)\
**Post date:** [June 17, 2020, 8:01am UTC](https://forums.percona.com/t/stateful-service-time-out-if-one-of-node-is-down/7691/1 "2020-06-17T08:01:44Z")

</div>

I am&nbsp; evaluating DataBase solution for my kubernetes cluster, So i installed&nbsp;percona-xtradb-cluster with three replica. To analyze failure situation i shutdown one node and meanwhile my test pods is reading data after every 5 seconds from DB Cluster but i observed out of 10 request 1 or 2 are getting timeout by saying “ERROR 2003 (HY000) Cant connect to MySQL Server on ‘pxc’ (110)” , if i further down another node which mean only one node is up error percentage is about 60% which out of 10 only 4 are successful

- I tried by adding PodDisruptionBudget with minAvailable: 1  
- I tried by creating NodePort and infact this is also showing intermittent behavior mean if i directly try on specific node it some time time out.

Is it due to StatefulSet or something else is wrong?&nbsp; If we have these issues how come its production ready?  
  
One more Observation, if i shutdown primary node then it doesn’t work whole cluster is unavailable, infact&nbsp; still two nodes are up  
  
2020-06-17T13:18:49.027004Z 0 [Note] WSREP: (0c831c98, ‘tcp://0.0.0.0:4567’) reconnecting to d4b530ac (tcp://10.244.2.1:4567), attempt 24002020-06-17T13:18:52.027693Z 0 [Note] WSREP: (0c831c98, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.244.2.1:4567 timed out, no messages seen in PT3S2020-06-17T13:18:56.028533Z 0 [Note] WSREP: (0c831c98, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.244.2.1:4567 timed out, no messages seen in PT3S
