# Percona 8.x cluster nodes dropping out unknown as to why **URL:** \ **Category:** Percona XtraDB Cluster 8.x\ **Created:** [July 24, 2024, 1:54pm UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792 "2024-07-24T13:54:04Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![jasonfe33](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@jasonfe33](https://forums.percona.com/u/jasonfe33)\ **Post date:** [July 24, 2024, 1:54pm UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792/1 "2024-07-24T13:54:04Z")
Hello, So, we had this issue a few years back and I don’t actually know what the fix ever was. We have a 3 node cluster and all nodes are in sync then we get an influx of requests in a minute to our website and then for whatever reason 2 of the nodes fall out of the cluster. Simply stopping and starting mysql seems to bring things back to normal and cluster is synced up again. Just looking as to what to check for this behavior? I am not the Mysql admin or site admin but wanted to get some insight as what I can give them to check. percona-xtradb-cluster-8.0.27-18.1.el7.x86\_64 Thank you in advance! ---
**Author:** ![Tibor\_Korocz\_Percona](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/tibor_korocz_percona/32/17251_2.png) [@Tibor\_Korocz\_Percona](https://forums.percona.com/u/Tibor_Korocz_Percona)\ **Post date:** [July 25, 2024, 8:16am UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792/2 "2024-07-25T08:16:50Z")
Hi, What would be helpful if you could show us the mysql error logs from all 3 nodes from the time when the issue was happening. Thanks. ---
**Author:** ![jasonfe33](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@jasonfe33](https://forums.percona.com/u/jasonfe33)\ **Post date:** [July 25, 2024, 9:57pm UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792/3 "2024-07-25T21:57:54Z")
@Tibor_Korocz_Percona Checking for log files here. I’ll post back tomorrow with info. I’m not sure our timing is correct but I believe it is. Or is there a specific line i’m looking for in the error.log that would indicate the nodes sudden non sync status from cluster? when checking cluster status on the 2 nodes that dropped they showed “inconsistent” for wsrep\_local\_state\_comment and cluster size 0 and no wsrep\_incoming\_addresses. The 1 node that was alive showed wsrep\_local\_state\_comment at Synced and then incoming address of itself and cluster size of 1. ---
**Author:** ![jasonfe33](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@jasonfe33](https://forums.percona.com/u/jasonfe33)\ **Post date:** [July 31, 2024, 1:34pm UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792/5 "2024-07-31T13:34:14Z")
Hello, Just checking if these logs show anything that would invoke a node to becoming “inconsistent” when viewing cluster status from the node? Maybe that doesn’t mean they are out of the cluster but rather being an inconsistent state will not show cluster status correctly? Looking for some smoking gun here to help prevent this from happening again. Thank you! ---
**Author:** ![jasonfe33](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@jasonfe33](https://forums.percona.com/u/jasonfe33)\ **Post date:** [July 31, 2024, 3:45pm UTC](https://forums.percona.com/t/percona-8-x-cluster-nodes-dropping-out-unknown-as-to-why/31792/6 "2024-07-31T15:45:01Z")
I think I had wrong timing of the logs I had posted before so will repost here soon. We actually had this issue this morning and I have found the logs that hopefully will show what is happening and why. Thank you for your patience.