# New Node4 Joining Erorrs and 32 Broken pipes

**URL:** <https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [November 3, 2017, 4:34am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974 "2017-11-03T04:34:21Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Daniel\_Newman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/daniel_newman/32/1194_2.png) [@Daniel\_Newman](https://forums.percona.com/u/Daniel_Newman)\
**Post date:** [November 3, 2017, 4:34am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/1 "2017-11-03T04:34:21Z")

</div>

First of all let me thank you for the great product you’ve creating each day for people like me and businesses.

I’ve got an Percona XDB Cluster with such scheme ( [url][https://i.imgur.com/P1YQbDc.png[/url]](https://i.imgur.com/P1YQbDc.png%5B/url%5D) ):

We have lost PXC3 and now trying to rebuild Cluster with new node PXC4 and have no success. PXC2 aka PXC7 also was estored some times ago but with no problem at all.

For now we have got some failures we don’t know how to fix:

```auto

[B]-wsrep-sst-joiner: *******************FATAL ERROR**********************
-wsrep-sst-joiner: Error while getting data from donor node: exit codes: 143 143
-wsrep-sst-joiner: ******************************************************
-wsrep-sst-joiner: Cleanup after exit with status:32[/B]

```

and

```auto
[B]WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)
WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():765: Will never receive state. Need to abort.[/B]

```

and

```auto
[B]polkitd[656]: Unregistered Authentication Agent for unix-process:13754:5709648

```

[/B]

and

```auto
[B]WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'px1.px1.px1.px1:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105267': 32 (Broken pipe)
WSREP: Command did not run: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'px1.px1.px1.px1:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '3aaca81d-8d1e-11e5-bf0e-aaeab5da33b6:401105267'
WSREP: 0.0 (PXC2): State transfer to 2.0 (PXC4) failed: -32 (Broken pipe)[/B]

```

There is a logs for all active nodes in cluster below.

Please, help us to bring the PXC4 node up and resolve the problem we own).

Text limitation (10k chars vs 40k chars we have) not allowing me to share logs here.  
[url][https://justpaste.it/1d46l[/url]](https://justpaste.it/1d46l%5B/url%5D)

---

<div class="post-metadata">

**Author:** ![krunalbauskar](https://avatars.discourse-cdn.com/v4/letter/k/439d5e/32.png) [@krunalbauskar](https://forums.percona.com/u/krunalbauskar)\
**Post date:** [November 6, 2017, 1:42am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/2 "2017-11-06T01:42:24Z")

</div>

From the said text it sounds like joiner made an exit before donor could donate. To find the exact cause we would need complete log files from donor and joiner. You can attached them as attachment.

---

<div class="post-metadata">

**Author:** ![Daniel\_Newman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/daniel_newman/32/1194_2.png) [@Daniel\_Newman](https://forums.percona.com/u/Daniel_Newman)\
**Post date:** [November 6, 2017, 3:39pm UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/3 "2017-11-06T15:39:23Z")

</div>

Logs attachment

[Pxc Nodes Logs.docx](https://forums.percona.com/uploads/short-url/iRltPIjLG3p6Cv3ANvLybjJ8UEo.docx) (11.2 KB)

---

<div class="post-metadata">

**Author:** ![Daniel\_Newman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/daniel_newman/32/1194_2.png) [@Daniel\_Newman](https://forums.percona.com/u/Daniel_Newman)\
**Post date:** [November 6, 2017, 3:43pm UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/4 "2017-11-06T15:43:54Z")

</div>

Scheme attachment

 ![photoid=50004](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/2X/0/09522248f6664cb4a24400a586d72e6ae0d3babe.png)

---

<div class="post-metadata">

**Author:** ![Daniel\_Newman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/daniel_newman/32/1194_2.png) [@Daniel\_Newman](https://forums.percona.com/u/Daniel_Newman)\
**Post date:** [November 8, 2017, 12:39am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/5 "2017-11-08T00:39:45Z")

</div>

Problem can be resolved with downgrade PXC4 (4th Node) to the same XtraDB version as a donor.

---

<div class="post-metadata">

**Author:** ![Daniel\_Newman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/daniel_newman/32/1194_2.png) [@Daniel\_Newman](https://forums.percona.com/u/Daniel_Newman)\
**Post date:** [November 8, 2017, 12:41am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/6 "2017-11-08T00:41:05Z")

</div>

Is there any other way to make different XDB version to work together or futher compotability requirements?

---

<div class="post-metadata">

**Author:** ![krunalbauskar](https://avatars.discourse-cdn.com/v4/letter/k/439d5e/32.png) [@krunalbauskar](https://forums.percona.com/u/krunalbauskar)\
**Post date:** [November 13, 2017, 12:39am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/7 "2017-11-13T00:39:47Z")

</div>

Cluster can have different version of PXC nodes (mix and match of 5.6 and 5.7 nodes)

Though this is not recommended or best way to operate given following incompatibilities:

- If 5.6 node act as donor to 5.7 node then MySQL recommends running mysql\_upgrade (SST script doesn’t do it automatically).
- If 5.7 node act as donor to 5.6 node then 5.7-data-directory may not be compatible with 5.6 binary.

Also, slowest node define the performance. 5.6 PXC nodes doesn’t have performance optimization so complete cluster performance may look bad.

I would strongly recommend moving all your nodes to 5.7.19.

---

<div class="post-metadata">

**Author:** ![jdanilson](https://avatars.discourse-cdn.com/v4/letter/j/df705f/32.png) [@jdanilson](https://forums.percona.com/u/jdanilson)\
**Post date:** [March 28, 2019, 9:12am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/8 "2019-03-28T09:12:00Z")

</div>

So frustrating. Found SST failing between 5.7.22 (donor) and 5.7.21 (joiner). my sysadmin and network guys pulling hair out as we all thought it was blocked ports. Maybe this post will help someone. No clue in the log, just  
Error while getting data from donor node: exit codes: 143 143 and even less on donor. wsrep\_debug gave no further info either.

---

<div class="post-metadata">

**Author:** ![lorraine.pocklington](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/lorraine.pocklington/32/37_2.png) [@lorraine.pocklington](https://forums.percona.com/u/lorraine.pocklington)\
**Post date:** [March 28, 2019, 9:35am UTC](https://forums.percona.com/t/new-node4-joining-erorrs-and-32-broken-pipes/5974/9 "2019-03-28T09:35:56Z")

</div>

Hi there, are you needing ongoing help, or confirming that your issue is resolved? Only if there’s still an ongoing problem I’ll need to get you to open a new post, these older ones don’t tend to be revisited. Let me know?
