Patching Percona-Xtradb - safe to do and or what procedure should I use?

Hello,
We have some percona clusters and always are hesitant to install any patches for it due to possible DB cluster issues with Percona. Our servers all run Mysql 8. We use Oracle Linux 8.7 and also have an older cluster using 7.9 but both percona environments are using Mysql 8 and Percona XtraDB cluster 8. Would I be ok just pushing the patches normally? I assume it treats these just like any other patch for Linux OS as it takes them on the fly and for the most part does not cause any issues. We reboot as needed if pending reboots post patching.

Here are patches its showing it needs:

percona-xtrabackup-80-8.0.34-29.1.el8.x86_64
percona-xtradb-cluster-8.0.33-25.1.el8.x86_64
percona-xtradb-cluster-client-8.0.33-25.1.el8.x86_64
percona-xtradb-cluster-server-8.0.33-25.1.el8.x86_64
percona-xtradb-cluster-shared-8.0.33-25.1.el8.x86_64
percona-xtradb-cluster-shared-compat-8.0.33-25.1.el8.x86_64

Any help understanding this and patching would help. We do have test environments for clusters we could do this on but wanted to get an idea 1st before I just started installing these.

Thank you!

Hello Jason,

We appreciate you reaching out to us.

The patching activity would probably operate in a similar manner, but there are a few considerations that should be taken into account.

1.This should be carried out in a rolling fashion, starting with the secondary PXC nodes first. Additionally, the database service should be gracefully stopped before rebooting the entire server if necessary.

  1. After completing the patching activity, it is advisable to always verify the MySQL/PXC logs and OS/kernel logs (e.g., /var/log/messages) for any suspicious warnings or errors.

  2. There should be enough gcache size in case of doing any maintenance activity to avoid full SST later on. You can read more about this in the given blogpost:- How to calculate the size of Percona XtraDB Cluster's gcache

  3. If using any middleware like ProxySQL its good to put the concerned node in maintenance mode “set global pxc_maint_mode=maintenance;”. This way, ProxySQL will automatically stop sending new traffic to that node.

  4. Always make sure to read the release notes:- https://dev.mysql.com/doc/relnotes/mysql/8.0/en/news-8-0-33.html to know about the latest changes.

I see you having a higher PXB(8.0.34) version compared to PXC (8.0.33) Please note that starting from version 8.0.22 compatible versions of XtraBackup and MySQL should match to avoid any hidden compatibility issues. We recommend to having the same version for both (PXC & PXB).

percona-xtrabackup-80-8.0.34-29.1.el8.x86_64
percona-xtradb-cluster-8.0.33-25.1.el8.x86_64

Moreover, with respect to PXC8.0.33-25, we see some know issues if using any “Garbd” node in your environment. You may read that in more detail in the given manual- Percona XtraDB Cluster 8.0.33-25 Update (2023-08-25) - Percona XtraDB Cluster

Further, we see in release PXC 8.0.34-26 (2023-11-01) all such concerns were addressed/fixed now:- Percona XtraDB Cluster 8.0.34-26 (2023-11-01) - Percona XtraDB Cluster

Bye the way, exactly what PXC version you are running in your environment?

Regards,
Anil

Hello,

So it seems we have slightly different versions in some of our environments.

Environment 1 - percona-xtradb-cluster-8.0.27-18.1.el8.x86_64
Environment 2 - percona-xtradb-cluster-8.0.27-18.1.el8.x86_64
Environment 3 - percona-xtradb-cluster-8.0.27-18.1.el7.x86_64
Environment 4 - percona-xtradb-cluster-8.0.33-25.1.el8.x86_64
Environment 5 - percona-xtradb-cluster-8.0.26-16.1.el7.x86_64

Hello,

So it seems we have slightly different versions in some of our environments.

Environment 1 - percona-xtradb-cluster-8.0.27-18.1.el8.x86_64
Environment 2 - percona-xtradb-cluster-8.0.27-18.1.el8.x86_64
Environment 3 - percona-xtradb-cluster-8.0.27-18.1.el7.x86_64
Environment 4 - percona-xtradb-cluster-8.0.33-25.1.el8.x86_64
Environment 5 - percona-xtradb-cluster-8.0.26-16.1.el7.x86_64

Okay, thanks for the confirmation.

So, going forward we having a latest PXC release (8.0.34-26) as well which you might considering upgrading from these older versions. You can read more about the fixes/changes in the below release notes.

Furthermore, you can refer to the suggestions we provided earlier.

Regards,
Anil