# Percona xtradb Cluster 5.6 for Disaster Recovery on LAN/WAN problems **URL:** \ **Category:** Percona XtraDB Cluster 5.x\ **Created:** [February 20, 2018, 6:27am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204 "2018-02-20T06:27:09Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [February 20, 2018, 6:27am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/1 "2018-02-20T06:27:09Z")
Hi, we have a Percona XtraDB Cluster with 3 nodes on our environment. We need to create other two Disaster Recovery Percona XtraDB Clusters starting from first Cluster, so we decide to use the MySQL replication from one node of first Cluster to the first node of the second Cluster, we know that we can have that node out from Cluster, but we don’t know other way to do it. So this is that we would like to have (or if there is another way, we would like to know) Cluster One Node 1 (Master) , Node 2 (Master), Node 3 (Master, Master for second Percona Cluster) Cluster Two Node 1 (Master, Slave of first Percona Cluster) Node 2 (Master) Node 3 (Master, Master for third Percona Cluster) Cluster Three Node 1 (Master, Slave of second Percona Cluster) Node 2 (Master) Node 3 (Master) The node 3 of first and second Cluster have log\_slave\_updates = 1 else we had inconsistence data replication on the first node of DR Clusters (error on updates records, not found). After setting up the first node of the second Cluster like Slave, we started Percona XtraDB cluster on the other two nodes and all seemed right, all the 3 nodes were synced, updates seemed to work with no problems. But we discovered that when we are adding a new user/grant on the first Cluster, it is only replicated on the Slave of the second Cluster, but not on the other Cluster nodes of second Cluster, we have verified that also on the third Cluster no user/grant was created (because data was not existing on the node 3 of second Cluster). Is there a way to fix it ? Is it a bug ? Is there a best practice to do Disaster Recovery on N (2 or mote) Percona XtraDB Clusters ? Thanks for your time and best regards. Claudio ---
**Author:** ![lorraine.pocklington](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/lorraine.pocklington/32/37_2.png) [@lorraine.pocklington](https://forums.percona.com/u/lorraine.pocklington)\ **Post date:** [February 20, 2018, 6:43am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/2 "2018-02-20T06:43:09Z")
Hi, would just like to quickly check if you saw this page on limitations? Just want to make sure that the first paragraph doesn’t apply in your case. [url][Redirecting](https://www.percona.com/doc/percona-xtradb-cluster/LATEST/limitation.html%5B/url%5D) ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [February 20, 2018, 8:04am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/3 "2018-02-20T08:04:51Z")
Hi lorraine, yes i know the limitation page, but i used CREATE USER command that would works in multi-master environment, infact it works on the First Cluster, works on the First node of Second Cluster but not on the other nodes of second Cluster. We use innoDB and we have on all nodes default\_storage\_engine = InnoDB enforce\_storage\_engine = InnoDB innodb\_autoinc\_lock\_mode = 2 (on all nodes of three Clusters) binlog\_format = ROW wsrep\_replicate\_myisam = ON Anyway i forgot to mention that, the user/grant is not replicated but the Cluster shows all the nodes in sync and at the same level. This is the strange thing, i was thinking to have not synced nodes, if something is not supported. Claudio ---
**Author:** ![Kenn\_Takara](https://avatars.discourse-cdn.com/v4/letter/k/b2d939/32.png) [@Kenn\_Takara](https://forums.percona.com/u/Kenn_Takara)\ **Post date:** [February 21, 2018, 4:12am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/4 "2018-02-21T04:12:12Z")
Hi Claudio, I’ve created a bug in jira (our bug-tracking system for this issue). I’ll be trying to see if I can repro this behavior. [url][[PXC-2064] PXC 5.6: CREATE USER fails to replicate to replicas - Percona JIRA](https://jira.percona.com/browse/PXC-2064%5B/url%5D) I have some questions (1) What’s the exact version of PXC that you are using? you can run “SELECT @@version” to check (2) What version of linux are you running? (3) Can you provide the cnf files for the nodes? You can also check the logs to see if there are any errors with the CREATE USER. ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [February 21, 2018, 8:19am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/5 "2018-02-21T08:19:52Z")
Hi Kenn, these are the infos you asked for 1: mysql\> SELECT @@version; ±-------------------+ | @@version | ±-------------------+ | 5.6.38-83.0-56-log | ±-------------------+ 1 row in set (0.00 sec) 2: more /etc/redhat-release CentOS Linux release 7.4.1708 (Core) 3: i attached the config files for nodes of Cluster1 and Cluster2 On the cluster1-node1 i issued mysql\> create user ‘sst\_test2’@‘localhost’ IDENTIFIED BY ‘password’; Query OK, 0 rows affected (0.00 sec) In /var/log/messages of - cluster1-node1 (where the data is created) - cluster2-node1 (which is the slave and the data is replicated) - cluster2-node2 (which is the 2nd master, where the data is not replicated) we can’t find any messages. Hope it can help you Claudio [config\_file.zip](https://forums.percona.com/uploads/short-url/46BBT7jzanYBgYamLcLlRF2zRmf.zip) (8.43 KB) ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [February 21, 2018, 9:34am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/6 "2018-02-21T09:34:33Z")
I add that the cluster2-node3 is the master for the cluster3 where node1 will be the slave and the other nodes will be masters Claudio ---
**Author:** ![Kenn\_Takara](https://avatars.discourse-cdn.com/v4/letter/k/b2d939/32.png) [@Kenn\_Takara](https://forums.percona.com/u/Kenn_Takara)\ **Post date:** [February 22, 2018, 8:46pm UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/7 "2018-02-22T20:46:09Z")
I have found a workaround, you will have to enable log-slave-updates on both ends of the async channels. So, in your setup, enable log-slave-updates on cluster1-node3 async-master cluster2-node1 async-slave cluster2-node3 async-master cluster3-node1 async-slave Enabling log-slave-updates on the async-master nodes allows the CREATE USER to replicate from galera to the async channel. Enabling log-slave-updates on the async-slave nodes allows the CREATE USER to replicate from the async channel to galera Note that the config files provided have log-slave-updates enabled on the async master nodes, not the async slave nodes. I have not fully tested this (just looked at CREATE USER), so you will have to ensure that things are working correctly for your setup. ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [February 27, 2018, 10:02am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/8 "2018-02-27T10:02:19Z")
Hi kenn we added the log\_slave\_updates = 1 like you recomended but as soon as we have done it, we got with the command SHOW SLAVE STATUS \G; the following sql error in the Last\_SQL\_Error field Could not execute Write\_rows event on table XXXX.j3\_2017\_session; Got error 122 from storage engine, Error\_code: 1030; handler error No Error!; the event’s master log master3-bin.000063, end\_log\_pos 137918825 so the slave results out of sync from master Let us know if you have some hints. Thanks Claudio ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [March 1, 2018, 8:30am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/9 "2018-03-01T08:30:07Z")
Hi kenn, we have updated today at the last version 5.6.39-26.25 hoping the bug was solved, but instead it is still not fixed. And adding log\_slave\_updates=1 on the async-slave too break the mysql replication from master to slave node for commands that DELETE ROWS with the following error Could not execute Delete\_rows event on table XXXX\_j3.qf4rl\_session; Got error -1 from storage engine, Error\_code: 1030; handler error No Error!; the event’s master log master3-bin.000066, end\_log\_pos 43204831 Hope it will be fixed as soon as possible, because a Disaster Recovery in this way is not possible. Thanks for your time Claudio ---
**Author:** ![soprano](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@soprano](https://forums.percona.com/u/soprano)\ **Post date:** [April 6, 2018, 2:41am UTC](https://forums.percona.com/t/percona-xtradb-cluster-5-6-for-disaster-recovery-on-lan-wan-problems/6204/10 "2018-04-06T02:41:29Z")
Hi all, i solved my problem following the new documentation at [url][https://www.percona.com/blog/2018/03/19/percona-xtradb-cluster-mysql-asynchronous-replication-and-log-slave-updates/[/url]](https://www.percona.com/blog/2018/03/19/percona-xtradb-cluster-mysql-asynchronous-replication-and-log-slave-updates/%5B/url%5D) all nodes of the first, second and third PXC must have log\_slave\_updates=1 in this way the replication works, no more create user problems from any nodes of first PXC Thanks Ken Claudio