Cluster fails during PTOSC

Hi, we have another problem that appears with cluster all the time, for only certain table.

After setting up 3-nodes cluster, we are trying to use pt-online-schema-change tool to no-matter-what (for instance, we can just run alter “engine=InnoDB” to do nothing with table structure in fact), but shortly after, our cluster becomes stuck with pause:

Logs
pxc1

2022-03-05T17:46:00.873432Z 7505364 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=4 solved by abort
2022-03-05T17:46:00.873482Z 7505451 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=4 solved by abort
2022-03-05T17:46:00.873674Z 7505466 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.873717Z 7505470 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.873818Z 7505446 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.873852Z 7505446 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.874614Z 7505454 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.874661Z 7505454 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875248Z 7505446 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875365Z 7505467 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875413Z 7505467 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875431Z 7505467 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875463Z 7505364 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-05T17:46:00.875487Z 7505364 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-05T17:46:00.875498Z 7505364 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 7505364, mode: toi, state: exec, conflict: aborted, seqno: 215655032
   SQL: CREATE TRIGGER `pt_osc_xxxxxxxx_users_del` AFTER DELETE ON `xxxxxxxx`.`users` FOR EACH ROW BEGIN DECLARE CONTINUE HANDLER FOR 1146 begin end; DELETE IGNORE FROM `xxxxxxxx`.`_users_new` WHERE `xxxxxxxx`.`_users_new`.`user_id` <=> OLD.`user_id`; END

2022-03-05T17:46:00.875514Z 7505364 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 7505472, mode: local, state: exec, conflict: aborted, seqno: -1
   SQL: SELECT field FROM `xxxxxxxx`.`users` WHERE `user_id` = 'x'
2022-03-05T17:46:00.875598Z 7505472 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875607Z 7505472 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=10 solved by abort
2022-03-05T17:46:00.875616Z 7505472 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=8 solved by abort
2022-03-05T17:46:00.875625Z 7505472 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=10 solved by abort
2022-03-05T17:46:00.882388Z 0 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=10 solved by abort
2022-03-05T17:46:00.892544Z 7505469 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=10 solved by abort
2022-03-05T17:46:00.909535Z 7505364 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-05T17:46:00.909554Z 7505364 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:
2022-03-05T17:46:00.909562Z 7505364 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 7505364, mode: toi, state: exec, conflict: aborted, seqno: 215655044
   SQL: CREATE TRIGGER `pt_osc_xxxxxxxx_users_upd`
........

pxc2

2022-03-05T17:46:02.525997Z 0 [Note] [MY-000000] [Galera] declaring 65d2b994-bce4 at ssl://xx.xxx.xxx.199:4567 stable
2022-03-05T17:46:02.526161Z 0 [Note] [MY-000000] [Galera] forgetting 95da07cd-9470 (ssl://xx.xxx.xxx.201:4567)
2022-03-05T17:46:02.526839Z 0 [Note] [MY-000000] [Galera] Node 2df1acc3-b163 state primary
2022-03-05T17:46:02.527012Z 0 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view (view_id(PRIM,2df1acc3-b163,10)
memb {
   2df1acc3-b163,0
   65d2b994-bce4,0
   }
joined {
   }
left {
   }
partitioned {
   95da07cd-9470,0
   }
)
2022-03-05T17:46:02.527032Z 0 [Note] [MY-000000] [Galera] Save the discovered primary-component to disk
2022-03-05T17:46:02.530148Z 0 [Note] [MY-000000] [Galera] forgetting 95da07cd-9470 (ssl://xx.xxx.xxx.201:4567)
2022-03-05T17:46:02.530368Z 0 [Note] [MY-000000] [Galera] New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2

pxc3

2022-03-05T17:46:00.904407Z 20 [Note] [MY-000000] [WSREP] MDL conflict db=xxxxxxxx table=users ticket=1 solved by abort
2022-03-05T17:46:02.518296Z 11 [Note] [MY-011825] [InnoDB] *** Priority TRANSACTION:
TRANSACTION 83020623739, ACTIVE 0 sec inserting
mysql tables in use 2, locked 2
LOCK WAIT , undo log entries 3
MySQL thread id 11, OS thread handle 140358281434880, query id 54881213 wsrep: writing row for write-set (215655578)
2022-03-05T17:46:02.518444Z 11 [Note] [MY-011825] [InnoDB] *** Priority TRANSACTION:
TRANSACTION 83020623738, ACTIVE (PREPARED) 0 sec
, undo log entries 2
MySQL thread id 13, OS thread handle 140358281139968, query id 54881211 wsrep: preparing to commit write set(215655579)
2022-03-05T17:46:02.518501Z 11 [Note] [MY-011825] [InnoDB] *** WAITING FOR THIS LOCK TO BE GRANTED:
2022-03-05T17:46:02.518518Z 11 [Note] [MY-011825] [InnoDB]  SQL1: 
2022-03-05T17:46:02.518533Z 11 [Note] [MY-011825] [InnoDB]  SQL2: 
2022-03-05T17:46:02.518554Z 11 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-05T17:46:02.518572Z 11 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-05T17:46:02.518590Z 11 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 11, mode: high priority, state: exec, conflict: executing, seqno: 215655578
   SQL: (null)

2022-03-05T17:46:02.518606Z 11 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 13, mode: high priority, state: exec, conflict: committing, seqno: 215655579
   SQL: (null)

2022-03-05T17:46:02.521458Z 11 [Note] [MY-011825] [InnoDB] Killed transaction: ID: 0 in hit list - MySQL thread id 13, OS thread handle 140358281139968, query id 54881211 wsrep: preparing to commit write set(215655579)
2022-03-05T17:46:02.521502Z 11 [Note] [MY-011825] [InnoDB] WSREP seqnos, BF: 215655578, victim: 215655579
2022-03-05T17:46:02.521523Z 11 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-05T17:46:02.521540Z 11 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-05T17:46:02.521557Z 11 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 11, mode: high priority, state: exec, conflict: executing, seqno: 215655578
   SQL: (null)

2022-03-05T17:46:02.521592Z 11 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 13, mode: high priority, state: exec, conflict: must_abort, seqno: 215655579
   SQL: (null)

2022-03-05T17:46:02.524290Z 13 [Note] [MY-000000] [Galera] Failed to apply write set: gtid: 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:215655579 server_id: 65d2b994-9bca-11ec-bce4-13f1b176a00a client_id: 7505593 trx_id: 192633761 flags: 3
2022-03-05T17:46:02.524887Z 13 [Note] [MY-000000] [Galera] Closing send monitor...
2022-03-05T17:46:02.524900Z 13 [Note] [MY-000000] [Galera] Closed send monitor.
2022-03-05T17:46:02.524910Z 13 [Note] [MY-000000] [Galera] gcomm: terminating thread
2022-03-05T17:46:02.524923Z 13 [Note] [MY-000000] [Galera] gcomm: joining thread
2022-03-05T17:46:02.525223Z 13 [Note] [MY-000000] [Galera] gcomm: closing backend
2022-03-05T17:46:02.526052Z 13 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view (view_id(NON_PRIM,2df1acc3-b163,9)
memb {
   95da07cd-9470,0
   }
joined {
   }
left {
   }
partitioned {
   2df1acc3-b163,0
   65d2b994-bce4,0
   }
)
2022-03-05T17:46:02.526098Z 13 [Note] [MY-000000] [Galera] PC protocol downgrade 1 -> 0
2022-03-05T17:46:02.526121Z 13 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view ((empty))
2022-03-05T17:46:02.526480Z 13 [Note] [MY-000000] [Galera] gcomm: closed
2022-03-05T17:46:02.526529Z 0 [Note] [MY-000000] [Galera] New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2022-03-05T17:46:02.526656Z 0 [Note] [MY-000000] [Galera] Flow-control interval: [100, 100]
2022-03-05T17:46:02.526680Z 0 [Note] [MY-000000] [Galera] Received NON-PRIMARY.
2022-03-05T17:46:02.526698Z 0 [Note] [MY-000000] [Galera] Shifting SYNCED -> OPEN (TO: 215655706)
2022-03-05T17:46:02.526719Z 0 [Note] [MY-000000] [Galera] New SELF-LEAVE.

Versions

xtrabackup version 8.0.26-18 based on MySQL server 8.0.26 Linux (x86_64) (revision id: 4aecf82)
mysql  Ver 8.0.23-14.1 for Linux on x86_64 (Percona XtraDB Cluster (GPL), Release rel14, Revision d3b9a1d, WSREP version 26.4.3)

Provider options

wsrep_provider_options="gcache.size=2G;socket.ssl_key=server-key.pem;socket.ssl_cert=server-cert.pem;socket.ssl_ca=ca.pem"

Cluster freeze happens every time we are trying to run PTOSC on this table. The case shown above is the latest one, but previously we also saw these errors:

2022-03-03T16:45:47.959951Z 0 [Note] [MY-000000] [Galera] Member 0(pxc-xx-node2) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787,95187530f4e561db:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.960075Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787:
   95187530f4e561db:   1/3
Waiting for more votes.
2022-03-03T16:45:47.960235Z 12 [Note] [MY-000000] [Galera] Got vote request for seqno 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787
2022-03-03T16:45:47.966241Z 0 [Note] [MY-000000] [Galera] Member 2(pxc-xx-node1) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787,95187530f4e561db:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.966346Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787:
   95187530f4e561db:   2/3
Winner: 95187530f4e561db
2022-03-03T16:45:47.966496Z 12 [Note] [MY-000000] [Galera] 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706787 already voted on. Continue.
2022-03-03T16:45:47.974820Z 0 [Note] [MY-000000] [Galera] Member 0(pxc-xx-node2) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788,965b9a15da8fe87d:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.974904Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788:
   965b9a15da8fe87d:   1/3
Waiting for more votes.
2022-03-03T16:45:47.975052Z 18 [Note] [MY-000000] [Galera] Got vote request for seqno 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788
2022-03-03T16:45:47.980153Z 0 [Note] [MY-000000] [Galera] Member 2(pxc-xx-node1) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788,965b9a15da8fe87d:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.980242Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788:
   965b9a15da8fe87d:   2/3
Winner: 965b9a15da8fe87d
2022-03-03T16:45:47.980356Z 18 [Note] [MY-000000] [Galera] 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706788 already voted on. Continue.
2022-03-03T16:45:47.989968Z 0 [Note] [MY-000000] [Galera] Member 0(pxc-xx-node2) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791,a3dedf7695bf2968:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.990076Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791:
   a3dedf7695bf2968:   1/3
Waiting for more votes.
2022-03-03T16:45:47.990252Z 1 [Note] [MY-000000] [Galera] Got vote request for seqno 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791
2022-03-03T16:45:47.994072Z 0 [Note] [MY-000000] [Galera] Member 2(pxc-xx-node1) initiates vote on 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791,a3dedf7695bf2968:  Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is deprecated and will be removed in a future release., Error_code: 1681; Integer display width is depre
2022-03-03T16:45:47.994148Z 0 [Note] [MY-000000] [Galera] Votes over 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791:
   a3dedf7695bf2968:   2/3
Winner: a3dedf7695bf2968
2022-03-03T16:45:47.994265Z 1 [Note] [MY-000000] [Galera] 2f3c9caa-917d-11ec-8fa9-3675bdbbabe7:177706791 already voted on. Continue.

What could be the reason of such behavior? Thanks.

1 Like

Forgot to mention important remark: it looks like something wrong with CEV feature, since in case of ONLY ONE NODE running at the time, PTOSC completes without any errors.

1 Like

thanks my issue has been fixed.

1 Like

UPDATE

  1. Checked - the cause of cluster freezing is NOT related to errors like “Integer display width is deprecated and will be removed…” (that was causing CEV voting during PTOSC).

  2. It seems that the real reason of cluster to stall is cluster conflict during creating triggers (see log below). I know that such conflicts can be natural (right?), but they happen EVERY time I start PTOSC and causing several deadlocks in STANDALONE cluster mode (only 1 node online), and whole cluster FREEZE in case of CLUSTER mode (2-3 nodes online)

This freeze looks like FC reaching it’s limits and stays on those limits forever. And no replication happens during this time at all (according to PMM replication graphs).

Please help in figuring out what’s wrong. Thank you.

2022-03-29T23:11:00.321343Z 95230818 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-29T23:11:00.321411Z 95230818 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-29T23:11:00.321434Z 95230818 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 95230818, mode: toi, state: exec, conflict: aborted, seqno: 290439160
   SQL: CREATE TRIGGER  `xxxxxxxx` AFTER UPDATE ON `xxxxxxxx`.`xxxxxxxx` FOR EACH ROW BEGIN DECLARE CONTINUE HANDLER FOR 1146 begin end; DELETE IGNORE FROM `xxxxxxxx`.`xxxxxxxx` WHERE !(OLD.`xxxxxxxx` <=> NEW.`xxxxxxxx`) AND `xxxxxxxx`.`xxxxxxxx`.`xxxxxxxx` <=> OLD.`xxxxxxxx`; REPLACE INTO `xxxxxxxx`.`xxxxxxxx` (`xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`) VALUES (NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`); END

2022-03-29T23:11:00.321489Z 95230818 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 95230851, mode: local, state: exec, conflict: aborted, seqno: -1
   SQL: SELECT
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    u.xxxxx
                FROM
                    `xxxxxxxx`.`xxxxxxxx` AS b 
                        
                LEFT JOIN `xxxxxxxx`.`xxxxxxxx` AS u ON u.xxxxx = b.xxxxx
                LEFT JOIN `xxxxxxxx`.`xxxxxxxx` AS g ON g.xxxxx = b.xxxxx
                    
                WHERE
                    b.xxxxx = 'xxxxxx'
                  AND 
                    b.xxxxx = ""
                  AND
                    u.xxxxx IS NOT NULL
                  AND
                    g.xxxxx IS NOT NULL
                  AND 
                    g.xxxxx = b.gameId
                  AND
                    g.xxxxx = 'xxxxx' AND b.xxxxx = xxxxx AND b.xxxxx = 'xxxxx' ORDER BY b.xxxxx DESC LIMIT 1

2022-03-29T23:11:00.321528Z 95230818 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.330141Z 95230853 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
2022-03-29T23:11:00.351993Z 95230818 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-29T23:11:00.352021Z 95230818 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-29T23:11:00.352032Z 95230818 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 95230818, mode: toi, state: exec, conflict: aborted, seqno: 290439162
   SQL: CREATE TRIGGER `xxxxxxxx` AFTER INSERT ON `xxxxxxxx`.`xxxxxxxx` FOR EACH ROW BEGIN DECLARE CONTINUE HANDLER FOR 1146 begin end; REPLACE INTO `xxxxxxxx`.`xxxxxxxx` (`xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`) VALUES (NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`);END

2022-03-29T23:11:00.352057Z 95230818 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 95230845, mode: local, state: exec, conflict: executing, seqno: -1
   SQL: SELECT xxxxx FROM `xxxxxxxx`.`xxxxxxxx`
                               LEFT JOIN `xxxxxxxx`.`xxxxxxxx` USING (idx_id)
                               WHERE id = xxxxx LIMIT 1

2022-03-29T23:11:00.352069Z 95230818 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.352076Z 95230818 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-29T23:11:00.352082Z 95230818 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-29T23:11:00.352089Z 95230818 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 95230818, mode: toi, state: exec, conflict: aborted, seqno: 290439162
   SQL: CREATE TRIGGER `xxxxxxxx` AFTER INSERT ON `xxxxxxxx`.`xxxxxxxx` FOR EACH ROW BEGIN DECLARE CONTINUE HANDLER FOR 1146 begin end; REPLACE INTO `xxxxxxxx`.`xxxxxxxx` (`xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`) VALUES (NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`);END

2022-03-29T23:11:00.352112Z 95230818 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 95230854, mode: local, state: exec, conflict: executing, seqno: -1
   SQL: SELECT
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    b.xxxxx,
                    u.xxxxx
                FROM
                    `xxxxxxxx`.`xxxxxxxx` AS b 
                        
                LEFT JOIN `xxxxxxxx`.`xxxxxxxx` AS u ON u.xxxxx = b.xxxxx
                LEFT JOIN `xxxxxxxx`.`xxxxxxxx` AS g ON g.xxxxx = b.xxxxx
                    
                WHERE
                    b.xxxxx = 'xxxxx'
                  AND 
                    b.xxxxx = ""
                  AND
                    u.xxxxx IS NOT NULL
                  AND
                    g.xxxxx IS NOT NULL
                  AND 
                    g.xxxxx = b.gameId
                  AND
                    g.xxxxx = 'xxxxxxxxxx' AND b.user_id = xxxxx AND b.session_id = 'xxxxx' ORDER BY b.xxxxx DESC LIMIT 1

2022-03-29T23:11:00.352120Z 95230818 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.352127Z 95230818 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
2022-03-29T23:11:00.352133Z 95230818 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:

2022-03-29T23:11:00.352139Z 95230818 [Note] [MY-000000] [WSREP] Winning thread: 
   THD: 95230818, mode: toi, state: exec, conflict: aborted, seqno: 290439162
   SQL: CREATE TRIGGER `xxxxxxxx` AFTER INSERT ON `xxxxxxxx`.`xxxxxxxx` FOR EACH ROW BEGIN DECLARE CONTINUE HANDLER FOR 1146 begin end; REPLACE INTO `xxxxxxxx`.`xxxxxxxx` (`xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`, `xxxxxxxx`) VALUES (NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`, NEW.`xxxxxxxx`);END

2022-03-29T23:11:00.352153Z 95230818 [Note] [MY-000000] [WSREP] Victim thread: 
   THD: 95230855, mode: local, state: exec, conflict: executing, seqno: -1
   SQL: SELECT show_in_report FROM `xxxxxxxx`.`xxxxxxxx` WHERE `xxxxxxxx` = '8784602'

2022-03-29T23:11:00.352162Z 95230818 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.352229Z 95230855 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.352279Z 95230855 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.352332Z 95230854 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=3 solved by abort
2022-03-29T23:11:00.353600Z 95230853 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
2022-03-29T23:14:27.629317Z 95237391 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
2022-03-29T23:14:27.631072Z 95237392 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
2022-03-29T23:14:27.671256Z 95237394 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
2022-03-29T23:14:27.682381Z 95237395 [Note] [MY-000000] [WSREP] MDL conflict db=database_name table=table_name ticket=10 solved by abort
1 Like

Long transactions are not a good fit for PXC, and also will conflict with pt-osc due to the metadata lock required for triggers. You will need to ensure no long transactions are running when you intend to run the pt-osc.

1 Like

Hi,

Thanks for your reply.

The problem here is that victim transactions are not long at all. I can reproduce this case locally with 100% confidence even on small selects by primary key:

mysql_node1     | 2022-03-30T18:04:51.194240Z 69 [Note] [MY-000000] [WSREP] --------- CONFLICT DETECTED --------
mysql_node1     | 2022-03-30T18:04:51.194256Z 69 [Note] [MY-000000] [WSREP] cluster conflict due to high priority abort for threads:
mysql_node1     | 
mysql_node1     | 2022-03-30T18:04:51.194261Z 69 [Note] [MY-000000] [WSREP] Winning thread: 
mysql_node1     |    THD: 69, mode: toi, state: exec, conflict: aborted, seqno: 787612
mysql_node1     |    SQL: drop trigger if exists pt_osc_xxxxx_users_upd
mysql_node1     | 
mysql_node1     | 2022-03-30T18:04:51.194265Z 69 [Note] [MY-000000] [WSREP] Victim thread: 
mysql_node1     |    THD: 70, mode: local, state: exec, conflict: executing, seqno: -1
mysql_node1     |    SQL: SELECT * FROM users WHERE uin = '15411'

The same for CREATE TRIGGER in the beginning of PTOSC.

On the client side I’m getting deadlock error.

Could this be related to configs or something like this?

1 Like

Hi Alexander_Bezpyatov,

Does this table has FKs ? Please provide the “SHOW CREATE TABLE” for the affected table.

Also do you do writes on all nodes or you route write traffic to a specific node ? Please provide "SHOW GLOBAL STATUS LIKE ‘%wsrep_local_commits%’’; for every node in the cluster.

Regards

1 Like

Hi, unfortunately I should hide field names, so I can provide SHOW CREATE TABLE like this:

Hope this will be enough to analyze overall situation. Thanks you.

CREATE TABLE `xxxxxxxxxxx` (
  `xxxxxxxxxxx` mediumint unsigned NOT NULL AUTO_INCREMENT,
  `xxxxxxxxxxx` varchar(256) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL,
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL,
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` datetime NOT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(39) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(2) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` tinyint unsigned NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(39) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` varchar(39) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` int unsigned NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` char(32) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL,
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` varchar(2) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(36) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` enum('m','f','') CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` date DEFAULT NULL,
  `xxxxxxxxxxx` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(150) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(255) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(15) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '1',
  `xxxxxxxxxxx` mediumint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` bigint unsigned NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` mediumint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(12,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` decimal(10,2) NOT NULL DEFAULT '0.00',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0' COMMENT '-1: do not block; 0 - normal; 1 - block;',
  `xxxxxxxxxxx` varchar(10) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT '',
  `xxxxxxxxxxx` int NOT NULL DEFAULT '1',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` varchar(35) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(32) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci DEFAULT NULL,
  `xxxxxxxxxxx` varchar(35) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(35) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(35) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` varchar(42) CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci NOT NULL DEFAULT '',
  `xxxxxxxxxxx` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP,
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '1',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0' COMMENT 'xxxxx for payments',
  `xxxxxxxxxxx` int NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` smallint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '1',
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` datetime DEFAULT NULL,
  `xxxxxxxxxxx` tinyint unsigned NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` tinyint NOT NULL DEFAULT '0',
  `xxxxxxxxxxx` time DEFAULT '71:59:00',
  PRIMARY KEY (`xxxxxxxxxxx`),
  UNIQUE KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  UNIQUE KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`,`xxxxxxxxxxx`) USING BTREE,
  UNIQUE KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`,`xxxxxxxxxxx`,`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`,`xxxxxxxxxxx`) USING BTREE,
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`,`xxxxxxxxxxx`) USING BTREE,
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`),
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`) USING BTREE,
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`) USING BTREE,
  KEY `xxxxxxxxxxx` (`xxxxxxxxxxx`)
) ENGINE=InnoDB AUTO_INCREMENT=8816017 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
1 Like

Hi again Alexander,

Sadly, the “SHOW CREATE TABLE” statement is not enough to troubleshoot the issue, although the width of the table is really wide. A wide table or large transaction increase the opportunity of issues when doing multi primary write on PXC.

Check that you are not writing to multiple servers in a round robin fashion and check the following articles:

Regards

1 Like