2024-01-10T17:38:24.472690Z 764 [Note] Aborted connection 764 to db: 'some-db' user: 'some-user' host: '10-42-2-15.mycluster-pxc-db-haproxy-replicas.pxc.svc.cluster.lo' (Got an error reading communication packets) 2024-01-10T17:41:16.985174Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection to peer 894c37e2 with addr ssl://10.42.2.13:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout), socket stats: rtt: 1941 rttvar: 3650 rto: 1632000 lost: 1 last_data_recv: 3260 cwnd: 1 last_queued_since: 259186037 last_delivered_since: 3259062074 send_queue_length: 0 send_queue_bytes: 0 segment: 0 messages: 0 2024-01-10T17:41:16.985609Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection to peer 1aacdd80 with addr ssl://10.42.0.249:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout), socket stats: rtt: 110 rttvar: 19 rto: 1632000 lost: 1 last_data_recv: 3260 cwnd: 1 last_queued_since: 14120 last_delivered_since: 3259661542 send_queue_length: 1 send_queue_bytes: 212 segment: 0 messages: 1 2024-01-10T17:41:16.985671Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: ssl://10.42.0.249:4567 ssl://10.42.2.13:4567 2024-01-10T17:41:18.485397Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') reconnecting to 1aacdd80 (ssl://10.42.0.249:4567), attempt 0 2024-01-10T17:41:18.485997Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') reconnecting to 894c37e2 (ssl://10.42.2.13:4567), attempt 0 2024-01-10T17:41:18.808117Z 0 [Note] WSREP: declaring node with index 0 suspected, timeout PT5S (evs.suspect_timeout) 2024-01-10T17:41:18.808181Z 0 [Note] WSREP: declaring node with index 2 suspected, timeout PT5S (evs.suspect_timeout) 2024-01-10T17:41:18.808205Z 0 [Note] WSREP: evs::proto(51673b8a, OPERATIONAL, view_id(REG,1aacdd80,18)) suspecting node: 1aacdd80 2024-01-10T17:41:18.808222Z 0 [Note] WSREP: evs::proto(51673b8a, OPERATIONAL, view_id(REG,1aacdd80,18)) suspected node without join message, declaring inactive 2024-01-10T17:41:18.808242Z 0 [Note] WSREP: evs::proto(51673b8a, OPERATIONAL, view_id(REG,1aacdd80,18)) suspecting node: 894c37e2 2024-01-10T17:41:18.808258Z 0 [Note] WSREP: evs::proto(51673b8a, OPERATIONAL, view_id(REG,1aacdd80,18)) suspected node without join message, declaring inactive 2024-01-10T17:41:19.308442Z 0 [Note] WSREP: declaring node with index 0 inactive (evs.inactive_timeout) 2024-01-10T17:41:19.308505Z 0 [Note] WSREP: declaring node with index 2 inactive (evs.inactive_timeout) 2024-01-10T17:41:19.808546Z 0 [Note] WSREP: Current view of cluster as seen by this node view (view_id(NON_PRIM,1aacdd80,18) memb { 51673b8a,0 } joined { } left { } partitioned { 1aacdd80,0 894c37e2,0 } ) 2024-01-10T17:41:19.808753Z 0 [Note] WSREP: Current view of cluster as seen by this node view (view_id(NON_PRIM,51673b8a,19) memb { 51673b8a,0 } joined { } left { } partitioned { 1aacdd80,0 894c37e2,0 } ) 2024-01-10T17:41:19.808759Z 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-01-10T17:41:19.808864Z 0 [Note] WSREP: Flow-control interval: [100, 100] 2024-01-10T17:41:19.808875Z 0 [Note] WSREP: Received NON-PRIMARY. 2024-01-10T17:41:19.808884Z 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 932630) 2024-01-10T17:41:19.808917Z 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-01-10T17:41:19.808929Z 0 [Note] WSREP: Flow-control interval: [100, 100] 2024-01-10T17:41:19.808936Z 0 [Note] WSREP: Received NON-PRIMARY. 2024-01-10T17:41:19.809063Z 2 [Note] WSREP: New cluster view: global state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3 2024-01-10T17:41:19.809106Z 2 [Note] WSREP: Setting wsrep_ready to false 2024-01-10T17:41:19.809156Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T17:41:19.809202Z 2 [Note] WSREP: New cluster view: global state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3 2024-01-10T17:41:19.809213Z 2 [Note] WSREP: Setting wsrep_ready to false 2024-01-10T17:41:19.809247Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T17:41:21.486582Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection to peer 00000000 with addr ssl://10.42.2.13:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout), socket stats: rtt: 0 rttvar: 250000 rto: 2000000 lost: 1 last_data_recv: 554287976 cwnd: 1 last_queued_since: 554587975624765 last_delivered_since: 554587975624765 send_queue_length: 0 send_queue_bytes: 0 2024-01-10T17:41:21.486792Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection to peer 00000000 with addr ssl://10.42.0.249:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout), socket stats: rtt: 0 rttvar: 250000 rto: 2000000 lost: 1 last_data_recv: 554287976 cwnd: 1 last_queued_since: 554587975865062 last_delivered_since: 554587975865062 send_queue_length: 0 send_queue_bytes: 0 2024-01-10T18:03:20.505990Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). 2024-01-10T18:03:20.508157Z 0 [Note] mysqld (mysqld 5.7.43-47-57-log) starting as process 1 ... 2024-01-10T18:03:20.511643Z 0 [Note] WSREP: Skipping automatic SSL certificate generation (enabled only in bootstrap mode) 2024-01-10T18:03:20.512020Z 0 [Note] WSREP: Setting wsrep_ready to false 2024-01-10T18:03:20.512039Z 0 [Note] WSREP: No pre-stored wsrep-start position found. Skipping position initialization. 2024-01-10T18:03:20.512047Z 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera3/libgalera_smm.so' 2024-01-10T18:03:20.512755Z 0 [Note] WSREP: wsrep_load(): Galera 3.65(rf47405c) by Codership Oy loaded successfully. 2024-01-10T18:03:20.512804Z 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2024-01-10T18:03:20.513682Z 0 [Note] WSREP: Found saved state: 4525a31a-a337-11ee-86ef-5aca530f9a97:-1, safe_to_bootstrap: 0 2024-01-10T18:03:20.521686Z 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.42.1.59; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.freeze_purge_at_seqno = -1; gcache.keep_pages_count = 0; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 100; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = true; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 10; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 9; socket.checksum = 2; socket.recv_buf_size = auto; socket.send_buf_size = auto; socket.ssl_ca = /etc/mysql/ssl-internal/ca.crt; socket.ssl_cert = /etc/mysql/ssl-internal/tls.crt; socket.ssl_cipher = ; socket.ssl_compression = YES; socket.ssl_key = /etc/mysql/ssl-internal/tls.key; 2024-01-10T18:03:20.556162Z 0 [Note] WSREP: GCache history reset: 4525a31a-a337-11ee-86ef-5aca530f9a97:0 -> 4525a31a-a337-11ee-86ef-5aca530f9a97:932630 2024-01-10T18:03:20.560683Z 0 [Note] WSREP: Assign initial position for certification: 932630, protocol version: -1 2024-01-10T18:03:20.560714Z 0 [Note] WSREP: Preparing to initiate SST/IST 2024-01-10T18:03:20.560743Z 0 [Note] WSREP: Starting replication 2024-01-10T18:03:20.560758Z 0 [Note] WSREP: Setting initial position to 4525a31a-a337-11ee-86ef-5aca530f9a97:932630 2024-01-10T18:03:20.561300Z 0 [Note] WSREP: Using CRC-32C for message checksums. 2024-01-10T18:03:20.561347Z 0 [Note] WSREP: initializing ssl context 2024-01-10T18:03:20.561795Z 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2024-01-10T18:03:20.562998Z 0 [Note] WSREP: Restoring primary-component from disk successful 2024-01-10T18:03:20.563176Z 0 [Note] WSREP: GMCast version 0 2024-01-10T18:03:20.565189Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567 2024-01-10T18:03:20.565251Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') multicast: , ttl: 1 2024-01-10T18:03:20.565952Z 0 [Note] WSREP: EVS version 0 2024-01-10T18:03:20.566128Z 0 [Note] WSREP: gcomm: connecting to group 'mycluster-pxc-db-pxc', peer '10.42.0.249:,mycluster-pxc-db-pxc-0.mycluster-pxc-db-pxc:' 2024-01-10T18:03:20.575752Z 0 [Note] WSREP: SSL handshake successful, remote endpoint ssl://10.42.2.13:4567 local endpoint ssl://10.42.1.59:38806 cipher: TLS_AES_256_GCM_SHA384 compression: none 2024-01-10T18:03:20.577779Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection established to 74e398cb ssl://10.42.2.13:4567 2024-01-10T18:03:20.577985Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2024-01-10T18:03:21.068783Z 0 [Note] WSREP: declaring 74e398cb at ssl://10.42.2.13:4567 stable 2024-01-10T18:03:21.069578Z 0 [Note] WSREP: Node 74e398cb state primary 2024-01-10T18:03:21.069915Z 0 [Note] WSREP: Current view of cluster as seen by this node view (view_id(PRIM,51673b8a,20) memb { 51673b8a,0 74e398cb,0 } joined { } left { } partitioned { } ) 2024-01-10T18:03:21.069951Z 0 [Note] WSREP: Save the discovered primary-component to disk 2024-01-10T18:03:21.085371Z 0 [Note] WSREP: discarding pending addr without UUID: ssl://10.42.0.249:4567 2024-01-10T18:03:21.085414Z 0 [Note] WSREP: clear restored view 2024-01-10T18:03:21.567528Z 0 [Note] WSREP: gcomm: connected 2024-01-10T18:03:21.567719Z 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2024-01-10T18:03:21.567870Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2024-01-10T18:03:21.567954Z 0 [Note] WSREP: Waiting for SST/IST to complete. 2024-01-10T18:03:21.568073Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8a7863b0-afe2-11ee-bde1-62d52fda42bc 2024-01-10T18:03:21.568714Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8a7863b0-afe2-11ee-bde1-62d52fda42bc 2024-01-10T18:03:21.569261Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8a7863b0-afe2-11ee-bde1-62d52fda42bc from 0 (mycluster-pxc-db-pxc-1) 2024-01-10T18:03:21.569308Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8a7863b0-afe2-11ee-bde1-62d52fda42bc from 1 (mycluster-pxc-db-pxc-0) 2024-01-10T18:03:21.569327Z 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (primary/total), act_id = 932634, last_appl. = -1, protocols = 0/9/3 (gcs/repl/appl), group UUID = 4525a31a-a337-11ee-86ef-5aca530f9a97 2024-01-10T18:03:21.569343Z 0 [Note] WSREP: Flow-control interval: [141, 141] 2024-01-10T18:03:21.569352Z 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 932634) 2024-01-10T18:03:21.569513Z 2 [Note] WSREP: State transfer required: Group state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932634 Local state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630 2024-01-10T18:03:21.569576Z 2 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-01-10T18:03:21.569589Z 2 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-01-10T18:03:21.569616Z 2 [Note] WSREP: New cluster view: global state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932634, view# 2: Primary, number of nodes: 2, my index: 0, protocol version 3 2024-01-10T18:03:21.569626Z 2 [Note] WSREP: Setting wsrep_ready to true 2024-01-10T18:03:21.569636Z 2 [Warning] WSREP: Gap in state sequence. Need state transfer. 2024-01-10T18:03:21.569677Z 2 [Note] WSREP: Setting wsrep_ready to false 2024-01-10T18:03:21.569895Z 0 [Note] WSREP: Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.42.1.59' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '1' --mysqld-version '5.7.43-47-57' '' ) 2024-01-10T18:03:22.145288Z WSREP_SST: [INFO] Streaming with xbstream 2024-01-10T18:03:22.651494Z 2 [Note] WSREP: Prepared SST/IST request: xtrabackup-v2|10.42.1.59:4444/xtrabackup_sst//1 2024-01-10T18:03:22.651550Z 2 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 1 -> 2) 2024-01-10T18:03:22.651625Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T18:03:22.651677Z 2 [Note] WSREP: Assign initial position for certification: 932634, protocol version: 4 2024-01-10T18:03:22.651804Z 0 [Note] WSREP: Service thread queue flushed. 2024-01-10T18:03:22.651883Z 2 [Note] WSREP: Check if state gap can be serviced using IST 2024-01-10T18:03:22.652018Z 2 [Note] WSREP: IST receiver addr using ssl://10.42.1.59:4568 2024-01-10T18:03:22.652118Z 2 [Note] WSREP: IST receiver using ssl 2024-01-10T18:03:22.652817Z 2 [Note] WSREP: Prepared IST receiver, listening at: ssl://10.42.1.59:4568 2024-01-10T18:03:22.652857Z 2 [Note] WSREP: State gap can be likely serviced using IST. SST request though present would be void. 2024-01-10T18:03:22.666573Z 0 [Note] WSREP: may fallback to sst. ist_seqno [932630] < safe_ist_seqno [932631] 2024-01-10T18:03:22.666620Z 0 [Note] WSREP: Member 0.0 (mycluster-pxc-db-pxc-1) requested state transfer from '*any*'. Selected 1.0 (mycluster-pxc-db-pxc-0)(SYNCED) as donor. 2024-01-10T18:03:22.666636Z 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 932634) 2024-01-10T18:03:22.666714Z 2 [Note] WSREP: Requesting state transfer: success, donor: 1 2024-01-10T18:03:22.666761Z 2 [Note] WSREP: GCache history reset: 4525a31a-a337-11ee-86ef-5aca530f9a97:0 -> 4525a31a-a337-11ee-86ef-5aca530f9a97:932634 joiner: => Rate:[ 190 B/s] Avg:[ 190 B/s] Elapsed:0:00:01 Bytes: 244 B 2024-01-10T18:03:24.067951Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') turning message relay requesting off 2024-01-10T18:03:24.362453Z WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST 2024-01-10T18:03:24.367782Z WSREP_SST: [INFO] Galera co-ords from recovery: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630 2024-01-10T18:03:24.384749Z 0 [Note] WSREP: SST complete, seqno: 932630 2024-01-10T18:03:24.387714Z 0 [Note] InnoDB: PUNCH HOLE support available 2024-01-10T18:03:24.387758Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2024-01-10T18:03:24.387776Z 0 [Note] InnoDB: Uses event mutexes 2024-01-10T18:03:24.387785Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2024-01-10T18:03:24.387795Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2024-01-10T18:03:24.387804Z 0 [Note] InnoDB: Using Linux native AIO 2024-01-10T18:03:24.389089Z 0 [Note] InnoDB: Number of pools: 1 2024-01-10T18:03:24.389319Z 0 [Note] InnoDB: Using CPU crc32 instructions 2024-01-10T18:03:24.398079Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M 2024-01-10T18:03:24.405316Z 0 [Note] InnoDB: Completed initialization of buffer pool 2024-01-10T18:03:24.408224Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2024-01-10T18:03:24.427854Z 0 [Note] InnoDB: Crash recovery did not find the parallel doublewrite buffer at /var/lib/mysql/xb_doublewrite 2024-01-10T18:03:24.429863Z 0 [Note] InnoDB: Highest supported file format is Barracuda. 2024-01-10T18:03:24.526955Z 0 [Note] InnoDB: Created parallel doublewrite buffer at /var/lib/mysql/xb_doublewrite, size 3932160 bytes 2024-01-10T18:03:24.604297Z 0 [Note] WSREP: 1.0 (mycluster-pxc-db-pxc-0): State transfer to 0.0 (mycluster-pxc-db-pxc-1) complete. 2024-01-10T18:03:24.604622Z 0 [Note] WSREP: Member 1.0 (mycluster-pxc-db-pxc-0) synced with group. 2024-01-10T18:03:24.714619Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2024-01-10T18:03:24.714723Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2024-01-10T18:03:24.871743Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2024-01-10T18:03:24.873166Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active. 2024-01-10T18:03:24.873191Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active. 2024-01-10T18:03:24.873880Z 0 [Note] InnoDB: Waiting for purge to start 2024-01-10T18:03:24.924824Z 0 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.7.43-47 started; log sequence number 1991646286 2024-01-10T18:03:24.925147Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2024-01-10T18:03:24.925896Z 0 [Note] Plugin 'FEDERATED' is disabled. 2024-01-10T18:03:24.943239Z 0 [Note] Skipping generation of SSL certificates as options related to SSL are specified. 2024-01-10T18:03:24.943281Z 0 [Warning] A deprecated TLS version TLSv1 is enabled. Please use TLSv1.2 or higher. 2024-01-10T18:03:24.943292Z 0 [Warning] A deprecated TLS version TLSv1.1 is enabled. Please use TLSv1.2 or higher. 2024-01-10T18:03:24.944770Z 0 [Warning] CA certificate /etc/mysql/ssl-internal/ca.crt is self signed. 2024-01-10T18:03:24.944873Z 0 [Note] Skipping generation of RSA key pair as key files are present in data directory. 2024-01-10T18:03:24.946654Z 0 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306 2024-01-10T18:03:24.946700Z 0 [Note] - '0.0.0.0' resolves to '0.0.0.0'; 2024-01-10T18:03:24.946784Z 0 [Note] Server socket created on IP: '0.0.0.0'. 2024-01-10T18:03:24.946827Z 0 [Note] Server hostname (bind-address): '0.0.0.0'; port: 33062 2024-01-10T18:03:24.946838Z 0 [Note] - '0.0.0.0' resolves to '0.0.0.0'; 2024-01-10T18:03:24.946852Z 0 [Note] Server socket created on IP: '0.0.0.0'. 2024-01-10T18:03:25.072021Z 0 [Note] InnoDB: Buffer pool(s) load completed at 240110 18:03:25 2024-01-10T18:03:25.104306Z 0 [Note] Failed to start slave threads for channel '' 2024-01-10T18:03:25.200505Z 0 [Note] Event Scheduler: Loaded 0 events 2024-01-10T18:03:25.200700Z 0 [Note] WSREP: Signalling provider to continue on SST completion. 2024-01-10T18:03:25.200735Z 0 [Note] WSREP: Initialized wsrep sidno 2 2024-01-10T18:03:25.200763Z 0 [Note] WSREP: SST received: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630 2024-01-10T18:03:25.200941Z 0 [Note] mysqld: ready for connections. Version: '5.7.43-47-57-log' socket: '/tmp/mysql.sock' port: 3306 Percona XtraDB Cluster (GPL), Release rel47, Revision 69b5c96, WSREP version 31.65, wsrep_31.65 2024-01-10T18:03:25.213210Z 2 [Note] WSREP: Receiving IST: 4 writesets, seqnos 932630-932634 2024-01-10T18:03:25.213412Z 0 [Note] WSREP: Receiving IST... 0.0% (0/4 events) complete. 2024-01-10T18:03:25.229708Z 0 [Note] WSREP: Receiving IST...100.0% (4/4 events) complete. 2024-01-10T18:03:25.230662Z 2 [Note] WSREP: IST received: 4525a31a-a337-11ee-86ef-5aca530f9a97:932634 2024-01-10T18:03:25.231136Z 0 [Note] WSREP: 0.0 (mycluster-pxc-db-pxc-1): State transfer from 1.0 (mycluster-pxc-db-pxc-0) complete. 2024-01-10T18:03:25.231176Z 0 [Note] WSREP: SST leaving flow control 2024-01-10T18:03:25.231191Z 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 932635) 2024-01-10T18:03:25.231445Z 0 [Note] WSREP: Member 0.0 (mycluster-pxc-db-pxc-1) synced with group. 2024-01-10T18:03:25.231456Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 932635) 2024-01-10T18:03:25.232007Z 2 [Note] WSREP: Synchronized with group, ready for connections 2024-01-10T18:03:25.232030Z 2 [Note] WSREP: Setting wsrep_ready to true 2024-01-10T18:03:25.232038Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T18:03:41.285739Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: ssl://10.42.0.249:4567 2024-01-10T18:03:41.578614Z 0 [Note] WSREP: SSL handshake successful, remote endpoint ssl://10.42.0.249:4567 local endpoint ssl://10.42.1.59:35970 cipher: TLS_AES_256_GCM_SHA384 compression: none 2024-01-10T18:03:41.580771Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') connection established to 96281114 ssl://10.42.0.249:4567 2024-01-10T18:03:41.777873Z 0 [Note] WSREP: declaring 74e398cb at ssl://10.42.2.13:4567 stable 2024-01-10T18:03:41.777949Z 0 [Note] WSREP: declaring 96281114 at ssl://10.42.0.249:4567 stable 2024-01-10T18:03:41.779100Z 0 [Note] WSREP: Node 51673b8a state primary 2024-01-10T18:03:41.779906Z 0 [Note] WSREP: Current view of cluster as seen by this node view (view_id(PRIM,51673b8a,21) memb { 51673b8a,0 74e398cb,0 96281114,0 } joined { } left { } partitioned { } ) 2024-01-10T18:03:41.779943Z 0 [Note] WSREP: Save the discovered primary-component to disk 2024-01-10T18:03:41.801227Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2024-01-10T18:03:41.801410Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9687c0c2-afe2-11ee-ac4a-c743039977bb 2024-01-10T18:03:41.804416Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9687c0c2-afe2-11ee-ac4a-c743039977bb 2024-01-10T18:03:41.805157Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9687c0c2-afe2-11ee-ac4a-c743039977bb from 0 (mycluster-pxc-db-pxc-1) 2024-01-10T18:03:41.805206Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9687c0c2-afe2-11ee-ac4a-c743039977bb from 1 (mycluster-pxc-db-pxc-0) 2024-01-10T18:03:42.277773Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9687c0c2-afe2-11ee-ac4a-c743039977bb from 2 (mycluster-pxc-db-pxc-2) 2024-01-10T18:03:42.277857Z 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 2, members = 2/3 (primary/total), act_id = 932635, last_appl. = 0, protocols = 0/9/3 (gcs/repl/appl), group UUID = 4525a31a-a337-11ee-86ef-5aca530f9a97 2024-01-10T18:03:42.277878Z 0 [Note] WSREP: Flow-control interval: [173, 173] 2024-01-10T18:03:42.278015Z 2 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-01-10T18:03:42.278051Z 2 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-01-10T18:03:42.278067Z 2 [Note] WSREP: New cluster view: global state: 4525a31a-a337-11ee-86ef-5aca530f9a97:932635, view# 3: Primary, number of nodes: 3, my index: 0, protocol version 3 2024-01-10T18:03:42.278076Z 2 [Note] WSREP: Setting wsrep_ready to true 2024-01-10T18:03:42.278085Z 2 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 2 -> 3) 2024-01-10T18:03:42.278094Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T18:03:42.278117Z 2 [Note] WSREP: Assign initial position for certification: 932635, protocol version: 4 2024-01-10T18:03:42.278172Z 0 [Note] WSREP: Service thread queue flushed. 2024-01-10T18:03:43.268378Z 0 [Note] WSREP: may fallback to sst. ist_seqno [932630] < safe_ist_seqno [932631] 2024-01-10T18:03:43.268430Z 0 [Note] WSREP: Member 2.0 (mycluster-pxc-db-pxc-2) requested state transfer from 'mycluster-pxc-db-pxc-1,'. Selected 0.0 (mycluster-pxc-db-pxc-1)(SYNCED) as donor. 2024-01-10T18:03:43.268444Z 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 932635) 2024-01-10T18:03:43.268566Z 2 [Note] WSREP: IST request: 4525a31a-a337-11ee-86ef-5aca530f9a97:932630-932635|ssl://10.42.0.249:4568 2024-01-10T18:03:43.268635Z 2 [Note] WSREP: IST first seqno 932631 not found from cache, falling back to SST 2024-01-10T18:03:43.268666Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-01-10T18:03:43.268885Z 0 [Note] WSREP: Initiating SST/IST transfer on DONOR side (wsrep_sst_xtrabackup-v2 --role 'donor' --address '10.42.0.249:4444/xtrabackup_sst//1' --socket '/tmp/mysql.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --mysqld-version '5.7.43-47-57' '' --gtid '4525a31a-a337-11ee-86ef-5aca530f9a97:932635' ) 2024-01-10T18:03:43.269662Z 2 [Note] WSREP: DONOR thread signaled with 0 2024-01-10T18:03:43.871538Z WSREP_SST: [INFO] Streaming with xbstream 2024-01-10T18:03:45.070421Z 0 [Note] WSREP: (51673b8a, 'ssl://0.0.0.0:4567') turning message relay requesting off 2024-01-10T18:03:55.159135Z WSREP_SST: [INFO] Streaming the backup to joiner at 10.42.0.249 4444 donor: => Rate:[71.5MiB/s] Avg:[71.5MiB/s] Elapsed:0:00:10 ETA 0:00:11 donor: => Rate:[85.4MiB/s] Avg:[78.5MiB/s] Elmycluster-pxcETA 0:00:00mycluster-pxc donor: => Rate:[78.0MiB/s] Avg:[78.0MiB/s] Elapsed:0:00:20 2024-01-10T18:04:15.353099Z 0 [Note] WSREP: 0.0 (mycluster-pxc-1): State transfer to 2.0 (mycluster-pxc-db-pxc-2) complete. 2024-01-10T18:04:15.353144Z 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 932654) 2024-01-10T18:04:15.354003Z 0 [Note] WSREP: Member 0.0 (mycluster-pxc-db-pxc-1) synced with group. 2024-01-10T18:04:15.354032Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 932654) 2024-01-10T18:04:15.354077Z 2 [Note] WSREP: Synchronized with group, ready for connections 2024-01-10T18:04:15.354101Z 2 [Note] WSREP: Settimycluster-pxc to truemycluster-pxc 2024-01-10T18:04:15.354136Z 2 [Note] WSREP: wsrep_notifymycluster-pxcfined, skipping notification. 2024-01-10T18:04:27.959377Z 0 [Note] WSREP: 2.0 (mycluster-pxc-db-pxc-2): State transfer from 0.0 (mycluster-pxc-db-pxc-1) complete. 2024-01-10T18:04:27.960366Z 0 [Note] WSREP: Member 2.0 (mycluster-pxc-db-pxc-2) synced with group.