I have node 1 started with ‘systemctl start mysl@bootstrap.service’ and node 2 joined and synced successfully with ‘systemctl start mysqld’. When I try ‘systemctl start mysqld’ on node 3, however, I get an error.
Here’s the joiner log of node 3:
2022-07-15T20:48:18.745784Z 0 [Warning] [MY-011068] [Server] The syntax 'wsrep_slave_threads' is deprecated and will be removed in a future release. Please use wsrep_applier_threads instead.
2022-07-15T20:48:18.745812Z 0 [Warning] [MY-011070] [Server] 'Disabling symbolic links using --skip-symbolic-links (or equivalent) is the default. Consider not using this option as it' is deprecated and will be removed in a future release.
2022-07-15T20:48:18.746020Z 0 [Warning] [MY-000000] [WSREP] Node is running in bootstrap/initialize mode. Disabling pxc_strict_mode checks
2022-07-15T20:48:18.747312Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.27-18.1) initializing of server in progress as process 15967
2022-07-15T20:48:18.762096Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.
2022-07-15T20:48:18.762336Z 0 [Note] [MY-000000] [Galera] Loading provider none initial position: 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:48:18.762384Z 0 [Note] [MY-000000] [Galera] wsrep_load(): loading provider library 'none'
2022-07-15T20:48:18.774469Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2022-07-15T20:48:32.738041Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2022-07-15T20:48:36.173097Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --binlog-expire-logs-seconds work.
2022-07-15T20:48:36.426125Z 0 [Warning] [MY-013746] [Server] A deprecated TLS version TLSv1 is enabled for channel mysql_main
2022-07-15T20:48:36.426160Z 0 [Warning] [MY-013746] [Server] A deprecated TLS version TLSv1.1 is enabled for channel mysql_main
2022-07-15T20:48:36.469373Z 6 [Note] [MY-010454] [Server] A temporary password is generated for root@localhost: WFNliT!Yt6et
2022-07-15T20:48:38.961222Z 6 [Note] [MY-000000] [WSREP] MDL conflict db=sys table=sys_config ticket=1 solved by abort
Log of wsrep recovery (--wsrep-recover):
INFO: WSREP: Running position recovery with --log_error='/mnt/data/mysqld/wsrep_recovery_verbose.f0BHrY' --pid-file='/mnt/data/mysqld/mys04-d-recover.pid'
INFO: WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:49:04.583264Z 0 [Warning] [MY-011068] [Server] The syntax 'wsrep_slave_threads' is deprecated and will be removed in a future release. Please use wsrep_applier_threads instead.
2022-07-15T20:49:04.583296Z 0 [Warning] [MY-011070] [Server] 'Disabling symbolic links using --skip-symbolic-links (or equivalent) is the default. Consider not using this option as it' is deprecated and will be removed in a future release.
2022-07-15T20:49:04.588440Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.27-18.1) starting as process 16146
2022-07-15T20:49:04.600127Z 0 [Note] [MY-000000] [Galera] Loading provider /usr/lib64/galera4/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:49:04.600269Z 0 [Note] [MY-000000] [Galera] wsrep_load(): loading provider library '/usr/lib64/galera4/libgalera_smm.so'
2022-07-15T20:49:04.602831Z 0 [Note] [MY-000000] [Galera] wsrep_load(): Galera 4.10(9728532) by Codership Oy <info@codership.com> (modified by Percona <https://percona.com/>) loaded successfully.
2022-07-15T20:49:04.602898Z 0 [Note] [MY-000000] [Galera] CRC-32C: using "slicing-by-8" algorithm.
2022-07-15T20:49:04.603724Z 0 [Warning] [MY-000000] [Galera] Could not open state file for reading: '/mnt/data/mysqld//grastate.dat'
2022-07-15T20:49:04.603768Z 0 [Warning] [MY-000000] [Galera] No persistent state found. Bootstraping with default state
2022-07-15T20:49:04.604246Z 0 [Note] [MY-000000] [Galera] Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1
2022-07-15T20:49:04.606602Z 0 [Note] [MY-000000] [Galera] GCache DEBUG: opened preamble:
Version: 0
UUID: 00000000-0000-0000-0000-000000000000
Seqno: -1 - -1
Offset: -1
Synced: 0
2022-07-15T20:49:04.606637Z 0 [Note] [MY-000000] [Galera] Skipped GCache ring buffer recovery: could not determine history UUID.
2022-07-15T20:49:04.610349Z 0 [Warning] [MY-000000] [Galera] Option 'gcs.fc_master_slave' is deprecated and will be removed in the future versions, please use 'gcs.fc_single_primary' instead.
2022-07-15T20:49:04.611479Z 0 [Note] [MY-000000] [Galera] Passing config to GCS: base_dir = /mnt/data/mysqld/; base_host = IPAddress.39; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /mnt/data/mysqld/; gcache.freeze_purge_at_seqno = -1; gcache.keep_pages_count = 0; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 100; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = true; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 10; socket.checksum = 2; socket.recv_buf_size = auto; socket.send_buf_size = auto;
2022-07-15T20:49:04.623404Z 0 [Note] [MY-000000] [WSREP] Starting replication
2022-07-15T20:49:04.623483Z 0 [Note] [MY-000000] [Galera] Connecting with bootstrap option: 0
2022-07-15T20:49:04.623538Z 0 [Note] [MY-000000] [Galera] Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:49:04.623652Z 0 [Note] [MY-000000] [Galera] protonet asio version 0
2022-07-15T20:49:04.623757Z 0 [Note] [MY-000000] [Galera] Using CRC-32C for message checksums.
2022-07-15T20:49:04.623802Z 0 [Note] [MY-000000] [Galera] backend: asio
2022-07-15T20:49:04.623930Z 0 [Note] [MY-000000] [Galera] gcomm thread scheduling priority set to other:0
2022-07-15T20:49:04.624099Z 0 [Warning] [MY-000000] [Galera] Fail to access the file (/mnt/data/mysqld//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
2022-07-15T20:49:04.624131Z 0 [Note] [MY-000000] [Galera] Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
2022-07-15T20:49:04.624776Z 0 [Note] [MY-000000] [Galera] GMCast version 0
2022-07-15T20:49:04.624979Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2022-07-15T20:49:04.625012Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2022-07-15T20:49:04.625402Z 0 [Note] [MY-000000] [Galera] EVS version 1
2022-07-15T20:49:04.625562Z 0 [Note] [MY-000000] [Galera] gcomm: connecting to group 'mysqla-d', peer 'IPAddress.62:,IPAddress.41:'
2022-07-15T20:49:04.630239Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') connection established to 14d6e6f2-ae30 tcp://IPAddress.41:4567
2022-07-15T20:49:04.630342Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-07-15T20:49:04.743037Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') connection established to 97ed1b68-80f7 tcp://IPAddress.62:4567
2022-07-15T20:49:05.129339Z 0 [Note] [MY-000000] [Galera] EVS version upgrade 0 -> 1
2022-07-15T20:49:05.129413Z 0 [Note] [MY-000000] [Galera] declaring 14d6e6f2-ae30 at tcp://IPAddress.41:4567 stable
2022-07-15T20:49:05.129460Z 0 [Note] [MY-000000] [Galera] declaring 97ed1b68-80f7 at tcp://IPAddress.62:4567 stable
2022-07-15T20:49:05.129525Z 0 [Note] [MY-000000] [Galera] PC protocol upgrade 0 -> 1
2022-07-15T20:49:05.130363Z 0 [Note] [MY-000000] [Galera] Node 14d6e6f2-ae30 state primary
2022-07-15T20:49:05.131665Z 0 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view (view_id(PRIM,14d6e6f2-ae30,48)
memb {
14d6e6f2-ae30,0
90465e57-995b,0
97ed1b68-80f7,0
}
joined {
}
left {
}
partitioned {
}
)
2022-07-15T20:49:05.131717Z 0 [Note] [MY-000000] [Galera] Save the discovered primary-component to disk
2022-07-15T20:49:05.626324Z 0 [Note] [MY-000000] [Galera] gcomm: connected
2022-07-15T20:49:05.626459Z 0 [Note] [MY-000000] [Galera] Changing maximum packet size to 64500, resulting msg size: 32636
2022-07-15T20:49:05.626659Z 0 [Note] [MY-000000] [Galera] Shifting CLOSED -> OPEN (TO: 0)
2022-07-15T20:49:05.626697Z 0 [Note] [MY-000000] [Galera] Opened channel 'mysqla-d'
2022-07-15T20:49:05.626891Z 0 [Note] [MY-000000] [Galera] New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2022-07-15T20:49:05.627076Z 0 [Note] [MY-000000] [Galera] STATE EXCHANGE: Waiting for state UUID.
2022-07-15T20:49:05.627146Z 0 [Note] [MY-000000] [Galera] STATE EXCHANGE: sent state msg: 909549a6-047f-11ed-93d7-96d15ad6cfbd
2022-07-15T20:49:05.627199Z 0 [Note] [MY-000000] [Galera] STATE EXCHANGE: got state msg: 909549a6-047f-11ed-93d7-96d15ad6cfbd from 0 (dbmys02)
2022-07-15T20:49:05.627238Z 0 [Note] [MY-000000] [Galera] STATE EXCHANGE: got state msg: 909549a6-047f-11ed-93d7-96d15ad6cfbd from 2 (dbmys03)
2022-07-15T20:49:05.627390Z 2 [Note] [MY-000000] [WSREP] Starting rollbacker thread 2
2022-07-15T20:49:05.627464Z 1 [Note] [MY-000000] [WSREP] Starting applier thread 1
2022-07-15T20:49:05.629357Z 0 [Note] [MY-000000] [Galera] STATE EXCHANGE: got state msg: 909549a6-047f-11ed-93d7-96d15ad6cfbd from 1 (dbmys04)
2022-07-15T20:49:05.629406Z 0 [Note] [MY-000000] [Galera] Quorum results:
version = 6,
component = PRIMARY,
conf_id = 37,
members = 2/3 (primary/total),
act_id = 11522409,
last_appl. = 11522397,
protocols = 2/10/4 (gcs/repl/appl),
vote policy= 0,
group UUID = b392a4b7-a3c8-11e7-b022-632a7cf1c510
2022-07-15T20:49:05.629493Z 0 [Note] [MY-000000] [Galera] Flow-control interval: [173, 173]
2022-07-15T20:49:05.629530Z 0 [Note] [MY-000000] [Galera] Shifting OPEN -> PRIMARY (TO: 11522410)
2022-07-15T20:49:05.629666Z 1 [Note] [MY-000000] [Galera] ####### processing CC 11522410, local, ordered
2022-07-15T20:49:05.629725Z 1 [Note] [MY-000000] [Galera] Maybe drain monitors from -1 upto current CC event 11522410 upto:-1
2022-07-15T20:49:05.629764Z 1 [Note] [MY-000000] [Galera] Drain monitors from -1 up to -1
2022-07-15T20:49:05.629813Z 1 [Note] [MY-000000] [Galera] Process first view: b392a4b7-a3c8-11e7-b022-632a7cf1c510 my uuid: 90465e57-047f-11ed-995b-af1036d7ff24
2022-07-15T20:49:05.629863Z 1 [Note] [MY-000000] [Galera] Server dbmys04 connected to cluster at position b392a4b7-a3c8-11e7-b022-632a7cf1c510:11522410 with ID 90465e57-047f-11ed-995b-af1036d7ff24
2022-07-15T20:49:05.629899Z 1 [Note] [MY-000000] [WSREP] Server status change disconnected -> connected
2022-07-15T20:49:05.629938Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2022-07-15T20:49:05.630012Z 1 [Note] [MY-000000] [Galera] ####### My UUID: 90465e57-047f-11ed-995b-af1036d7ff24
2022-07-15T20:49:05.630060Z 1 [Note] [MY-000000] [Galera] Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes
2022-07-15T20:49:05.630182Z 0 [Note] [MY-000000] [Galera] Service thread queue flushed.
2022-07-15T20:49:05.630260Z 1 [Note] [MY-000000] [Galera] ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2022-07-15T20:49:05.630301Z 1 [Note] [MY-000000] [Galera] State transfer required:
Group state: b392a4b7-a3c8-11e7-b022-632a7cf1c510:11522410
Local state: 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:49:05.630331Z 1 [Note] [MY-000000] [WSREP] Server status change connected -> joiner
2022-07-15T20:49:05.630369Z 1 [Note] [MY-000000] [WSREP] wsrep_notify_cmd is not defined, skipping notification.
2022-07-15T20:49:05.630553Z 0 [Note] [MY-000000] [WSREP] Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'IPAddress.39' --datadir '/mnt/data/mysqld/' --basedir '/usr/' --plugindir '/usr/lib64/mysql/plugin/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '16146' --mysqld-version '8.0.27-18.1' '' )
2022-07-15T20:49:07.419292Z 1 [Note] [MY-000000] [WSREP] Prepared SST request: xtrabackup-v2|IPAddress.39:4444/xtrabackup_sst//1
2022-07-15T20:49:07.419380Z 1 [Note] [MY-000000] [Galera] Check if state gap can be serviced using IST
2022-07-15T20:49:07.419425Z 1 [Note] [MY-000000] [Galera] Local UUID: 00000000-0000-0000-0000-000000000000 != Group UUID: b392a4b7-a3c8-11e7-b022-632a7cf1c510
2022-07-15T20:49:07.419459Z 1 [Note] [MY-000000] [Galera] ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 11522410, STRv: 3
2022-07-15T20:49:07.419573Z 1 [Note] [MY-000000] [Galera] IST receiver addr using tcp://IPAddress.39:4568
2022-07-15T20:49:07.419823Z 1 [Note] [MY-000000] [Galera] Prepared IST receiver for 0-11522410, listening at: tcp://IPAddress.39:4568
2022-07-15T20:49:07.422124Z 0 [Note] [MY-000000] [Galera] Member 1.0 (dbmys04) requested state transfer from '*any*'. Selected 0.0 (dbmys02)(SYNCED) as donor.
2022-07-15T20:49:07.422171Z 0 [Note] [MY-000000] [Galera] Shifting PRIMARY -> JOINER (TO: 11522410)
2022-07-15T20:49:07.422252Z 1 [Note] [MY-000000] [Galera] Requesting state transfer: success, donor: 0
2022-07-15T20:49:07.422305Z 1 [Note] [MY-000000] [Galera] Resetting GCache seqno map due to different histories.
2022-07-15T20:49:07.422356Z 1 [Note] [MY-000000] [Galera] GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> b392a4b7-a3c8-11e7-b022-632a7cf1c510:11522410
2022-07-15T20:49:08.126729Z 0 [Note] [MY-000000] [Galera] (90465e57-995b, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-07-15T20:49:08.627131Z 0 [Note] [MY-000000] [WSREP-SST] Logging all stderr of SST/XtraBackup to syslog
2022-07-15T20:49:18.897918Z 0 [ERROR] [MY-000000] [WSREP] Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'IPAddress.39' --datadir '/mnt/data/mysqld/' --basedir '/usr/' --plugindir '/usr/lib64/mysql/plugin/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '16146' --mysqld-version '8.0.27-18.1' '' : 2 (No such file or directory)
2022-07-15T20:49:18.898568Z 0 [ERROR] [MY-000000] [WSREP] Failed to read uuid:seqno from joiner script.
2022-07-15T20:49:18.898619Z 0 [ERROR] [MY-000000] [WSREP] SST script aborted with error 2 (No such file or directory)
2022-07-15T20:49:18.898724Z 3 [Note] [MY-000000] [Galera] Processing SST received
2022-07-15T20:49:18.898773Z 3 [Note] [MY-000000] [Galera] SST received: 00000000-0000-0000-0000-000000000000:-1
2022-07-15T20:49:18.898809Z 3 [System] [MY-000000] [WSREP] SST completed
2022-07-15T20:49:18.899018Z 1 [Note] [MY-000000] [Galera] str_proto_ver_: 3 sst_seqno_: -1 cc_seqno: 11522410 req->ist_len(): 74
2022-07-15T20:49:18.899061Z 1 [ERROR] [MY-000000] [Galera] Application received wrong state:
Received: 00000000-0000-0000-0000-000000000000
Required: b392a4b7-a3c8-11e7-b022-632a7cf1c510
2022-07-15T20:49:18.899091Z 1 [ERROR] [MY-000000] [Galera] Application state transfer failed. This is unrecoverable condition, restart required.
2022-07-15T20:49:18.899121Z 1 [Note] [MY-000000] [Galera] ReplicatorSMM::abort()
2022-07-15T20:49:18.899152Z 1 [Note] [MY-000000] [Galera] Closing send monitor...
2022-07-15T20:49:18.899181Z 1 [Note] [MY-000000] [Galera] Closed send monitor.
2022-07-15T20:49:18.899216Z 1 [Note] [MY-000000] [Galera] gcomm: terminating thread
2022-07-15T20:49:18.899265Z 1 [Note] [MY-000000] [Galera] gcomm: joining thread
2022-07-15T20:49:18.899396Z 1 [Note] [MY-000000] [Galera] gcomm: closing backend
2022-07-15T20:49:18.901927Z 1 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view (view_id(NON_PRIM,14d6e6f2-ae30,48)
memb {
90465e57-995b,0
}
joined {
}
left {
}
partitioned {
14d6e6f2-ae30,0
97ed1b68-80f7,0
}
)
2022-07-15T20:49:18.902022Z 1 [Note] [MY-000000] [Galera] PC protocol downgrade 1 -> 0
2022-07-15T20:49:18.902058Z 1 [Note] [MY-000000] [Galera] Current view of cluster as seen by this node
view ((empty))
2022-07-15T20:49:18.902555Z 1 [Note] [MY-000000] [Galera] gcomm: closed
2022-07-15T20:49:18.902634Z 0 [Note] [MY-000000] [Galera] New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2022-07-15T20:49:18.902742Z 0 [Note] [MY-000000] [Galera] Flow-control interval: [100, 100]
2022-07-15T20:49:18.902775Z 0 [Note] [MY-000000] [Galera] Received NON-PRIMARY.
2022-07-15T20:49:18.902802Z 0 [Note] [MY-000000] [Galera] Shifting JOINER -> OPEN (TO: 11522410)
2022-07-15T20:49:18.902833Z 0 [Note] [MY-000000] [Galera] New SELF-LEAVE.
2022-07-15T20:49:18.902872Z 0 [Note] [MY-000000] [Galera] Flow-control interval: [0, 0]
2022-07-15T20:49:18.902900Z 0 [Note] [MY-000000] [Galera] Received SELF-LEAVE. Closing connection.
2022-07-15T20:49:18.902927Z 0 [Note] [MY-000000] [Galera] Shifting OPEN -> CLOSED (TO: 11522410)
2022-07-15T20:49:18.902954Z 0 [Note] [MY-000000] [Galera] RECV thread exiting 0: Success
2022-07-15T20:49:18.903044Z 1 [Note] [MY-000000] [Galera] recv_thread() joined.
2022-07-15T20:49:18.903084Z 1 [Note] [MY-000000] [Galera] Closing replication queue.
2022-07-15T20:49:18.903112Z 1 [Note] [MY-000000] [Galera] Closing slave action queue.
2022-07-15T20:49:18.903155Z 1 [Note] [MY-000000] [Galera] /usr/sbin/mysqld: Terminated.
2022-07-15T20:49:18.903181Z 1 [Note] [MY-000000] [WSREP] Initiating SST cancellation
Here’s the my.cnf, which is essentially the same on all 3 nodes:
[client]
socket=/var/lib/mysql/mysql.sock
[mysqld]
user = mysql
port = PORT
server-id = 4
datadir = /mnt/data/mysql_d
pid-file = /var/run/mysqld/mysqld.pid
log-error = /mnt/data/logs/mysqld.log
log_replica_updates
binlog_expire_logs_seconds=604800
max_connections = 200
thread_handling = pool-of-threads
binlog_format = ROW # In order for Galera to work correctly binlog format should be ROW
default_storage_engine = InnoDB
innodb_buffer_pool_size = 8G # Should be up to %75-80 of memory
innodb_buffer_pool_instances = 8 # each pool instance should be about 1GB
innodb_log_buffer_size = 32M
innodb_log_file_size = 1024M
innodb_flush_log_at_trx_commit = 1 # 1=Default, 0/2 (more perf, less reliability)
innodb_flush_method = O_DIRECT # Avoid double buffering
innodb_flush_neighbors = 0
innodb_autoinc_lock_mode = 2 # changes InnoDB autoincrement locks are managed.2=Interleaved mode
innodb_doublewrite = 1
innodb_numa_interleave = 1
loose-innodb-page-cleaners = 4
loose-innodb-checksum-algorithm = strict_crc32
wsrep_cluster_address = gcomm://IP.39,IP.62,IP.41
wsrep_node_address = IP.39 # Node IP address
wsrep_provider = /usr/lib64/galera4/libgalera_smm.so # path to Galera library
wsrep_sst_method = xtrabackup-v2 # SST method
wsrep_cluster_name = mysql-d # Cluster name. It must be the same for all nodes in your cluster.
wsrep_node_name = dbmys04 # If wsrep_node_name is not specified, system hostname will be used
wsrep_slave_threads=8
wsrep_log_conflicts
pxc_strict_mode = PERMISSIVE # Should be ENFORCING. Set to PERMISSIVE for compatability reasons
symbolic-links = 0 # Disabling symbolic-links is recommended to prevent assorted security risks
skip_name_resolve = ON
max_allowed_packet = 1024M
pxc_encrypt_cluster_traffic = OFF
[sst]
encrypt=0
# ssl-ca=ca.pem
# ssl-cert=server-cert.pem
# ssl-key=server-key.pem
[mysqld_safe]
flush_caches = 1
pid-file = /run/mysqld/mysql.pid
service_startup_timeout=9000
syslog
## Other directories to check. mysqld-safe and mysql-client settings are in these folders
!includedir /etc/my.cnf.d/
##!includedir /etc/percona-xtradb-cluster.conf.d/
- As you can see encryption is off
- I’ve tested port connections (these were already working on 5.7), they work
- I’ve tried starting node 2 as the bootstrap and get the same error
- I’ve tried bootstrapping node 3, and that starts successfully by itself
- I’ve extended service_startup_timeout in both /etc/my.cnf and /usr/bin/mysql-systemd
- I’ve toggled bin-log, which is something I had to do to get node 2 to join successfully
I don’t know what else to do at this point. Every time I try joining node 3, I get the following files in my datadir:
-rw-r----- 1 129M 2022-07-15 16:42 galera.cache
-rw-r----- 1 0 2022-07-15 16:42 sst_in_progress
-rw-r----- 1 0 2022-07-15 16:42 grastate.dat
-rw------- 1 1.7K 2022-07-15 16:41 private_key.pem
-rw-r--r-- 1 452 2022-07-15 16:41 public_key.pem
-rw-r--r-- 1 1.1K 2022-07-15 16:41 client-cert.pem
-rw------- 1 1.7K 2022-07-15 16:41 client-key.pem
-rw-r--r-- 1 1.1K 2022-07-15 16:41 server-cert.pem
-rw------- 1 1.7K 2022-07-15 16:41 server-key.pem
-rw-r--r-- 1 1.1K 2022-07-15 16:41 ca.pem
-rw------- 1 1.7K 2022-07-15 16:41 ca-key.pem
Blank grastate.dat file. However, when I tried to bootstrap just node 3 alone, I get the full output of files you would expect.
any help would be appreciated. thanks
