Hello,
Having 3 nodes its Node1, Node2 and Node3. Node1 having all database and want to synced it on Node2 and 3. When i start the first node with /etc/init.d/mysql bootstrap-pxc it’s getting started smoothly but when i started the Node2 and Node3 they both are going on SST and it fine for me but after some hour both node is showing service failed and sst is in progress, then when i checking logs and size of database showing as like same on node1. Then after start the service mysql start of NODE2 and Node3, the below error is getting and again m doing the boothstrap of node1 again it going to SST mode and remove all database and starting from new, because of this process lot of time is getting waste. please suggest how to solve this issue.
170123 17:57:45 mysqld_safe mysqld from pid file /master_db/Mysql/mysql.pid ended
170123 18:00:33 mysqld_safe Starting mysqld daemon with databases from /master_db/ Mysql/data/mysql_frmfiles
170123 18:00:33 mysqld_safe WSREP: Running position recovery with --log_error=‘/ma ster_db/Mysql/data/mysql_frmfiles/wsrep_recovery.USeNvQ’ --pid-file=‘/master_db/My sql/data/mysql_frmfiles/cluster3-recover.pid’
2017-01-23 18:00:34 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecate d. Please use --explicit_defaults_for_timestamp server option (see documentation f or more details).
170123 18:00:36 mysqld_safe WSREP: Recovered position 00000000-0000-0000-0000-0000 00000000:-1
2017-01-23 18:00:36 0 [Note] WSREP: wsrep_start_position var submitted: ‘00000000- 0000-0000-0000-000000000000:-1’
2017-01-23 18:00:36 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecate d. Please use --explicit_defaults_for_timestamp server option (see documentation f or more details).
2017-01-23 18:00:36 790 [Note] WSREP: Read nil XID from storage engines, skipping position init
2017-01-23 18:00:36 790 [Note] WSREP: wsrep_load(): loading provider library ‘/usr /lib64/libgalera_smm.so’
2017-01-23 18:00:37 790 [Note] WSREP: wsrep_load(): Galera 3.1(r169) by Codership Oy <info@codership.com> loaded successfully.
2017-01-23 18:00:37 790 [Note] WSREP: CRC-32C: using hardware acceleration.
2017-01-23 18:00:37 790 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-0 00000000000:-1
2017-01-23 18:00:37 790 [Note] WSREP: Passing config to GCS: base_host = 192.168.1 4.99; base_port = 4567; cert.log_conflicts = no; gcache.dir = /master_db/Mysql/dat a/mysql_frmfiles/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /master_db/Mysql/data/mysql_frmfiles//galera.cache; gcache.page_size = 128M; gcach e.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_mast er_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_ha rd_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.proto_max = 5
2017-01-23 18:00:37 790 [Note] WSREP: Assign initial position for certification: - 1, protocol version: -1
2017-01-23 18:00:37 790 [Note] WSREP: wsrep_sst_grab()
2017-01-23 18:00:37 790 [Note] WSREP: Start replication
2017-01-23 18:00:37 790 [Note] WSREP: Setting initial position to 00000000-0000-00 00-0000-000000000000:-1
2017-01-23 18:00:37 790 [Note] WSREP: protonet asio version 0
2017-01-23 18:00:37 790 [Note] WSREP: Using CRC-32C (optimized) for message checks ums.
2017-01-23 18:00:37 790 [Note] WSREP: backend: asio
2017-01-23 18:00:37 790 [Note] WSREP: GMCast version 0
2017-01-23 18:00:37 790 [Note] WSREP: (be2ff307-e167-11e6-9378-67ab6650a1b7, ‘tcp: //0.0.0.0:4567’) listening at tcp://0.0.0.0:4567
2017-01-23 18:00:37 790 [Note] WSREP: (be2ff307-e167-11e6-9378-67ab6650a1b7, ‘tcp: //0.0.0.0:4567’) multicast: , ttl: 1
2017-01-23 18:00:37 790 [Note] WSREP: EVS version 0
2017-01-23 18:00:37 790 [Note] WSREP: PC version 0
2017-01-23 18:00:37 790 [Note] WSREP: gcomm: connecting to group ‘dmh’, peer ‘192. 168.14.98:,192.168.14.99:’
2017-01-23 18:00:37 790 [Warning] WSREP: (be2ff307-e167-11e6-9378-67ab6650a1b7, ‘t cp://0.0.0.0:4567’) address ‘tcp://192.168.14.99:4567’ points to own listening add ress, blacklisting
2017-01-23 18:00:37 790 [Note] WSREP: (be2ff307-e167-11e6-9378-67ab6650a1b7, ‘tcp: //0.0.0.0:4567’) address ‘tcp://192.168.14.99:4567’ pointing to uuid be2ff307-e167 -11e6-9378-67ab6650a1b7 is blacklisted, skipping
2017-01-23 18:00:37 790 [Note] WSREP: declaring 7e0092d8-e166-11e6-b52f-1f4a0711bf a0 stable
2017-01-23 18:00:37 790 [Note] WSREP: view(view_id(NON_PRIM,7e0092d8-e166-11e6-b52 f-1f4a0711bfa0,8) memb {
7e0092d8-e166-11e6-b52f-1f4a0711bfa0,0
be2ff307-e167-11e6-9378-67ab6650a1b7,0
} joined {
} left {
} partitioned {
23ee7b37-e167-11e6-b5d0-72e7b4a28f2c,0
45167897-e167-11e6-9397-7259e4573a9f,0
83fe3edf-e166-11e6-90dc-5ac037b37553,0
})
2017-01-23 18:01:07 790 [ERROR] WSREP: failed to open gcomm backend connection: 0: failed to reach primary view: 110 (Connection timed out)
at gcomm/src/pc.cpp:connect():141
2017-01-23 18:01:07 790 [ERROR] WSREP: gcs/src/gcs_core.c:gcs_core_open():196: F led to open backend connection: -110 (Connection timed out)
2017-01-23 18:01:07 790 [ERROR] WSREP: gcs/src/gcs.c:gcs_open():1291: Failed to en channel ‘dmh’ at ‘gcomm://192.168.14.98,192.168.14.99’: -110 (Connection time out)
2017-01-23 18:01:07 790 [ERROR] WSREP: gcs connect failed: Connection timed out
2017-01-23 18:01:07 790 [ERROR] WSREP: wsrep::connect() failed: 7
2017-01-23 18:01:07 790 [ERROR] Aborting
2017-01-23 18:01:07 790 [Note] WSREP: Service disconnected.
2017-01-23 18:01:08 790 [Note] WSREP: Some threads may fail to exit.
2017-01-23 18:01:08 790 [Note] Binlog end
2017-01-23 18:01:08 790 [Note] /usr/sbin/mysqld: Shutdown complete
170123 18:01:08 mysqld_safe mysqld from pid file /master_db/Mysql/mysql.pid ende
^Z
[1]+ Stopped tail -f dmh-amritalive_error.log
[root@cluster3 Mysql]# tail -f dmh-amritalive_error.log
2017-01-23 18:01:07 790 [ERROR] WSREP: gcs connect failed: Connection timed out
2017-01-23 18:01:07 790 [ERROR] WSREP: wsrep::connect() failed: 7
2017-01-23 18:01:07 790 [ERROR] Aborting
2017-01-23 18:01:07 790 [Note] WSREP: Service disconnected.
2017-01-23 18:01:08 790 [Note] WSREP: Some threads may fail to exit.
2017-01-23 18:01:08 790 [Note] Binlog end
2017-01-23 18:01:08 790 [Note] /usr/sbin/mysqld: Shutdown complete
170123 18:01:08 mysqld_safe mysqld from pid file /master_db/Mysql/mysql.pid ended