Hello all,
I have 3 node xtradb cluster and want to add arbiter to that cluster. I followed “https://www.percona.com/doc/percona-xtradb-cluster/8.0/howtos/garbd_howto.html” this article, but arbiter could not communicate even it has network connectivity. What am i missing?
Arbiter log:
2020-11-10 16:26:45.537 INFO: CRC-32C: using hardware acceleration.
2020-11-10 16:26:45.537 INFO: Read config:
daemon: 0
name: garb
address: gcomm://10.10.10.201:4567,10.10.10.202:4567,10.10.10.203:4567
group: pxc-poc
sst: trivial
donor:
options: gcs.fc_limit=9999999; gcs.fc_factor=1.0; gcs.fc_master_slave=yes
cfg:
log:
recv_script:
2020-11-10 16:26:45.539 INFO: protonet asio version 0
2020-11-10 16:26:45.539 INFO: Using CRC-32C for message checksums.
2020-11-10 16:26:45.539 INFO: backend: asio
2020-11-10 16:26:45.539 INFO: gcomm thread scheduling priority set to other:0
2020-11-10 16:26:45.540 WARN: Fail to access the file (./gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
2020-11-10 16:26:45.540 INFO: Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
2020-11-10 16:26:45.540 INFO: GMCast version 0
2020-11-10 16:26:45.540 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) listening at tcp://0.0.0.0:4567
2020-11-10 16:26:45.541 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) multicast: , ttl: 1
2020-11-10 16:26:45.541 INFO: EVS version 1
2020-11-10 16:26:45.541 INFO: gcomm: connecting to group ‘pxc-poc’, peer ‘10.10.10.201:4567,10.10.10.202:4567,10.10.10.203:4567’
2020-11-10 16:26:48.543 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:26:48.543 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.202:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:26:48.543 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.203:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:26:48.543 INFO: announce period timed out (pc.announce_timeout)
2020-11-10 16:26:48.543 INFO: EVS version upgrade 0 → 1
2020-11-10 16:26:48.543 INFO: PC protocol upgrade 0 → 1
2020-11-10 16:26:48.543 WARN: no nodes coming from prim view, prim not possible
2020-11-10 16:26:48.543 INFO: Current view of cluster as seen by this node
view (view_id(NON_PRIM,60f0857d,1)
memb {
60f0857d,0
}
joined {
}
left {
}
partitioned {
}
)
2020-11-10 16:26:49.043 WARN: last inactive check more than PT1.5S (3*evs.inactive_check_period) ago (PT3.50246S), skipping check
2020-11-10 16:26:52.544 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:26:55.544 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.202:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:26:58.545 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:01.545 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.202:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:04.546 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:07.547 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.202:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:10.547 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:13.548 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.202:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:16.548 INFO: (60f0857d, ‘tcp://0.0.0.0:4567’) connection to peer 00000000 with addr tcp://10.10.10.201:4567 timed out, no messages seen in PT3S (gmcast.peer_timeout)
2020-11-10 16:27:18.556 INFO: PC protocol downgrade 1 → 0
2020-11-10 16:27:18.556 INFO: Current view of cluster as seen by this node
view ((empty))
2020-11-10 16:27:18.556 ERROR: failed to open gcomm backend connection: 110: failed to reach primary view (pc.wait_prim_timeout): 110 (Connection timed out)
at gcomm/src/pc.cpp:connect():159
2020-11-10 16:27:18.556 ERROR: gcs/src/gcs_core.cpp:gcs_core_open():220: Failed to open backend connection: -110 (Connection timed out)
2020-11-10 16:27:18.556 ERROR: gcs/src/gcs.cpp:gcs_open():1700: Failed to open channel ‘pxc-poc’ at ‘gcomm://10.10.10.201:4567,10.10.10.202:4567,10.10.10.203:4567’: -110 (Connection timed out)
2020-11-10 16:27:18.556 FATAL: Exception in creating receive loop: Failed to open connection to group: 110 (Connection timed out)
at garb/garb_gcs.cpp:Gcs():35