# Cluster doesnt accept wsrep\_cluster\_address in my.cnf

**URL:** <https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760>\
**Category:** Percona XtraDB Cluster 5.x\
**Created:** [June 17, 2013, 9:46am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760 "2013-06-17T09:46:24Z")\
**Posts on this page:** 17\
**Page:** 1

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 17, 2013, 9:46am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/1 "2013-06-17T09:46:24Z")

</div>

hi experts,

I’m new to percona cluster.  
I just installed it:

sudo apt-get install percona-xtradb-cluster-client-5.5   
percona-xtradb-cluster-server-5.5 percona-xtrabackup

and now try to make it running however without access.

I created /etc/mysql/my.cnf on all 3 nodes which look like this one from the first node:

[client]  
port = 3306  
socket = /var/run/mysqld/mysqld.sock

[mysqld\_safe]  
socket = /var/run/mysqld/mysqld.sock  
nice = 0

[mysqld]

datadir=/var/lib/mysql/

# Path to Galera library

wsrep\_provider=/usr/lib64/libgalera\_smm.so

# Cluster connection URL contains the IPs of node#1, node#2 and node#3

#wsrep\_cluster\_address=gcomm://xxx.xx.xxx.xx1,xxx.xx.xxx.xx2,xxx.xx.xxx.xx3

# In order for Galera to work correctly binlog format should be ROW

binlog\_format=ROW

# MyISAM storage engine has only experimental support

default\_storage\_engine=InnoDB

# This is a recommended tuning variable for performance

innodb\_locks\_unsafe\_for\_binlog=1

# This changes how InnoDB autoincrement locks are managed and is a requirement for Galera

innodb\_autoinc\_lock\_mode=2

# Node #1 address

wsrep\_node\_address=xxx.xx.xxx.xx1

# SST method

wsrep\_sst\_method=xtrabackup

# Cluster name

wsrep\_cluster\_name=my\_debian\_cluster

# Authentication for SST method

wsrep\_sst\_auth=“username:password”

this way mysql starts, but when I comment out wsrep\_cluster\_address:  
wsrep\_cluster\_address=gcomm://xxx.xx.xxx.xx1,xxx.xx.xxx.xx2,xxx.xx.xxx.xx3  
it won’t start.

the first node was started this way:  
/etc/init.d/mysql start --wsrep-cluster-address=“gcomm://”

the two others this way:  
/etc/init.d/mysql start

so none of the nodes accepts wsrep\_cluster\_address option in my.cnf.

OS: debian 6

mysql\> show status like ‘wsrep%’; from 3 nodes looks like this:  
±---------------------------±----------------------------------+  
| Variable\_name | Value |  
±---------------------------±----------------------------------+  
| wsrep\_local\_state\_uuid | |  
| wsrep\_protocol\_version | 18446744073709551615 |  
| wsrep\_last\_committed | 18446744073709551615 |  
| wsrep\_replicated | 0 |  
| wsrep\_replicated\_bytes | 0 |  
| wsrep\_received | 0 |  
| wsrep\_received\_bytes | 0 |  
| wsrep\_local\_commits | 0 |  
| wsrep\_local\_cert\_failures | 0 |  
| wsrep\_local\_bf\_aborts | 0 |  
| wsrep\_local\_replays | 0 |  
| wsrep\_local\_send\_queue | 0 |  
| wsrep\_local\_send\_queue\_avg | 0.000000 |  
| wsrep\_local\_recv\_queue | 0 |  
| wsrep\_local\_recv\_queue\_avg | 0.000000 |  
| wsrep\_flow\_control\_paused | 0.000000 |  
| wsrep\_flow\_control\_sent | 0 |  
| wsrep\_flow\_control\_recv | 0 |  
| wsrep\_cert\_deps\_distance | 0.000000 |  
| wsrep\_apply\_oooe | 0.000000 |  
| wsrep\_apply\_oool | 0.000000 |  
| wsrep\_apply\_window | 0.000000 |  
| wsrep\_commit\_oooe | 0.000000 |  
| wsrep\_commit\_oool | 0.000000 |  
| wsrep\_commit\_window | 0.000000 |  
| wsrep\_local\_state | 0 |  
| wsrep\_local\_state\_comment | Initialized |  
| wsrep\_cert\_index\_size | 0 |  
| wsrep\_causal\_reads | 0 |  
| wsrep\_incoming\_addresses | |  
| wsrep\_cluster\_conf\_id | 18446744073709551615 |  
| wsrep\_cluster\_size | 0 |  
| wsrep\_cluster\_state\_uuid | |  
| wsrep\_cluster\_status | Disconnected |  
| wsrep\_connected | OFF |  
| wsrep\_local\_index | 18446744073709551615 |  
| wsrep\_provider\_name | Galera |  
| wsrep\_provider\_vendor | Codership Oy \<info@codership.com\> |  
| wsrep\_provider\_version | 2.5(r150) |  
| wsrep\_ready | OFF

what am I doing wrong?  
thank you indeed!

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 17, 2013, 10:25am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/2 "2013-06-17T10:25:33Z")

</div>

now I could start the first node with:  
wsrep\_cluster\_address=gcomm://  
in my.cnf

however in the documentation they recommend :  
After this single-node cluster is started, variable wsrep\_cluster\_address should be updated to the list of all nodes in the cluster. For example:  
wsrep\_cluster\_address=gcomm://192.168.70.2,192.168.70.3,192.168.70.4

so I stop mysql , change it in my.cnf to wsrep\_cluster\_address=gcomm://xxx.xx.xxx.xx1,xxx.xx.xxx.xx2,xxx.xx.xxx.xx3  
and it fails again!  
where is the mistake?

---

<div class="post-metadata">

**Author:** ![percona.jayj](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/percona.jayj/32/927_2.png) [@percona.jayj](https://forums.percona.com/u/percona.jayj)\
**Post date:** [June 20, 2013, 12:16pm UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/3 "2013-06-20T12:16:38Z")

</div>

All of your nodes (including the first node) are in Initialized state? Paste your logs.

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 6:40am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/4 "2013-06-21T06:40:52Z")

</div>

here you go

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 6:42am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/5 "2013-06-21T06:42:45Z")

</div>

attachments from 3 nodes

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 6:45am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/6 "2013-06-21T06:45:30Z")

</div>

attachment function in this forum doesnt seem to work

---

<div class="post-metadata">

**Author:** ![percona.jayj](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/percona.jayj/32/927_2.png) [@percona.jayj](https://forums.percona.com/u/percona.jayj)\
**Post date:** [June 21, 2013, 7:14am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/7 "2013-06-21T07:14:23Z")

</div>

Hmm, I let someone know. In the meantime, you can put them on pastebin or [sprunge.us](http://sprunge.us) (or similar) and just paste the links.

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 7:29am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/8 "2013-06-21T07:29:51Z")

</div>

[URL][Dropbox - Error](https://www.dropbox.com/sh/odcod4fnwivcx6q/EvD7g8Y9Ti%5B/URL%5D)

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 8:58am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/9 "2013-06-21T08:58:34Z")

</div>

3 uploaded files here

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 8:59am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/10 "2013-06-21T08:59:14Z")

</div>

1 file here

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 21, 2013, 9:01am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/11 "2013-06-21T09:01:18Z")

</div>

ok doesnt work, please use the link to dropbox.  
by the way this forums threads can’t be seen in chrome browser, at least in the chrome version for linux

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [June 24, 2013, 7:58am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/12 "2013-06-24T07:58:11Z")

</div>

no worries, but bump

---

<div class="post-metadata">

**Author:** ![percona.jayj](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/percona.jayj/32/927_2.png) [@percona.jayj](https://forums.percona.com/u/percona.jayj)\
**Post date:** [July 4, 2013, 7:49am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/13 "2013-07-04T07:49:21Z")

</div>

Sorry for the delayed reply here Zuri.

Rereading your comments, I think you’re confused about how to bootstrap the cluster. The first node must be bootstrapped by providing ‘wsrep\_cluster\_address=gcomm://’.  
This first node should have a status like this:

mysql\> show status like ‘wsrep%’; from 3 nodes looks like this:  
±---------------------------±----------------------------------+  
| Variable\_name | Value |  
±---------------------------±----------------------------------+  
| wsrep\_local\_state\_comment | Synced |  
| wsrep\_cluster\_conf\_id | 1 |  
| wsrep\_cluster\_size | 1 |  
| wsrep\_cluster\_status | Primary |  
| wsrep\_connected | ON |  
| wsrep\_ready | ON

After this node is started in this state, you can start the other nodes with the full wsrep\_cluster\_address. They _should_ SST and join the cluster (you should see the cluster size increase, and all nodes in the Synced and Primary states).

After you get the other nodes started, you do want to make sure the first node’s my.cnf has your full cluster address (a restart is not required after you get the other nodes up).

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [July 8, 2013, 8:38am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/14 "2013-07-08T08:38:30Z")

</div>

hi percona.jayj,

I’ve given it an one more try.

first node’s my.cnf:  
wsrep\_cluster\_address=gcomm://  
started like this:  
/etc/init.d/mysql start --wsrep-cluster-address=“gcomm://”

so far success and

mysql\> show status like ‘wsrep%’;  
±---------------------------±----------------------------------+  
| Variable\_name | Value |  
±---------------------------±----------------------------------+  
| wsrep\_local\_state\_comment | Synced |  
| wsrep\_cluster\_conf\_id | 1 |  
| wsrep\_cluster\_size | 1 |  
| wsrep\_cluster\_status | Primary |  
| wsrep\_connected | ON |  
| wsrep\_ready | ON

looks ok.

second node’s my.cnf:  
wsrep\_cluster\_address=gcomm://first\_nod\_ip\_here,second\_node\_ip\_here

second node started like this:  
/etc/init.d/mysql start

start not successfull. error log shows:

130708 15:41:28 mysqld\_safe Starting mysqld daemon with databases from /var/lib/mysql  
130708 15:41:28 mysqld\_safe WSREP: Running position recovery with --log\_error=/tmp/tmp.QIFh4U6aiJ  
130708 15:41:33 mysqld\_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1  
130708 15:41:33 [Note] WSREP: wsrep\_start\_position var submitted: ‘00000000-0000-0000-0000-000000000000:-1’  
130708 15:41:33 [Note] WSREP: Read nil XID from storage engines, skipping position init  
130708 15:41:33 [Note] WSREP: wsrep\_load(): loading provider library ‘/usr/lib64/libgalera\_smm.so’  
130708 15:41:33 [Note] WSREP: wsrep\_load(): Galera 2.5(r150) by Codership Oy \<info@codership.com\> loaded succesfully.  
130708 15:41:33 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1  
130708 15:41:33 [Note] WSREP: Reusing existing ‘/var/lib/mysql//galera.cache’.  
130708 15:41:33 [Note] WSREP: Passing config to GCS: base\_host = second\_node\_ip\_here; base\_port = 4567; cert.log\_conflicts = no; gcache.dir = /var/lib/mysql/; gcache.keep\_pages\_size = 0; gcache.mem\_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page\_size = 128M; gcache.size = 128M; gcs.fc\_debug = 0; gcs.fc\_factor = 1; gcs.fc\_limit = 16; gcs.fc\_master\_slave = NO; gcs.max\_packet\_size = 64500; gcs.max\_throttle = 0.25; gcs.recv\_q\_hard\_limit = 9223372036854775807; gcs.recv\_q\_soft\_limit = 0.25; gcs.sync\_donor = NO; replicator.causal\_read\_timeout = PT30S; replicator.commit\_order = 3  
130708 15:41:33 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1  
130708 15:41:33 [Note] WSREP: wsrep\_sst\_grab()  
130708 15:41:33 [Note] WSREP: Start replication  
130708 15:41:33 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1  
130708 15:41:33 [Note] WSREP: protonet asio version 0  
130708 15:41:33 [Note] WSREP: backend: asio  
130708 15:41:33 [Note] WSREP: GMCast version 0  
130708 15:41:33 [Note] WSREP: (1a786454-e7d4-11e2-0800-4bed3fdb41d0, ‘tcp://0.0.0.0:4567’) listening at tcp://0.0.0.0:4567  
130708 15:41:33 [Note] WSREP: (1a786454-e7d4-11e2-0800-4bed3fdb41d0, ‘tcp://0.0.0.0:4567’) multicast: , ttl: 1  
130708 15:41:33 [Note] WSREP: EVS version 0  
130708 15:41:33 [Note] WSREP: PC version 0  
130708 15:41:33 [Note] WSREP: gcomm: connecting to group ‘my\_wsrep\_cluster’, peer ‘first\_node\_ip\_here:,second\_node\_ip\_here:’  
130708 15:41:33 [Warning] WSREP: (1a786454-e7d4-11e2-0800-4bed3fdb41d0, ‘tcp://0.0.0.0:4567’) address ‘tcp://second\_node\_ip\_here:4567’ points to own listening address, blacklisting  
130708 15:41:36 [Warning] WSREP: no nodes coming from prim view, prim not possible  
130708 15:41:36 [Note] WSREP: view(view\_id(NON\_PRIM,1a786454-e7d4-11e2-0800-4bed3fdb41d0,1) memb {  
1a786454-e7d4-11e2-0800-4bed3fdb41d0,  
} joined {  
} left {  
} partitioned {  
})  
130708 15:41:37 [Warning] WSREP: last inactive check more than PT1.5S ago, skipping check  
130708 15:42:06 [Note] WSREP: view((empty))  
130708 15:42:06 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)  
at gcomm/src/pc.cpp:connect():139  
130708 15:42:06 [ERROR] WSREP: gcs/src/gcs\_core.c:gcs\_core\_open():195: Failed to open backend connection: -110 (Connection timed out)  
130708 15:42:06 [ERROR] WSREP: gcs/src/gcs.c:gcs\_open():1290: Failed to open channel ‘my\_wsrep\_cluster’ at ‘gcomm://first\_node\_ip\_here,second\_node\_ip\_here’: -110 (Connection timed out)  
130708 15:42:06 [ERROR] WSREP: gcs connect failed: Connection timed out  
130708 15:42:06 [ERROR] WSREP: wsrep::connect() failed: 6  
130708 15:42:06 [ERROR] Aborting

130708 15:42:06 [Note] WSREP: Service disconnected.  
130708 15:42:07 [Note] WSREP: Some threads may fail to exit.  
130708 15:42:07 [Note] /usr/sbin/mysqld: Shutdown complete

130708 15:42:07 mysqld\_safe mysqld from pid file /var/lib/mysql/first\_node\_dnsname\_here.pid ended  
130708 15:42:56 mysqld\_safe Starting mysqld daemon with databases from /var/lib/mysql  
130708 15:42:56 mysqld\_safe WSREP: Running position recovery with --log\_error=/tmp/tmp.LgQydon7i3  
130708 15:43:01 mysqld\_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1  
130708 15:43:01 [Note] WSREP: wsrep\_start\_position var submitted: ‘00000000-0000-0000-0000-000000000000:-1’  
130708 15:43:01 [Note] WSREP: Read nil XID from storage engines, skipping position init  
130708 15:43:01 [Note] WSREP: wsrep\_load(): loading provider library ‘/usr/lib64/libgalera\_smm.so’  
130708 15:43:01 [Note] WSREP: wsrep\_load(): Galera 2.5(r150) by Codership Oy \<info@codership.com\> loaded succesfully.  
130708 15:43:01 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1  
130708 15:43:01 [Note] WSREP: Reusing existing ‘/var/lib/mysql//galera.cache’.  
130708 15:43:01 [Note] WSREP: Passing config to GCS: base\_host = second\_node\_ip\_here; base\_port = 4567; cert.log\_conflicts = no; gcache.dir = /var/lib/mysql/; gcache.keep\_pages\_size = 0; gcache.mem\_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page\_size = 128M; gcache.size = 128M; gcs.fc\_debug = 0; gcs.fc\_factor = 1; gcs.fc\_limit = 16; gcs.fc\_master\_slave = NO; gcs.max\_packet\_size = 64500; gcs.max\_throttle = 0.25; gcs.recv\_q\_hard\_limit = 9223372036854775807; gcs.recv\_q\_soft\_limit = 0.25; gcs.sync\_donor = NO; replicator.causal\_read\_timeout = PT30S; replicator.commit\_order = 3  
130708 15:43:01 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1  
130708 15:43:01 [Note] Plugin ‘FEDERATED’ is disabled.  
130708 15:43:01 InnoDB: The InnoDB memory heap is disabled  
130708 15:43:01 InnoDB: Mutexes and rw\_locks use GCC atomic builtins  
130708 15:43:01 InnoDB: Compressed tables use zlib 1.2.3  
130708 15:43:01 InnoDB: Using Linux native AIO  
130708 15:43:01 InnoDB: Initializing buffer pool, size = 128.0M  
130708 15:43:01 InnoDB: Completed initialization of buffer pool  
130708 15:43:01 InnoDB: highest supported file format is Barracuda.  
130708 15:43:02 InnoDB: Waiting for the background threads to start  
130708 15:43:03 Percona XtraDB ([http://www.percona.com](http://www.percona.com)) 5.5.30-rel30.2 started; log sequence number 1598139  
130708 15:43:03 [Note] Event Scheduler: Loaded 0 events  
130708 15:43:03 [Note] /usr/sbin/mysqld: ready for connections.  
Version: ‘5.5.30-30.2’ socket: ‘/var/run/mysqld/mysqld.sock’ port: 3306 Percona Server (GPL), Release 30.2, wsrep\_23.7.4.r3843

after deleting wsrep\_cluster\_address=gcomm://first\_nod\_ip\_here,second\_node\_ip\_here  
in my.cnf on second node, mysql on second node can be started successfull.

Any thoughts or ideas?

regards,  
zuri

---

<div class="post-metadata">

**Author:** ![percona.jayj](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/percona.jayj/32/927_2.png) [@percona.jayj](https://forums.percona.com/u/percona.jayj)\
**Post date:** [July 12, 2013, 1:47pm UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/15 "2013-07-12T13:47:27Z")

</div>

Can your second node connect to your first node on TCP port 4567? It looks to me like it cannot.

---

<div class="post-metadata">

**Author:** ![zuri](https://avatars.discourse-cdn.com/v4/letter/z/b9bd4f/32.png) [@zuri](https://forums.percona.com/u/zuri)\
**Post date:** [July 16, 2013, 6:54am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/16 "2013-07-16T06:54:40Z")

</div>

I have tried to find documantation for this. no luck. can you provide me some links?

I can only guess to write into my.cnf on all notes:  
wsrep\_provider\_options ="gmcast.listen\_addr=tcp://0.0.0.0:4567;

but actually it should only be used to overwrite the default port which is 4567

---

<div class="post-metadata">

**Author:** ![klausdk](https://avatars.discourse-cdn.com/v4/letter/k/d26b3c/32.png) [@klausdk](https://forums.percona.com/u/klausdk)\
**Post date:** [November 14, 2013, 8:52am UTC](https://forums.percona.com/t/cluster-doesnt-accept-wsrep-cluster-address-in-my-cnf/2760/17 "2013-11-14T08:52:44Z")

</div>

I had a lot of trouble with this too.

​I was running 5.5.28 and it worked, but after upgrading to 5.5.34 it didn’t.

After some trouble I tried to move wsrep\_cluster\_address from [mysqld\_safe] section to [mysqld] and now it works.