# WSREP: SST failed: 1 (Operation not permitted) **URL:** \ **Category:** Percona XtraDB Cluster 5.x\ **Created:** [July 4, 2014, 2:52am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595 "2014-07-04T02:52:03Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [July 4, 2014, 2:52am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/1 "2014-07-04T02:52:03Z")
Hi everybody, I upgrade my nodes one by one in PXC 5.6 but I have a problem with my second node. This error message is : 2014-07-04 10:01:31 11953 [ERROR] WSREP: Process completed with error: wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘192.168.xx.xx’ --auth ‘_ **:** _\*\*\*’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/mysql/my.cnf’ --parent ‘11953’ ‘’ : 1 (Operation not permitted) 2014-07-04 10:01:31 11953 [ERROR] WSREP: Failed to read uuid:seqno from joiner script. 2014-07-04 10:01:31 11953 [ERROR] WSREP: SST failed: 1 (Operation not permitted) 2014-07-04 10:01:31 11953 [ERROR] Aborting So it can’t start, I don’t understand why because it’s ok for the others. Thx for your help ---
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [July 8, 2014, 9:49am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/2 "2014-07-08T09:49:05Z")
Hi everybody, I decide to create a new node with PXC 5.6 and now I have this error message : 2014-07-08 17:14:32 29001 [ERROR] WSREP: Process completed with error: wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘192.168.60.12’ --auth ‘sst:\*\*\*\*\*\*\*’ --datadir ‘/var/lib/mysql/’ --defaults-file ‘/etc/mysql/my.cnf’ --parent ‘29001’ ‘’ : 22 (Invalid argument) 2014-07-08 17:14:32 29001 [ERROR] WSREP: Failed to read uuid:seqno from joiner script. 2014-07-08 17:14:32 29001 [ERROR] WSREP: SST failed: 22 (Invalid argument) 2014-07-08 17:14:32 29001 [ERROR] Aborting I think there is a big bug with PXC 5.6 Thx for your help ---
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [July 8, 2014, 10:29am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/3 "2014-07-08T10:29:40Z")
Hi I solve my second problem, it’s becaus I’ve forgotted to install qpress. But I have always my first error message. I want to know how can I disable the “Cleaning the existing datadir”. When I start the second and third node, it’s removing all databases even mysql and performance\_schema database Thx ---
**Author:** ![taka-h](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/taka-h/32/1023_2.png) [@taka-h](https://forums.percona.com/u/taka-h)\ **Post date:** [July 23, 2014, 6:37am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/4 "2014-07-23T06:37:48Z")
> I want to know how can I disable the “Cleaning the existing datadir”. I think this is not the error message and there happens normal SST. ---
**Author:** ![rennschnecke](https://avatars.discourse-cdn.com/v4/letter/r/3d9bf3/32.png) [@rennschnecke](https://forums.percona.com/u/rennschnecke)\ **Post date:** [July 23, 2014, 6:53am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/5 "2014-07-23T06:53:54Z")
This is normal using xbstream! Use tar and this is no problem any more but then you don’t have compact, compress, … → less performance! ---
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [April 19, 2017, 1:44am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/6 "2017-04-19T01:44:52Z")
Hi everybody, I have again this error with 2 nodes : WSREP\_SST: [ERROR] Cleanup after exit with status:1 (20170418 18:59:02.528) 2017-04-18 18:59:02 140072523396864 [ERROR] WSREP: Process completed with error: wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘10.91.18.32’ --datadir ‘/data/mariadb/’ --parent ‘4872’ ‘’ : 1 (Operation not permitted) 2017-04-18 18:59:02 140072523396864 [ERROR] WSREP: Failed to read uuid:seqno and wsrep\_gtid\_domain\_id from joiner script. 2017-04-18 18:59:02 140075136813312 [ERROR] WSREP: SST failed: 1 (Operation not permitted) 2017-04-18 18:59:02 140075136813312 [ERROR] Aborting Error in my\_thread\_global\_end(): 1 threads didn’t exit And in the innobackup.move.log : 170418 17:57:30 innobackupex: Starting the move-back operation IMPORTANT: Please check that the move-back run completes successfully. At the end of a successful move-back run innobackupex prints “completed OK!”. innobackupex version 2.4.7 based on MySQL server 5.7.13 Linux (x86\_64) (revision id: 6f7a799) Error: datadir must be specified. My conf file is : # # These groups are read by MariaDB server. # Use it for options that only the server (but not clients) should see # # See the examples of server my.cnf files in /usr/share/mysql/ # # this is read by the standalone daemon and embedded servers [server] ## ## mysqld options _MANDATORY_ for correct opration of the cluster ## [mysqld\_safe] flush\_cache = 1 numa\_interleave = 1 [xtrabackup] compress parallel=8 compress-threads=8 # 2014-09-09 #rebuild-threads=8 #compact [sst] streamfmt=xbstream # this is only for the mysqld standalone daemon [mysqld] # # \* Galera-related settings # [galera] # Mandatory settings wsrep\_provider=“/usr/lib64/galera/libgalera\_smm.so” wsrep\_cluster\_address=“gcomm://yy.yy.yyy.yyy” wsrep\_provider\_options=“gcache.size=2G; evs.keepalive\_period=PT3S; evs.inactive\_check\_period=PT10S; evs.suspect\_timeout=PT1M; evs.inactive\_timeout=PT1M; evs.install\_timeout=PT1M; cert.log\_conflicts=1” #wsrep\_provider\_options=“gcache.size=2G; cert.log\_conflicts=1” binlog\_format=row wsrep\_cluster\_name=“prodealcenter\_cluster” wsrep\_sst\_method=xtrabackup-v2 wsrep\_on=ON wsrep\_node\_address=“xx.xx.xx.xx” wsrep\_node\_name=“mdb02” # SST authentication string. This will be used to send SST to joining nodes. # Depends on SST method. For mysqldump method it is root: wsrep\_sst\_auth=sst:zzzzzzzzzzz # # Optional setting #wsrep\_slave\_threads=1 #innodb\_flush\_log\_at\_trx\_commit=0 # this is only for embedded server [embedded] # This group is only read by MariaDB servers, not by MySQL. # If you use the same .cnf file for MySQL and MariaDB, # you can put MariaDB-only options here [mariadb] # This group is only read by MariaDB-10.1 servers. # If you use the same .cnf file for MariaDB of different versions, # use this group for options that older servers don’t understand [mariadb-10.1] # \* Basic Settings # user = mysql #socket = /var/lib/mariadb/mariadb.sock socket = /var/lib/mysql/mysql.sock port = 3306 basedir = /usr datadir = /data/mariadb #datadir = /var/lib/mysql tmpdir = /tmp lc-messages-dir = /usr/share/mysql skip-external-locking explicit\_defaults\_for\_timestamp #auto\_increment\_increment = 2 #auto\_increment\_offset = 2 character-set-server=utf8 collation-server=utf8\_general\_ci pid-file=/data/mariadb/mariadb.pid # Instead of skip-networking the default is now to listen only on # localhost which is more compatible and is not less secure. bind-address = xx.xx.xx.xx # # \* Fine Tuning General # thread\_stack = 192K tmp\_table\_size = 64M thread\_cache\_size = 8 table\_open\_cache = 400 join\_buffer\_size=2M key\_buffer\_size=50M max\_allowed\_packet = 512M skip-name-resolve skip-host-cache max\_connections=200 # \* Fine Tuning InnoDB default-storage-engine=innodb innodb\_file\_format=Barracuda innodb\_file\_format\_max=Barracuda innodb\_flush\_log\_at\_trx\_commit=2 sync\_binlog=0 innodb\_io\_capacity=1000 innodb\_io\_capacity\_max=10000 innodb\_log\_file\_size=256M innodb\_log\_files\_in\_group=3 innodb\_max\_dirty\_pages\_pct=75 innodb\_read\_io\_threads=16 innodb\_write\_io\_threads=16 innodb\_stats\_on\_metadata=0 innodb\_support\_xa=0 innodb\_thread\_concurrency=0 innodb\_autoinc\_lock\_mode=2 innodb\_buffer\_pool\_size=16G innodb\_buffer\_pool\_dump\_at\_shutdown=1 innodb\_buffer\_pool\_load\_at\_startup=1 innodb\_print\_all\_deadlocks=1 # \* Query Cache Configuration # query\_cache\_type = 1 query\_cache\_size = 256M query\_cache\_limit = 2M # \* Logging and Replication # # Both location gets rotated by the cronjob. # Be aware that this log type is a performance killer. # As of 5.1 you can enable the log at runtime! #general\_log\_file = /var/log/mariadb/mariadb.log #general\_log = 1 # # # Here you can see queries with especially long duration slow\_query\_log = 1 slow\_query\_log\_file = /var/log/mariadb/mariadb-slow.log long\_query\_time = 2 log-queries-not-using-indexes # #Error log log-error=/var/log/mariadb/mariadb-error.log # # # The following can be used as easy to replay backup logs or for replication. # note: if you are setting up a replication slave, see README.Debian about # other settings you may need to change. #server-id = 2 #log\_bin = /var/log/mariadb/mariadb-bin.log #expire\_logs\_days = 2 #max\_binlog\_size = 100M # \* InnoDB # # InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/. # Read the manual for more InnoDB related options. There are many! # # It seems that we need this for successful mysql-5.1 → mysql-5.6 upgrade innodb\_data\_file\_path=ibdata1:10M:autoextend # Disabling symbolic-links is recommended to prevent assorted security risks symbolic-links=0 # Recommended in standard MySQL setup sql\_mode=NO\_ENGINE\_SUBSTITUTION,STRICT\_TRANS\_TABLES I install all tools : percona-xtrabackup-24, qpress and socat I disable iptables and selinux But always the problem Can u help me please Thx ---
**Author:** ![Kenn\_Takara](https://avatars.discourse-cdn.com/v4/letter/k/b2d939/32.png) [@Kenn\_Takara](https://forums.percona.com/u/Kenn_Takara)\ **Post date:** [April 19, 2017, 7:37pm UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/7 "2017-04-19T19:37:08Z")
The config file lists the options (like the datadir) under the [mariadb] and [mariadb-10.1] sections, the xtrabackup-v2 SST scripts will not read the values from those sections. For PXC, those will have to be moved under [mysqld] ---
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [April 20, 2017, 1:39am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/8 "2017-04-20T01:39:11Z")
Hi Kenn, Thx for your response but I use MariaDB. I thought xtrabackup worked the same way for PXC. No ? Kind regards ---
**Author:** ![azigui](https://avatars.discourse-cdn.com/v4/letter/a/cab0a1/32.png) [@azigui](https://forums.percona.com/u/azigui)\ **Post date:** [April 20, 2017, 3:14am UTC](https://forums.percona.com/t/wsrep-sst-failed-1-operation-not-permitted/3595/9 "2017-04-20T03:14:44Z")
Hi Kenn, Thx a lot I move my options in mysqld section and it’s working successfully