# Wresp breakdown WSREP: fork() failed: 12 (Cannot allocate memory) **URL:** \ **Category:** Percona XtraDB Cluster 5.x\ **Created:** [March 10, 2015, 11:34am UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097 "2015-03-10T11:34:00Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![simonhoenscheid](https://avatars.discourse-cdn.com/v4/letter/s/6de8d8/32.png) [@simonhoenscheid](https://forums.percona.com/u/simonhoenscheid)\ **Post date:** [March 10, 2015, 11:34am UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097/1 "2015-03-10T11:34:00Z")
We use percona cluster on debian wheezy. last cluster was build two weeks ago and worked properly. Today we tried startuing a new one and get memory errors from wresp. dpkg -l|grep galera ii percona-xtradb-cluster-galera-3 3.9.3494.wheezy amd64 Metapackage for latest version of galera3. ii percona-xtradb-cluster-galera-3.x 3.9.3494.wheezy amd64 Galera components of Percona XtraDB Cluster 150310 17:48:52 mysqld\_safe Starting mysqld\_using\_numa daemon with databases from /data/mysql 150310 17:48:52 mysqld\_safe WSREP: Running position recovery with --log\_error=‘/data/mysql/wsrep\_recovery.35GNao’ --pid-file=‘/data/mysql/galeranode-02-recover.pid’ 2015-03-10 17:48:55 0 [Warning] Using unique option prefix sort\_buffer instead of sort\_buffer\_size is deprecated and will be removed in a future release. Please use the full name instead. 2015-03-10 17:48:55 0 [Warning] Using unique option prefix thread\_cache instead of thread\_cache\_size is deprecated and will be removed in a future release. Please use the fu ll name instead. 2015-03-10 17:48:55 0 [Warning] ‘THREAD\_CONCURRENCY’ is deprecated and will be removed in a future release. 2015-03-10 17:48:55 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit\_defaults\_for\_timestamp server option (see documentation for more d etails). 150310 17:48:58 mysqld\_safe WSREP: Recovered position fafe51f0-c743-11e4-9db3-765772f3dde5:15 Log of wsrep recovery (–wsrep-recover): 2015-03-10 17:48:55 15254 [Warning] Using unique option prefix myisam\_recover instead of myisam-recover-options is deprecated and will be removed in a future release. Please use the full name instead. 2015-03-10 17:48:55 15254 [Warning] option ‘innodb-log-files-in-group’: unsigned value 1 adjusted to 2 InnoDB: Warning: innodb\_log\_block\_size has been changed from default value 512. (###EXPERIMENTAL### operation) InnoDB: The log block size is set to 4096. 2015-03-10 17:48:55 7f563d5f5720 InnoDB: Warning: Using innodb\_additional\_mem\_pool\_size is DEPRECATED. This option may be removed in future releases, together with the optio n innodb\_use\_sys\_malloc and with the InnoDB’s internal memory allocator. 2015-03-10 17:48:55 7f563d5f5720 InnoDB: Warning: Using innodb\_locks\_unsafe\_for\_binlog is DEPRECATED. This option may be removed in future releases. Please use READ COMMITTE D transaction isolation level instead, see [url][http://dev.mysql.com/doc/refman/5.6/en/set-transaction.html[/url]](http://dev.mysql.com/doc/refman/5.6/en/set-transaction.html%5B/url%5D). 2015-03-10 17:48:55 15254 [Note] InnoDB: Using atomics to ref count buffer pool pages 2015-03-10 17:48:55 15254 [Note] InnoDB: The InnoDB memory heap is disabled 2015-03-10 17:48:55 15254 [Note] InnoDB: Mutexes and rw\_locks use GCC atomic builtins 2015-03-10 17:48:55 15254 [Note] InnoDB: Memory barrier is not used 2015-03-10 17:48:55 15254 [Note] InnoDB: Compressed tables use zlib 1.2.7 2015-03-10 17:48:55 15254 [Note] InnoDB: Using Linux native AIO 2015-03-10 17:48:55 15254 [Note] InnoDB: Not using CPU crc32 instructions 2015-03-10 17:48:55 15254 [Note] InnoDB: Initializing buffer pool, size = 5.5G InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool InnoDB: HugeTLB: Warning: Failed to allocate 601882624 bytes. errno 22 InnoDB HugeTLB: Warning: Using conventional memory pool 2015-03-10 17:48:55 15254 [Note] InnoDB: Completed initialization of buffer pool 2015-03-10 17:48:55 15254 [Note] InnoDB: Highest supported file format is Barracuda. 2015-03-10 17:48:55 15254 [Note] InnoDB: 128 rollback segment(s) are active. 2015-03-10 17:48:55 15254 [Note] InnoDB: Waiting for purge to start 2015-03-10 17:48:55 15254 [Note] InnoDB: Percona XtraDB ([http://www.percona.com](http://www.percona.com)) 5.6.22-72.0 started; log sequence number 1647917 2015-03-10 17:48:55 15254 [Warning] InnoDB: Skipping buffer pool dump/restore during wsrep recovery. 2015-03-10 17:48:55 15254 [Warning] /usr/sbin/mysqld: unknown variable ‘loose\_handlersocket\_port=9998’ 2015-03-10 17:48:55 15254 [Warning] /usr/sbin/mysqld: unknown variable ‘loose\_handlersocket\_port\_wr=9999’ 2015-03-10 17:48:55 15254 [Warning] /usr/sbin/mysqld: unknown variable ‘loose\_handlersocket\_threads=16’ 2015-03-10 17:48:55 15254 [Warning] /usr/sbin/mysqld: unknown variable ‘loose\_handlersocket\_threads\_wr=1’ 2015-03-10 17:48:56 15254 [Note] RSA private key file not found: /data/mysql//private\_key.pem. Some authentication plugins will not work. 2015-03-10 17:48:56 15254 [Note] RSA public key file not found: /data/mysql//public\_key.pem. Some authentication plugins will not work. 2015-03-10 17:48:56 15254 [Note] Server hostname (bind-address): ‘\*’; port: 33306 2015-03-10 17:48:56 15254 [Note] IPv6 is available. 2015-03-10 17:48:56 15254 [Note] - ‘::’ resolves to ‘::’; 2015-03-10 17:48:56 15254 [Note] Server socket created on IP: ‘::’. 2015-03-10 17:48:56 15254 [Note] WSREP: Recovered position: fafe51f0-c743-11e4-9db3-765772f3dde5:15 2015-03-10 17:48:56 15254 [Note] Binlog end 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘partition’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘PERFORMANCE\_SCHEMA’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘BLACKHOLE’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CHANGED\_PAGES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_DATAFILES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_TABLESPACES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_FOREIGN\_COLS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_FOREIGN’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_FIELDS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_COLUMNS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_INDEXES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_TABLESTATS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_SYS\_TABLES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_INDEX\_TABLE’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_INDEX\_CACHE’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_CONFIG’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_BEING\_DELETED’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_DELETED’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_FT\_DEFAULT\_STOPWORD’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_METRICS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_BUFFER\_POOL\_STATS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_BUFFER\_PAGE\_LRU’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_BUFFER\_PAGE’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMP\_PER\_INDEX\_RESET’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMP\_PER\_INDEX’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMPMEM\_RESET’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMPMEM’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMP\_RESET’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_CMP’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_LOCK\_WAITS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_LOCKS’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘INNODB\_TRX’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘XTRADB\_RSEG’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘XTRADB\_INTERNAL\_HASH\_TABLES’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘XTRADB\_READ\_VIEW’ 2015-03-10 17:48:56 15254 [Note] Shutting down plugin ‘InnoDB’ 2015-03-10 17:48:56 15254 [Note] InnoDB: FTS optimize thread exiting. 2015-03-10 17:48:56 15254 [Note] InnoDB: Starting shutdown… 2015-03-10 17:48:58 15254 [Note] InnoDB: Shutdown completed; log sequence number 1647927 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘ARCHIVE’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘MEMORY’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘MyISAM’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘CSV’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘MRG\_MYISAM’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘sha256\_password’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘mysql\_old\_password’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘mysql\_native\_password’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘wsrep’ 2015-03-10 17:48:58 15254 [Note] Shutting down plugin ‘binlog’ 2015-03-10 17:48:58 15254 [Note] /usr/sbin/mysqld: Shutdown complete ---
**Author:** ![simonhoenscheid](https://avatars.discourse-cdn.com/v4/letter/s/6de8d8/32.png) [@simonhoenscheid](https://forums.percona.com/u/simonhoenscheid)\ **Post date:** [March 10, 2015, 11:34am UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097/2 "2015-03-10T11:34:35Z")
2015-03-10 17:49:03 0 [Warning] Using unique option prefix sort\_buffer instead of sort\_buffer\_size is deprecated and will be removed in a future release. Please use the full name instead. 2015-03-10 17:49:03 0 [Warning] Using unique option prefix thread\_cache instead of thread\_cache\_size is deprecated and will be removed in a future release. Please use the full name instead. 2015-03-10 17:49:03 0 [Warning] ‘THREAD\_CONCURRENCY’ is deprecated and will be removed in a future release. 2015-03-10 17:49:03 0 [Note] WSREP: wsrep\_start\_position var submitted: ‘fafe51f0-c743-11e4-9db3-765772f3dde5:15’ 2015-03-10 17:49:03 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit\_defaults\_for\_timestamp server option (see documentation for more details). 2015-03-10 17:49:03 15327 [Note] WSREP: Read nil XID from storage engines, skipping position init 2015-03-10 17:49:03 15327 [Note] WSREP: wsrep\_load(): loading provider library ‘/usr/lib/libgalera\_smm.so’ 2015-03-10 17:49:03 15327 [Note] WSREP: wsrep\_load(): Galera 3.9(r93aca2d) by Codership Oy \ loaded successfully. 2015-03-10 17:49:03 15327 [Note] WSREP: CRC-32C: using “slicing-by-8” algorithm. 2015-03-10 17:49:03 15327 [Note] WSREP: Found saved state: fafe51f0-c743-11e4-9db3-765772f3dde5:-1 2015-03-10 17:49:03 15327 [Note] WSREP: Passing config to GCS: base\_dir = /data/mysql/; base\_host = 172.16.123.205; base\_port = 4567; cert.log\_conflicts = no; debug = no; evs.auto\_evict = 0; evs.delay\_margin = PT1S; evs.delayed\_keep\_period = PT30S; evs.inactive\_check\_period = PT10S; evs.inactive\_timeout = PT1M; evs.install\_timeout = PT1M; evs.join\_retrans\_period = PT1S; evs.keepalive\_period = PT3S; evs.max\_install\_timeouts = 3; evs.send\_window = 4; evs.stats\_report\_period = PT1M; evs.suspect\_timeout = PT30S; evs.user\_send\_window = 2; evs.view\_forget\_timeout = PT24H; gcache.dir = /data/mysql/; gcache.keep\_pages\_size = 0; gcache.mem\_size = 0; gcache.name = /data/mysql//galera.cache; gcache.page\_size = 128M; gcache.size = 4G; gcs.fc\_debug = 0; gcs.fc\_factor = 1.0; gcs.fc\_limit = 16; gcs.fc\_master\_slave = no; gcs.max\_packet\_size = 64500; gcs.max\_throttle = 0.25; gcs.recv\_q\_hard\_limit = 9223372036854775807; gcs.recv\_q\_soft\_limit = 0.25; gcs.sync\_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce\_timeout = PT3S; pc.checksum = false; 2015-03-10 17:49:03 15327 [Note] WSREP: Service thread queue flushed. 2015-03-10 17:49:03 15327 [Note] WSREP: Assign initial position for certification: 15, protocol version: -1 2015-03-10 17:49:03 15327 [Note] WSREP: wsrep\_sst\_grab() 2015-03-10 17:49:03 15327 [Note] WSREP: Start replication 2015-03-10 17:49:03 15327 [Note] WSREP: Setting initial position to fafe51f0-c743-11e4-9db3-765772f3dde5:15 2015-03-10 17:49:03 15327 [Note] WSREP: protonet asio version 0 2015-03-10 17:49:03 15327 [Note] WSREP: Using CRC-32C for message checksums. 2015-03-10 17:49:03 15327 [Note] WSREP: backend: asio 2015-03-10 17:49:03 15327 [Warning] WSREP: access file(/data/mysql//gvwstate.dat) failed(No such file or directory) 2015-03-10 17:49:03 15327 [Note] WSREP: restore pc from disk failed 2015-03-10 17:49:03 15327 [Note] WSREP: GMCast version 0 2015-03-10 17:49:03 15327 [Note] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) listening at tcp://0.0.0.0:4567 2015-03-10 17:49:03 15327 [Note] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) multicast: , ttl: 1 2015-03-10 17:49:03 15327 [Note] WSREP: EVS version 0 2015-03-10 17:49:03 15327 [Note] WSREP: gcomm: connecting to group ‘sso-uat’, peer ‘172.16.123.204:,172.16.123.205:,172.16.123.206:,172.16.123.207:’ 2015-03-10 17:49:03 15327 [Warning] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) address ‘tcp://172.16.123.205:4567’ points to own listening address, blacklisting 2015-03-10 17:49:03 15327 [Note] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) address ‘tcp://172.16.123.205:4567’ pointing to uuid 5bcb2aad is blacklisted, skipping 2015-03-10 17:49:03 15327 [Note] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) turning message relay requesting on, nonlive peers: 2015-03-10 17:49:03 15327 [Note] WSREP: declaring f844ae82 at tcp://172.16.123.204:4567 stable 2015-03-10 17:49:03 15327 [Note] WSREP: Node f844ae82 state prim 2015-03-10 17:49:03 15327 [Note] WSREP: view(view\_id(PRIM,5bcb2aad,6) memb { 5bcb2aad,0 f844ae82,0 } joined { } left { } partitioned { }) 2015-03-10 17:49:03 15327 [Note] WSREP: save pc into disk 2015-03-10 17:49:03 15327 [Note] WSREP: discarding pending addr without UUID: tcp://172.16.123.206:4567 2015-03-10 17:49:03 15327 [Note] WSREP: discarding pending addr without UUID: tcp://172.16.123.207:4567 2015-03-10 17:49:04 15327 [Note] WSREP: gcomm: connected 2015-03-10 17:49:04 15327 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2015-03-10 17:49:04 15327 [Note] WSREP: Shifting CLOSED → OPEN (TO: 0) 2015-03-10 17:49:04 15327 [Note] WSREP: Opened channel ‘sso-uat’ 2015-03-10 17:49:04 15327 [Note] WSREP: Waiting for SST to complete. 2015-03-10 17:49:04 15327 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my\_idx = 0, memb\_num = 2 2015-03-10 17:49:04 15327 [Note] WSREP: STATE\_EXCHANGE: sent state UUID: 5c64cc5b-c745-11e4-8b3f-1e0b689180a2 2015-03-10 17:49:04 15327 [Note] WSREP: STATE EXCHANGE: sent state msg: 5c64cc5b-c745-11e4-8b3f-1e0b689180a2 2015-03-10 17:49:04 15327 [Note] WSREP: STATE EXCHANGE: got state msg: 5c64cc5b-c745-11e4-8b3f-1e0b689180a2 from 0 (galeranode-02) 2015-03-10 17:49:04 15327 [Note] WSREP: STATE EXCHANGE: got state msg: 5c64cc5b-c745-11e4-8b3f-1e0b689180a2 from 1 (galeranode-01) 2015-03-10 17:49:04 15327 [Note] WSREP: Quorum results: version = 3, component = PRIMARY, conf\_id = 5, members = 1/2 (joined/total), act\_id = 17, last\_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = 377d1d1f-c723-11e4-be0f-f205bd80e309 2015-03-10 17:49:04 15327 [Note] WSREP: Flow-control interval: [23, 23] 2015-03-10 17:49:04 15327 [Note] WSREP: Shifting OPEN → PRIMARY (TO: 17) 2015-03-10 17:49:04 15327 [Note] WSREP: State transfer required: Group state: 377d1d1f-c723-11e4-be0f-f205bd80e309:17 Local state: fafe51f0-c743-11e4-9db3-765772f3dde5:15 2015-03-10 17:49:04 15327 [Note] WSREP: New cluster view: global state: 377d1d1f-c723-11e4-be0f-f205bd80e309:17, view# 6: Primary, number of nodes: 2, my index: 0, protocol version 3 2015-03-10 17:49:04 15327 [Warning] WSREP: Gap in state sequence. Need state transfer. 2015-03-10 17:49:04 15327 [Note] WSREP: Running: 'wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘172.16.123.205’ --auth ‘root:Uz6oebu6’ --datadir ‘/data/mysql/’ --defaults-file ‘/etc/mysql/my.cnf’ --parent ‘15327’ ‘’ ’ 2015-03-10 17:49:04 15327 [ERROR] WSREP: fork() failed: 12 (Cannot allocate memory) 2015-03-10 17:49:04 15327 [ERROR] WSREP: Failed to execute: wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘172.16.123.205’ --auth ‘root:Uz6oebu6’ --datadir ‘/data/mysql/’ --defaults-file ‘/etc/mysql/my.cnf’ --parent ‘15327’ ‘’ : 12 (Cannot allocate memory) 2015-03-10 17:49:04 15327 [ERROR] WSREP: Failed to prepare for ‘xtrabackup-v2’ SST. Unrecoverable. 2015-03-10 17:49:04 15327 [ERROR] Aborting 2015-03-10 17:49:06 15327 [Note] WSREP: Closing send monitor… 2015-03-10 17:49:06 15327 [Note] WSREP: Closed send monitor. 2015-03-10 17:49:06 15327 [Note] WSREP: gcomm: terminating thread 2015-03-10 17:49:06 15327 [Note] WSREP: gcomm: joining thread 2015-03-10 17:49:06 15327 [Note] WSREP: gcomm: closing backend 2015-03-10 17:49:06 15327 [Note] WSREP: (5bcb2aad, ‘tcp://0.0.0.0:4567’) turning message relay requesting off 2015-03-10 17:49:07 15327 [Note] WSREP: view(view\_id(NON\_PRIM,5bcb2aad,6) memb { 5bcb2aad,0 } joined { } left { } partitioned { f844ae82,0 }) 2015-03-10 17:49:07 15327 [Note] WSREP: view((empty)) 2015-03-10 17:49:07 15327 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my\_idx = 0, memb\_num = 1 2015-03-10 17:49:07 15327 [Note] WSREP: gcomm: closed 2015-03-10 17:49:07 15327 [Note] WSREP: Flow-control interval: [16, 16] 2015-03-10 17:49:07 15327 [Note] WSREP: Received NON-PRIMARY. 2015-03-10 17:49:07 15327 [Note] WSREP: Shifting PRIMARY → OPEN (TO: 17) 2015-03-10 17:49:07 15327 [Note] WSREP: Received self-leave message. 2015-03-10 17:49:07 15327 [Note] WSREP: Flow-control interval: [0, 0] 2015-03-10 17:49:07 15327 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2015-03-10 17:49:07 15327 [Note] WSREP: Shifting OPEN → CLOSED (TO: 17) 2015-03-10 17:49:07 15327 [Note] WSREP: RECV thread exiting 0: Success 2015-03-10 17:49:07 15327 [Note] WSREP: recv\_thread() joined. 2015-03-10 17:49:07 15327 [Note] WSREP: Closing replication queue. 2015-03-10 17:49:07 15327 [Note] WSREP: Closing slave action queue. 2015-03-10 17:49:07 15327 [Note] WSREP: Service disconnected. 2015-03-10 17:49:07 15327 [Note] WSREP: rollbacker thread exiting 2015-03-10 17:49:08 15327 [Note] WSREP: Some threads may fail to exit. 2015-03-10 17:49:08 15327 [Note] Binlog end 2015-03-10 17:49:08 15327 [Note] /usr/sbin/mysqld: Shutdown complete Error in my\_thread\_global\_end(): 1 threads didn’t exit 150310 17:49:13 mysqld\_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended Anybody some hints? Thx in advance ​ Simon ---
**Author:** ![jrivera](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/jrivera/32/13_2.png) [@jrivera](https://forums.percona.com/u/jrivera)\ **Post date:** [March 14, 2015, 6:03am UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097/3 "2015-03-14T06:03:08Z")
Can you also post error log from the DONOR node and post relevant wsrep\_\* variables for further analysis ---
**Author:** ![wagnerbianchi](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/wagnerbianchi/32/802_2.png) [@wagnerbianchi](https://forums.percona.com/u/wagnerbianchi)\ **Post date:** [March 18, 2015, 1:45pm UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097/4 "2015-03-18T13:45:06Z")
> [@](#): > > 2015-03-10 17:49:04 15327 [ERROR] WSREP: fork() failed: 12 (Cannot allocate memory) > 2015-03-10 17:49:04 15327 [ERROR] WSREP: Failed to execute: wsrep\_sst\_xtrabackup-v2 --role ‘joiner’ --address ‘172.16.123.205’ --auth ‘root:Uz6oebu6’ --datadir ‘/data/mysql/’ --defaults-file ‘/etc/mysql/my.cnf’ --parent ‘15327’ ‘’ : 12 (Cannot allocate memory) > 2015-03-10 17:49:04 15327 [ERROR] WSREP: Failed to prepare for ‘xtrabackup-v2’ SST. Unrecoverable. > 2015-03-10 17:49:04 15327 [ERROR] Aborting It seems that the server where this is running has a small space in RAM and when xtrabackup comes in to prepare a backup, it use to allocate 100MB RAM by default and consequently, failing by a lack of RAM space. It’s going to consider the size of dataset being copied to the backup set. Just to confirm, is this a small VM or similar thing? Additionally, the fork() called out my attention: [http://en.wikipedia.org/wiki/Fork\_(system\_call)](http://en.wikipedia.org/wiki/Fork_%28system_call%29) Cheers, ---
**Author:** ![HAGBARD](https://avatars.discourse-cdn.com/v4/letter/h/d26b3c/32.png) [@HAGBARD](https://forums.percona.com/u/HAGBARD)\ **Post date:** [June 19, 2015, 5:05am UTC](https://forums.percona.com/t/wresp-breakdown-wsrep-fork-failed-12-cannot-allocate-memory/4097/5 "2015-06-19T05:05:50Z")
I had the same problem as you, I’ve solved enabling SWAP in the DONOR and other nodes.