What could be wrong here. I switched from Mysql 5.5.23 to Percona 5.5.23 and converted most of the tables from MyISAM to Innodb.
Since then Percona has stalled three times and every time I have had to do ‘kill -9 mysql’ so that I could start it again (‘mysql stop’ just keeps doing … …).
Here are the logs:
Version: ‘5.5.23-rel25.3’ socket: ‘/tmp/mysql.sock’ port: 0 Percona Server with XtraDB (GPL), Release rel25.3, Revision 240
InnoDB: Warning: a long semaphore wait:
–Thread 139679652914944 has waited at dict0dict.c line 742 for 241.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 0
=====================================
120523 21:00:18 INNODB MONITOR OUTPUT
Per second averages calculated from the last 36 seconds
BACKGROUND THREAD
srv_master_thread loops: 368042 1_second, 367727 sleeps, 36613 10_second, 2156 background, 2156 flush
srv_master_thread log flush and writes: 425253
SEMAPHORES
OS WAIT ARRAY INFO: reservation count 77805, signal count 105351
–Thread 139679652914944 has waited at dict0dict.c line 742 for 258.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679655577344 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679656908544 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679656642304 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679654778624 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139656811095808 has waited at buf0flu.c line 1481 for 256.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679652382464 has waited at buf0buf.c line 2527 for 256.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679661434624 has waited at buf0buf.c line 2527 for 256.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679663032064 has waited at buf0buf.c line 2527 for 256.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679665428224 has waited at dict0dict.c line 742 for 253.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656747890432 has waited at dict0dict.c line 742 for 253.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679657441024 has waited at buf0buf.c line 2527 for 253.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139656381863680 has waited at buf0buf.c line 2527 for 252.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679663830784 has waited at dict0dict.c line 742 for 252.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679664895744 has waited at dict0dict.c line 742 for 251.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679655843584 has waited at dict0dict.c line 742 for 250.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679662499584 has waited at dict0dict.c line 742 for 250.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679661967104 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679655311104 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679664363264 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679652116224 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679663564544 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679653447424 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679664629504 has waited at buf0buf.c line 2527 for 247.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679657707264 has waited at buf0buf.c line 2527 for 247.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679661168384 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679736440576 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679657973504 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679656376064 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679659570944 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679654512384 has waited at dict0dict.c line 742 for 246.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679652648704 has waited at dict0dict.c line 742 for 246.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679660369664 has waited at buf0buf.c line 2527 for 246.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679651849984 has waited at dict0dict.c line 742 for 244.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679658505984 has waited at dict0dict.c line 742 for 243.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679735641856 has waited at buf0buf.c line 2527 for 243.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679657174784 has waited at buf0buf.c line 2527 for 243.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679664097024 has waited at dict0dict.c line 742 for 243.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679658239744 has waited at dict0dict.c line 742 for 242.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
–Thread 139679736174336 has waited at dict0dict.c line 742 for 240.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679735375616 has waited at dict0dict.c line 742 for 239.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679654246144 has waited at dict0dict.c line 742 for 239.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679734843136 has waited at dict0dict.c line 742 for 237.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679653181184 has waited at dict0dict.c line 742 for 235.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679663298304 has waited at dict0dict.c line 742 for 235.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139679661700864 has waited at dict0dict.c line 742 for 234.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656758646528 has waited at buf0buf.c line 2527 for 232.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
–Thread 139679660103424 has waited at dict0dict.c line 742 for 230.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656747624192 has waited at dict0dict.c line 742 for 228.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656747357952 has waited at dict0dict.c line 742 for 223.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656747091712 has waited at dict0dict.c line 742 for 222.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656746825472 has waited at dict0dict.c line 742 for 221.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656746559232 has waited at dict0dict.c line 742 for 219.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656746292992 has waited at dict0dict.c line 742 for 214.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656746026752 has waited at dict0dict.c line 742 for 207.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656745760512 has waited at dict0dict.c line 742 for 203.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656745494272 has waited at dict0dict.c line 742 for 202.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656745228032 has waited at dict0dict.c line 742 for 194.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656744961792 has waited at dict0dict.c line 742 for 194.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656744695552 has waited at dict0dict.c line 742 for 139.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656744429312 has waited at dict0dict.c line 742 for 139.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656744163072 has waited at dict0dict.c line 742 for 98.000 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656743896832 has waited at dict0dict.c line 742 for 39.000 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
–Thread 139656743630592 has waited at dict0dict.c line 742 for 17.000 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
Mutex spin waits 174645, rounds 933148, OS waits 8825
RW-shared spins 65088, rounds 1443040, OS waits 45489
RW-excl spins 15637, rounds 777875, OS waits 22758
Spin rounds per wait: 5.34 mutex, 22.17 RW-shared, 49.75 RW-excl
FILE I/O
I/O thread 0 state: waiting for completed aio requests (insert buffer thread)
I/O thread 1 state: waiting for completed aio requests (log thread)
I/O thread 2 state: waiting for completed aio requests (read thread)
I/O thread 3 state: waiting for completed aio requests (read thread)
I/O thread 4 state: waiting for completed aio requests (read thread)
I/O thread 5 state: waiting for completed aio requests (read thread)
I/O thread 6 state: waiting for completed aio requests (write thread)
I/O thread 7 state: waiting for completed aio requests (write thread)
I/O thread 8 state: waiting for completed aio requests (write thread)
I/O thread 9 state: waiting for completed aio requests (write thread)
Pending normal aio reads: 0 [0, 0, 0, 0] , aio writes: 0 [0, 0, 0, 0] ,
ibuf aio reads: 0, log i/o’s: 0, sync i/o’s: 0
Pending flushes (fsync) log: 0; buffer pool: 0
175995 OS file reads, 5893732 OS file writes, 793642 OS fsyncs
0.00 reads/s, 0 avg bytes/read, 0.00 writes/s, 0.00 fsyncs/s
INSERT BUFFER AND ADAPTIVE HASH INDEX
Ibuf: size 1, free list len 8868, seg size 8870, 995 merges
merged operations:
insert 12034, delete mark 756, delete 157
discarded operations:
insert 0, delete mark 0, delete 0
Hash table size 42499631, node heap has 8001 buffer(s)
0.00 hash searches/s, 0.00 non-hash searches/s
LOG
Log sequence number 73408964340
Log flushed up to 73408964340
Last checkpoint at 73408964310
Max checkpoint age 433446544
Checkpoint age target 419901340
Modified age 30
Checkpoint age 30
0 pending log writes, 0 pending chkp writes
2419317 log i/o’s done, 0.00 log i/o’s/second
BUFFER POOL AND MEMORY
Total memory allocated 22062039040; in additional pool allocated 0
Internal hash tables (constant factor + variable factor)
Adaptive hash index 471089648 (339997048 + 131092600)
Page hash 21250552 (buffer pool 0 only)
Dictionary cache 90295032 (85000912 + 5294120)
File system 400352 (82672 + 317680)
Lock system 53141048 (53125256 + 15792)
Recovery system 0 (0 + 0)
Dictionary memory allocated 5294120
InnoDB: ###### Diagnostic info printed to the standard error stream
InnoDB: Warning: a long semaphore wait:
–Thread 139679652914944 has waited at dict0dict.c line 742 for 272.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655577344 has waited at buf0buf.c line 2527 for 271.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679656908544 has waited at buf0buf.c line 2527 for 271.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679656642304 has waited at buf0buf.c line 2527 for 271.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679654778624 has waited at buf0buf.c line 2527 for 271.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139656811095808 has waited at buf0flu.c line 1481 for 270.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679652382464 has waited at buf0buf.c line 2527 for 270.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679661434624 has waited at buf0buf.c line 2527 for 270.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679663032064 has waited at buf0buf.c line 2527 for 270.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679665428224 has waited at dict0dict.c line 742 for 267.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747890432 has waited at dict0dict.c line 742 for 267.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679657441024 has waited at buf0buf.c line 2527 for 267.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139656381863680 has waited at buf0buf.c line 2527 for 266.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679663830784 has waited at dict0dict.c line 742 for 266.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664895744 has waited at dict0dict.c line 742 for 265.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655843584 has waited at dict0dict.c line 742 for 264.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679662499584 has waited at dict0dict.c line 742 for 264.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679661967104 has waited at dict0dict.c line 742 for 262.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655311104 has waited at dict0dict.c line 742 for 262.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664363264 has waited at dict0dict.c line 742 for 262.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679652116224 has waited at dict0dict.c line 742 for 262.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679663564544 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679653447424 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664629504 has waited at buf0buf.c line 2527 for 261.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679657707264 has waited at buf0buf.c line 2527 for 261.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679661168384 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679736440576 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679657973504 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679656376064 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679659570944 has waited at dict0dict.c line 742 for 261.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679654512384 has waited at dict0dict.c line 742 for 260.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679652648704 has waited at dict0dict.c line 742 for 260.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679660369664 has waited at buf0buf.c line 2527 for 260.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679651849984 has waited at dict0dict.c line 742 for 258.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679658505984 has waited at dict0dict.c line 742 for 257.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679735641856 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679657174784 has waited at buf0buf.c line 2527 for 257.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679664097024 has waited at dict0dict.c line 742 for 257.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679658239744 has waited at dict0dict.c line 742 for 256.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679736174336 has waited at dict0dict.c line 742 for 254.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679735375616 has waited at dict0dict.c line 742 for 253.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679654246144 has waited at dict0dict.c line 742 for 253.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679734843136 has waited at dict0dict.c line 742 for 251.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679653181184 has waited at dict0dict.c line 742 for 249.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679663298304 has waited at dict0dict.c line 742 for 249.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679661700864 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656758646528 has waited at buf0buf.c line 2527 for 246.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679660103424 has waited at dict0dict.c line 742 for 244.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747624192 has waited at dict0dict.c line 742 for 242.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 0
InnoDB: ###### Diagnostic info printed to the standard error stream
InnoDB: Warning: a long semaphore wait:
–Thread 139679652914944 has waited at dict0dict.c line 742 for 303.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655577344 has waited at buf0buf.c line 2527 for 302.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679656908544 has waited at buf0buf.c line 2527 for 302.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679656642304 has waited at buf0buf.c line 2527 for 302.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679654778624 has waited at buf0buf.c line 2527 for 302.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139656811095808 has waited at buf0flu.c line 1481 for 301.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679652382464 has waited at buf0buf.c line 2527 for 301.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679661434624 has waited at buf0buf.c line 2527 for 301.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679663032064 has waited at buf0buf.c line 2527 for 301.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679665428224 has waited at dict0dict.c line 742 for 298.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747890432 has waited at dict0dict.c line 742 for 298.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679657441024 has waited at buf0buf.c line 2527 for 298.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139656381863680 has waited at buf0buf.c line 2527 for 297.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679663830784 has waited at dict0dict.c line 742 for 297.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664895744 has waited at dict0dict.c line 742 for 296.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655843584 has waited at dict0dict.c line 742 for 295.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679662499584 has waited at dict0dict.c line 742 for 295.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679661967104 has waited at dict0dict.c line 742 for 293.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679655311104 has waited at dict0dict.c line 742 for 293.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664363264 has waited at dict0dict.c line 742 for 293.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679652116224 has waited at dict0dict.c line 742 for 293.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679663564544 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679653447424 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679664629504 has waited at buf0buf.c line 2527 for 292.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679657707264 has waited at buf0buf.c line 2527 for 292.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679661168384 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679736440576 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679657973504 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679656376064 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679659570944 has waited at dict0dict.c line 742 for 292.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679654512384 has waited at dict0dict.c line 742 for 291.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679652648704 has waited at dict0dict.c line 742 for 291.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679660369664 has waited at buf0buf.c line 2527 for 291.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679651849984 has waited at dict0dict.c line 742 for 289.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679658505984 has waited at dict0dict.c line 742 for 288.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679735641856 has waited at buf0buf.c line 2527 for 288.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679657174784 has waited at buf0buf.c line 2527 for 288.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679664097024 has waited at dict0dict.c line 742 for 288.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679658239744 has waited at dict0dict.c line 742 for 287.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679736174336 has waited at dict0dict.c line 742 for 285.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679735375616 has waited at dict0dict.c line 742 for 284.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679654246144 has waited at dict0dict.c line 742 for 284.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679734843136 has waited at dict0dict.c line 742 for 282.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679653181184 has waited at dict0dict.c line 742 for 280.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679663298304 has waited at dict0dict.c line 742 for 280.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139679661700864 has waited at dict0dict.c line 742 for 279.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656758646528 has waited at buf0buf.c line 2527 for 277.00 seconds the semaphore:
S-lock on RW-latch at 0x2c647f8 ‘&buf_pool->page_hash_latch’
a writer (thread id 139679655577344) has reserved it in mode exclusive
number of readers 0, waiters flag 1, lock_word: 0
Last time read locked in file buf0buf.c line 2527
Last time write locked in file /home/jenkins/workspace/percona-server-5.5-binaries/label_ex p/centos5-64/Percona-Server-5.5.23-rel25.3/storage/innobase/ buf/buf0lru.c line 628
InnoDB: Warning: a long semaphore wait:
–Thread 139679660103424 has waited at dict0dict.c line 742 for 275.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747624192 has waited at dict0dict.c line 742 for 273.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747357952 has waited at dict0dict.c line 742 for 268.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656747091712 has waited at dict0dict.c line 742 for 267.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656746825472 has waited at dict0dict.c line 742 for 266.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656746559232 has waited at dict0dict.c line 742 for 264.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656746292992 has waited at dict0dict.c line 742 for 259.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656746026752 has waited at dict0dict.c line 742 for 252.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656745760512 has waited at dict0dict.c line 742 for 248.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: Warning: a long semaphore wait:
–Thread 139656745494272 has waited at dict0dict.c line 742 for 247.00 seconds the semaphore:
Mutex at 0x2486ba78 ‘&dict_sys->mutex’, lock var 1
waiters flag 1
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 0
InnoDB: ###### Diagnostic info printed to the standard error stream
120523 21:26:09 [Warning] Too many connections
120523 21:26:09 [Warning] Too many connections
…
120523 21:35:49 mysqld_safe Number of processes running now: 0
120523 21:35:49 mysqld_safe mysqld restarted
120523 21:35:49 [Note] Flashcache bypass: disabled
120523 21:35:49 [Note] Flashcache setup error is : ioctl failed
120523 21:35:49 [Note] Plugin ‘FEDERATED’ is disabled.
120523 21:35:49 InnoDB: The InnoDB memory heap is disabled
120523 21:35:49 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120523 21:35:49 InnoDB: Compressed tables use zlib 1.2.3
120523 21:35:49 InnoDB: Using Linux native AIO
120523 21:35:49 InnoDB: Initializing buffer pool, size = 20.0G
120523 21:35:50 InnoDB: Completed initialization of buffer pool
120523 21:35:50 InnoDB: highest supported file format is Barracuda.
InnoDB: Log scan progressed past the checkpoint lsn 73408964310
120523 21:35:50 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files…
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer…
InnoDB: Doing recovery: scanned up to log sequence number 73408964340
120523 21:35:52 InnoDB: Starting an apply batch of log records to the database…
InnoDB: Progress in percents: 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
120523 21:35:53 InnoDB: Waiting for the background threads to start
120523 21:35:54 Percona XtraDB (http://www.percona.com) 1.1.8-rel25.3 started; log sequence number 73408964340
120523 21:35:54 [Note] Event Scheduler: Loaded 0 events
120523 21:35:54 [Note] /usr/local/mysql/bin/mysqld: ready for connections.