Too many locks

Hello everyone,
We are using Berkeley DB Java Edition with our heavily-multithreaded application. Transactions have been enabled on the database.
While the system is busy, we occasionally face an orgy of LockTimeoutException, which can be resolved only by a restart. Note that the locks also usually prevent a clean close of the database/environment.
One such sample is:
com.sleepycat.je.LockTimeoutException: (JE 4.1.17) Lock expired. Locker 1668415747 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970960_ReadCommittedLocker: waited for lock on database=sampleDatabase LockAddr:292555378 node=8759642048 type=READ grant=WAIT_NEW timeoutMillis=30000 startTime=1327243343323 endTime=1327243373324 Owners: [<LockInfo locker="1542681801 610308237201_TH_CGTOutCylSMS5 for gOutMsgID 96970930_Txn" type="WRITE"/>]
Waiters: [<LockInfo locker="711907833 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970946_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1403551794 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970940_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1369480950 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970957_ReadCommittedLocker" type="READ"/>, <LockInfo locker="136598104 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970970_ReadCommittedLocker" type="READ"/>, <LockInfo locker="144315285 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970968_ReadCommittedLocker" type="READ"/>, <LockInfo locker="997957532 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970975_ReadCommittedLocker" type="READ"/>, <LockInfo locker="824957254 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970961_ReadCommittedLocker" type="READ"/>, <LockInfo locker="902142946 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970967_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1081945602 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970977_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1515693665 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970981_ReadCommittedLocker" type="READ"/>, <LockInfo locker="812406941 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970964_ReadCommittedLocker" type="READ"/>, <LockInfo locker="422429761 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970966_ReadCommittedLocker" type="READ"/>, <LockInfo locker="196056145 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970976_ReadCommittedLocker" type="READ"/>, <LockInfo locker="875714517 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970971_Read
CommittedLocker" type="READ"/>, <LockInfo locker="1428454328 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970969_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1312200883 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970985_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1650669538 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970986_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1609173220 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970983_ReadCommittedLocker" type="READ"/>, <LockInfo locker="2112741869 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970982_ReadCommittedLocker" type="READ"/>, <LockInfo locker="210489138 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970980_ReadCommittedLocker" type="READ"/>, <LockInfo locker="785375757 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970973_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1375853437 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970978_ReadCommittedLocker" type="READ"/>, <LockInfo locker="2012288410 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970988_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1958833914 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970987_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1197284088 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970984_Re
adCommittedLocker" type="READ"/>, <LockInfo locker="831894626 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970979_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1534437212 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970911_ReadCommittedLocker" type="READ"/>, <LockInfo locker="155105261 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970922_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1956457816 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970919_ReadCommittedLocker" type="READ"/>, <LockInfo locker="2064394295 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970928_ReadCommittedLocker" type="READ"/>, <LockInfo locker="1529115133 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970936_ReadCommittedLocker" type="READ"/>, <LockInfo locker="901236682 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970943_ReadCommittedLocker" type="READ"/>, <LockInfo locker="882752083 -1_TH_CGTOutCylSMS5 for gOutMsgID 96970937_ReadCommittedLocker" type="READ"/>]
This has today resulted in, during shutdown:
com.sleepycat.je.EnvironmentFailureException: (JE 4.1.17) Txn undo for LSN=0x4c5d59/0x2fd8da UNEXPECTED_EXCEPTION: Unexpected internal Exception, may have side effects.
Problem: 376426 locks left
java.lang.OutOfMemoryError
Java heap space
java.util.Arrays.copyOf(Arrays.java:2882)
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:390)
java.lang.StringBuilder.append(StringBuilder.java:119)
java.lang.StringBuilder.append(StringBuilder.java:115)
com.sleepycat.je.txn.LockManager.dumpToStringNoLatch(LockManager.java:1205)
com.sleepycat.je.txn.LockManager.dumpToString(LockManager.java:1187)
com.sleepycat.je.txn.LockManager.dump(LockManager.java:1177)
com.sleepycat.je.dbi.EnvironmentImpl.checkLeaks(EnvironmentImpl.java:1786)
com.sleepycat.je.dbi.EnvironmentImpl.doClose(EnvironmentImpl.java:1642)
com.sleepycat.je.dbi.DbEnvPool.closeEnvironment(DbEnvPool.java:348)
com.sleepycat.je.dbi.EnvironmentImpl.close(EnvironmentImpl.java:1480)
com.sleepycat.je.Environment.closeInternal(Environment.java:460)
com.sleepycat.je.Environment.close(Environment.java:321)
and also an entry in the je.log:
120122 19:55:18:205 SEVERE [prog/citrine/db]LNUndo success=false node=46893596705 lsn=0x4c5d59/0x2fd8da found=false replaced=false inserted=false index=-1
We are using 4.1.17 (also previously used 4.1.10 with the same problem) on java 1.6.0u27, 64-bit, on CentOS. The size of the database is over 250 GB.
We am currently running a database.verify() to ensure that the data isnt corrupt.
Our questions are:
* The locks seem to be read locks. While i am aware that the Java Edition does not have MVCC, is there any other mechanism that will give similar 'locklessness'?
* Should increasing the setting of LOCK_N_LOCK_TABLES to say, 500, reduce the chances of this issue?
* Are there any other lock-specific settings we should be aware of? We have set the reads to READ_COMMITTED.
and more immediately:
* Is database.verify sufficient to verify that there is no corruption of data? (It has been running for over half an hour now) There is only one database in the environment.
Awaiting your response,
Sushant A.

I have some additional comments.
The SEVERE log message that you describe should be accompanied by a stack trace. If you have one, please send it. If there was no stack trace, then it is possible this is due to an OutOfMemoryError. This is likely due to the large number of locks that have accumulated.
Increasing the number of JE lock tables will not solve this problem. The number of lock tables is increased for better concurrency at a lower level. It won't avoid lock timeouts.
In the stack trace you sent, one thread holds a write lock, and many threads are waiting on a read lock. Lock timeouts can occur because the writer holds the lock (does not commit/abort the txn) for the timeout interval, but this seems unlikely since it looks like you have set the timeout to 30s.
The other reason for the exception is a deadlock. Deadlocks are described in the doc link I sent you earlier. If a deadlock occurs, you'll need to retry the operation after closing the cursors and aborting the txn.
Because many (300k) locks have accumulated, I strongly suspect your app is not closing cursors and/or txns when an exception occurs. The first thing is to check for that.
--mark

Similar Messages

DB need too many locks in single threaded application

Hello,
I`m new to BDB, and search for help of gurus.
I try to create database importing data from csv files. Import procedure is already written and works fine, but sometimes it starts to need too many locks.
Import process read csv file line by line. Check if key is already in the database, if yes it updates data, otherwise create new record. Import procedure is using DBEnv and transaction.
Please, look at 2 cases of data to import.
Case 1: Data in csv files are like:
key1, some_data_1
key1, some_data_2
key2, some_data_3
key2, some_data_4
keyN, some_data_2N-1
keyN, some_data_2N
(key became a key and data became the value in the database)
Case 2: Remove each second line in the csv file, so it became:
key1, some_data_1
key2, some_data_3
keyN, some_data_2N-1
In this case for successful import of the file more locks are needed then in case 1.
This seems very odd to me. Could somebody explain why lock system behave so? Looking forward to hearing any response.
Thanks.
p.s.: maybe my explanation is not very clear, but i don't know which other details are really important. I could provide more details if it could help.
Message was edited by:
user647892

There is nothing wrong.
Oracle by default locks records. In case 1, you insert a record (1 row level lock) and update that same record. Why is a mystery, but the update doesn't require a lock (by you) as you already did lock the record.
In case 2, you have distinct keys for each line, so each line results in a row level lock as expected.
There are as much record locks as you request it to make.
You could consider locking the table explicitly once, prior to the transaction, by a lock table statement.
However, your approach is fundamentally flawed an non-scalable, as it processes each line individually instead of loading the data in a staging table and transferring it to the production table using
insert into production table
select * from staging table
where key not in (select key from product table)
Sybrand Bakker
Senior Oracle DBA

Too many lock entries on BUT000 in SRM7

Hi,
When we are trying to update attributes of Org units through FM BBP_UPDATE_ATTRIBUTES, there are so many lock entries created for different values on table BUT000.
We are calling the said FM in loop becasue this FM has the capability of updating just one ORG unit at a time. So while the loop runs, there are a lot of lock entries created on BUT000 which are just not getting unlocked automatically.
There is a huge performance hit due to this. We are not sure how and why BUT000 entries are getting locked while updating org unit attributes.
Please suggest what should be a remedy to this.
Thanks,
Tirth

i dont know BUT000 table and have no idea what it does, but i suspect that it works like with every other thing in SAP system.
In DEV you mostly have not much data. E.G. in your case lets say 200 BUT000 entries.
200 lock entries aint a problem for the system.
In Quality you SHOULD have more data, up to number of data in production. If you have nearly same amount of data in Q like in P the problem should have existed in quality as well.
Another thing is that in productive MORE people work.
See there is a table where your lock entries get stored, if that table exceeds some certain amount of entries your system is going to slow down up to dumping or timeouting.
So in production system there are probably other people as well creating lockj entries with various transactions, while when you tested it in quality you were probably not much users on the system.

My friend changed the password on my ipod touch lock, aI have tried multiple times to input the correct password. But I attempted too many times and I was locked out. The screen is red and says "connect to itunes'. But I cant connect to itunes.

My friend changed the password on my ipod touch. And now I am locked out because I tried too many times. I can no longer put in a password, and I can't connect to itunes because it says "must input passcode first before connecting", even though the ipod says to connect to itunes

Place the iPod into recovery mode in order to restore the iPod with iTunes.
http://support.apple.com/kb/ht1808

I'm trying to set up an iPad for work and the apple id I was trying to use came back expired. I set a new password and then it said it was invalid. Now I'm locked out for too many tries answering security questions that I don't remember setting up. Help!

I seem to be stuck in apple ID ****. First the password was expired only two minutes after I finished setting up the account and then the new password was invalid. I don't know what to try next but this is making me crazy. And I'm locked out for eight hours for too many attempts at answering questions that I never set up in the first place. I don't know what gives but something is way off. I need to set up this iPad for work but I can't get past the login.

Place the iOS device in Recovery Mode and then connect to your computer and restore via iTunes. The iPod will be erased. Some glitch occured and you have to restore/erse the iPod. Y will have to restore from an existing backup if y ohave one.
iOS: Wrong passcode results in red disabled screen
If recovery mode does not work try DFU mode.
How to put iPod touch / iPhone into DFU mode « Karthik's scribblings
For how to restore:
iTunes: Restoring iOS software
To restore from backup see:
iOS: How to back up
If you restore from iCloud backup the apps will be automatically downloaded. If you restore from iTunes backup the apps and music have to be in the iTunes library since synced media like apps and music are not included in the backup of the iOS device that iTunes makes.
You can redownload most iTunes purchases by:
Downloading past purchases from the App Store, iBookstore, and iTunes Store

HT1212 My Ipad has been permanently lock because incorrect password has been enter too many times. Normally, it will ask to wait for 60 minutes but this is not available, the only option, it says to connect to Itunes. I cannot connect to ITunes either.

What can I do to unlock the IPAD if I cannot access the device by using computer? When I connect to computer, it says I have to unlock the IPad to connect to itunes.
I try everything but I cannot figure out what to do. I turn off IPAD and it still stay in the connect to Itunes mode. It does not goes back to wait mode.
Any suggestion would be appreciated.
Thanks,
Bill

How can I unlock my iPad if I forgot the passcode?
http://www.everymac.com/systems/apple/ipad/ipad-troubleshooting-repair-faq/ipad- how-to-unlock-open-forgot-code-passcode-password-login.html
iOS: Device disabled after entering wrong passcode
http://support.apple.com/kb/ht1212
How can I unlock my iPad if I forgot the passcode?
http://tinyurl.com/7ndy8tb
How to Reset a Forgotten Password for an iOS Device
http://www.wikihow.com/Reset-a-Forgotten-Password-for-an-iOS-Device
Using iPhone/iPad Recovery Mode
http://ipod.about.com/od/iphonetroubleshooting/a/Iphone-Recovery-Mode.htm
Saw this solution on another post about an iPad in a school environment. Might work on your iPad so you won't lose everything.
~~~~~~~~~~~~~
‘iPad is disabled’ fix without resetting using iTunes
Today I met my match with an iPad that had a passcode entered too many times, resulting in it displaying the message ‘iPad is disabled – Connect to iTunes’. This was a student iPad and since they use Notability for most of their work there was a chance that her files were not all backed up to the cloud. I really wanted to just re-activate the iPad instead of totally resetting it back to our default image.
I reached out to my PLN on Twitter and had some help from a few people through retweets and a couple of clarification tweets. I love that so many are willing to help out so quickly. Through this I also learned that I look like Lt. Riker from Star Trek (thanks @FillineMachine).
Through some trial and error (and a little sheer luck), I was able to reactivate the iPad without loosing any data. Note, this will only work on the computer it last synced with. Here’s how:
1. Configurator is useless in reactivating a locked iPad. You will only be able to completely reformat the iPad using Configurator. If that’s ok with you, go for it – otherwise don’t waste your time trying to figure it out.
2. Open iTunes with the iPad disconnected.
3. Connect the iPad to the computer and wait for it to show up in the devices section in iTunes.
4. Click on the iPad name when it appears and you will be given the option to restore a backup or setup as a new iPad (since it is locked).
5. Click ‘Setup as new iPad’ and then click restore.
6. The iPad will start backing up before it does the full restore and sync. CANCEL THE BACKUP IMMEDIATELY. You do this by clicking the small x in the status window in iTunes.
7. When the backup cancels, it immediately starts syncing – cancel this as well using the same small x in the iTunes status window.
8. The first stage in the restore process unlocks the iPad, you are basically just cancelling out the restore process as soon as it reactivates the iPad.
If done correctly, you will experience no data loss and the result will be a reactivated iPad. I have now tried this with about 5 iPads that were locked identically by students and each time it worked like a charm.
~~~~~~~~~~~~~
Try it and good luck. You have nothing more to lose if it doesn't work for you.
 Cheers, Tom

After my friend locked me out of my iPhone with too many wrong passwords I restored my iPhone and now it is showing that picture of a cable leading towards itunes and itunes says the sim is not supported but it is the original sim. How do I fix this?

After my friend locked me out of my iPhone with too many wrong password attempts I restored my iPhone via recovery mode and now it is showing that picture of a cable leading towards itunes, and itunes says the sim is not supported but it is the original sim. How do I fix this?

Something went wrong with the update, this can and does happen with every version of iOS.
There is nothing wrong with the update.
Simply restore the device via iTunes on the computer.
If iTunes is stating it will take hours to update, that indicates an extremely slow Internet connection and is likely the reason the OTA update failed.

If you enter your password on the ipad too many times and your sim card locks, is there a way of recovery without replacing the sim card?

If you enter your password on the ipad too many times and your sim card locks, is there a way of recovery without replacing the sim card?

That doesn't lock the SIM card, it just locks you out of the device.
If you forgot (or don't know) your passcode, restore the device from backup on the last computer it was synced with when the passcode was turned on... this will remove the passcode. If you do not have access to the last computer it was synced with, you will have to force it into recovery mode & restore as a new device.
See this for more info... http://support.apple.com/kb/HT1212

HT1212 ipad is locked as my daughter locked putting in the password wrong too many times. When I try and do a restore it seems to be doing it until the end and it say it can't do anything as it's locked, go to itunes to unlock.. It's driving me mental

My ipad 4 wif is ocked as my daughter locked putting in the password wrong too many times. When I try and do a restore it seems to be doing it until the end and then it say it can't do anything as it's locked, go to itunes to unlock.. It's driving me mental. tried twice now ...
I haven't synced with a password, I don't mind losing all the data I just want to be able to use it again !! I'm not sure what IOS it is, not sure it's the most recent, I have a feeling I'm not on IO7.
Thanks for all your help.

Force iPad into Recovery Mode. Follow step 1 to 6 very closely.
http://support.apple.com/kb/HT1808
Note: You may have to repeat the above a few times.

I have an iphone3 and tried to log in too many times. Now I am locked out. What do I do?

I have an iphone3 and tried to log in too many times. Now I am locked out. When I press my home button, I get the emergency call screen and not my home screen.
What do I do?

Restore the phone using iTunes.

HT4528 how do I re-activate my phone after its been locked due to attempting an incorrect pass code too many times?

how do I re-activate my phone after its been locked due to attempting an incorrect pass code too many times?

Connect the iPod to its syncing computer and restore via iTunes. If iTunes asks for the passcode and yu can't enter the passcode or you do not have the syncing computer, place the iPod in recovery mode and then restore. For recovery mode see:
iPhone and iPod touch: Unable to update or restore

Phone is locked, too many passcode attempts. When I try to restore it won't proceed until i enter the passcode which the phone won't let me. I'm stuck. Help

My iphone 4 is locked because my son tried to enter the wrong passcode too many times. The solution on apple support says to restore it. But when I try to restore after about 10 minutes of software update it comes up with a message that it cannot continue until you enter the passcode on the phone. But the phone is locked and you cannot enter the passcode. I'm stuck. Help!?

You can still bypass this but deleting all of the contents of your iPhone, but of you previously backed up from iCloud or iTunes you can recover te files as it used to be,
You have to download a copy of iOS software you wish to recover to, you can get from google by typing it, iOS 5.1.1 iPhone 4 etc and find links, once downloaded. it should be IPSW file,
Turn your iPhone into "DFU" mode by holding sleep/wake button and home button at the same time, you can get tutorials from google or YouTube.
once done connect to iTunes, note this is the important step, before attempting to recover you should hold "shift-key" at the same time click check for updates or recover, from if it doesn't detect the file here's a link on how to do it, but this link is iOS 4.3 the difference is you will use iOS 5 or later. http://techie-buzz.com/how-to/how-to-update-ios-4-3-itunes-manually.html
after updating or restoring,
Congrats you bypassed your password and now restore your back up from itunes.

Have tried Apple password too many times now locked out of iPhone and ipad

I Have tried to put Apple password on too many times now I am locked out of iPhone and iPad how do I fix this

If you've disabled your iTunes account (is that what you mean ?) then you might be able to re-enable it via this page : http://appleid.apple.com, then 'reset your password'
You might then need to log out of your account on your devices by tapping on your id in Settings > iTunes & App Store and then log back in so as to 'refresh' the account on them.
If that doesn't fix it then contact iTunes Support : http://www.apple.com/support/itunes/contact/ - click on Contact iTunes Store Support on the right-hand side of the page

I have entered the wong password on mi iPad 2 too many times and it says disabled connect to iTunes so when i plug it into the computer , iTunes says pad locked cannot sync until you unlock the iPad but i don't remember the password nor can i put it in

i have entered the wong password on mi iPad 2 too many times and it says disabled connect to iTunes so when i plug it into the computer , iTunes says pad locked cannot sync until you unlock the iPad but i don't remember the password nor can i put it in

You have to restore the device within iTunes. You want to use the same computer that you always sync with so that you can restore your app data and settings. You can restore with any other computer, but you will lose everything on the iPad.
iOS: Wrong passcode results in red disabled screen
This will tell you how to restore
iTunes: Backing up, updating or restoring iOS software
If you cannot restore that way, you may have to use recovery mode
iPad: Unable to update or restore

HT1212 Iphone is locked but I can't restore because "find my iphone" is on. I'm prompted to turn it off in settings but, obviously, I can't because I'm locked out due to too many incorrect passcode attempts. What should I do? PS: I downloaded IOS7 toda

Iphone is locked but I can't restore because "find my iphone" is on. I'm prompted to turn it off in settings but, obviously, I can't because I'm locked out due to too many incorrect passcode attempts. What should I do? PS: I downloaded IOS7 today. My passcode was never enabled! But after I installed the new software it automatically turned it on. I hadn't used it in so long, I couldn't remember my last passcode, hence the lockout.

Hello 199Seth
Reset the password and that will take care of activating your iPhone.
Apple ID: 'This Apple ID has been disabled for security reasons' alert appears
http://support.apple.com/kb/ts2446
Thanks for using Apple Support Communities.
Regards,
-Norm G.

Too many locks

Similar Messages

Maybe you are looking for