Importing large number of images still broken in Lightroom 1.1

It's deja-vu all over again :(
Clean XP SP2 install, clean LR 1.1 install, new library
Core 2 Duo, 4GB RAM, almost 2TB disk space
28,000 RAW images from Canon 10D, 1D Mark II and 1Ds Mark II
I have a 30" screen so I set my library to: high quality previews, 2048 pixels high, never drop 1:1 previews, automatically export to xmp
I have tried importing the whole lot, tried a subset of a few thousand images, same result.
I always import in place.
If I try importing images without generating standard sized previews it always completes, my library ends up being about 330MB, the Catalog Previews.lrdata directory contains roughly the number of files that were imported. So far so good. I've tried compacting the library at this point, it didn't make a difference. After importing lightroom just goes to 50% CPU and stays there for hours. Eventually it goes down to 0%. But then it refuses to open any files at 1:1 (it just shows 'Loading...', waited for half an hour for ONE images, no change), if I try to prerender 1:1 previews it takes several MINUTES PER IMAGE (no disk activity to speak of, CPU busy) and the supposedly prerendered images have the same 'Loading...' problem.
If I try importing images and generate standard sized previews I notice that after about 1000 files get added to the 'Catalog Previews.lrdata' directory it stops growing, new directories keep getting added but they're empty (this is on a drive with 400GB free...). Trying to open any of the imported files seems to work but after looking at two or three I get a red, up-side-down 'Out of memory - A2' error.
Has ANYONE been able to build a new library with a non-trivial number of images AND generate previews?
If anyone from Adobe is reading this, and cares, please reply and let me know how to proceed. I'm a software engineer, I have debugging tools, please work with me. I really, really, really want Lightroom to work for me.

Sorry to report, but I built my catalog [library in 1.0] with 21,000 images and it went smooth as silk. My conversion to 1.1 was fast and smooth, all of the library became a catalog.
I have been paring down my catalog, removing bad photos and dups with no problem. No freezes, no out of memory errors, no crashes. I will admit that I had a couple of OOMs and occasional crash before 1.1, but those went away with the addition of the second pagefile on second HDD.
Do I know what actually caused the fixes, not really. I used the "fix everything" approach. Somewhere along the line, something clicked I expect, but I had no serious problems even in the beginning.
I now have 13800+ images and I import from an external USB card reader, then import into LR from HDD, then convert to DNG inside of LR.
-Core 2 Duo 6600,
-XP Pro SP2 with all updates after SP2 was issued,
-2 HDDs, SATA,
-2 pagefiles-one on each HDD at 1.5 x RAM [2GB],
-nVidia 7600GT video card with 256MB,
-Windows kernel resident in RAM,
-system optimized for applications-not cache,
-remote Logitech mouse,
-Microsoft keyboard,
-19" CTL 9GX LCD monitor [3 years old],
-monitor calibrated with Pantone Color Plus 1.1.
This article http://tinyurl.com/36uqqt bears on RAM situation Vista or XP that is not 64 bit, or even if 64 bit if vendor doesn't do things right.
Mel

Similar Messages

Problem with importing a large number of images to Lightroom?

I'm trying to import a large number of images from disk to Lightroom. If I select more that approximately 1500 images (1250 works fine), I get an error message saying "files do not exist". If I reduce the number of files imported, everything works fine. I can import in groups as long as the number selected at any one time is less that the ~1500 limit.
Has any one had a similar problems? I'm running LR 2.4 64-bit on Win7 RC 64-bit, Q6600 processor, 8 GB RAM.
Does not seem like this should be a problem. Its a real hassle to my workflow. I'm working on a series of time-laps movies (here is a link to a sample: http://vimeo.com/6375019).

Thanks for your reply Sean,
It is an internal disk drive, SATA II interface.I have no other disk/file problems, this is unique to LR as far as I can tell.
I'm loading files onto disk from a CF card reader outside of Lightroom, then opening LR and telling it to import from disk. I've never had a problem before with imports. Experimenting with number of files, somewhere between 1250 and 1500 is where the problem occurs.
Been busy making time-lapse videos of the fire in LA, so I'm away from the computer most of the time.
thanks,
Dan Finnerty

How do I create new versions of a large number of images, and place them in a new location?

Hello!
I have been using Aperture for years, and have just one small problem. There have been many times where I want to have multiple versions of a large number of images. I like to do a color album and B&W album for example.
Previously, I would click on all the images at one, and select new version. The problem is this puts all of the new versions in a stack. I then have to open all the stacks, and one by one move the new versions to a different album. Is there any way to streamline this proccess? When it's only 10 images, it's no problem. When it's a few hundred (or more) its rather time consuming..
What I'm hoping for is a way to either automatically have new versions populate a separate album, or for a way to easily select all the new versions I create at one time, and simply move them with as few steps as possible to a new destination.
Thanks for any help,
Ricardo

Ricardo,
in addition to Kirby's and phosgraphis's excellent suggestions, you may want to use the filters to further restrict your versions to the ones you want to access.
For example, you mentioned
I like to do a color album and B&W album for example.
You could easily separate the color versions from the black-and-white versions by using the filter rule:
Adjustment includes Black&white
or
Adjustment does not include Black&white
With the above filter setting (Add rule > Adjustment includes Black&White) only the versions with Black&White adjustment are shown in the Browers. You could do similar to separate cropped versions from uncropped ones.
Regards
Léonie

How to handle a large number of images?

I am writing a program that need handle a large number of images.
How should i do to make it work faster and less memory.
Is it a image pool i can use ? How is it works?

Thank you for you reply.
I need to handle images.For example a user upload an
image via web browser and i need save too images ,one
is the original image ,the other is the compressed
image.And there may be a large number of images
because my project is a web application.
How should i do to reduce the stress of server?Well, you can find some answers under "Image I/O" for your image related IO problems here
http://java.sun.com/products/java-media/jai/forDevelopers/jaifaq.html.

How do I globally set in and out points on a large number of images?

As the post asks: How do I globally set in and out points on a large number of images before sending to the timeline? In AVID I can do this in the Script view. How do I do it in FCP?
Thanks in advance

Thanks. I assumed I needed to set in and out points. I have not done an image sequence in FCP. If I have a 10 second image and a 2 second transition, but then change the duration of the transition to say 4 seconds then FCP will let me alter the transition duration?
With regards to movie clips, what happens with setting global in and out points? How would I do that?
Thanks in advance

Canvas Resize to Square for a large number of images using script. E.g. image is currently 1020 x 600, I would like to change this to 1020 x 600. PLEASE HELP

Hi All,
I have a large number of images that I need to resize the canvas sizes to a square, the images are currently in different sizes. For example, if an image is 1020 x 600 I would like to change the canvas to 1020 x 1020 so that the image becomes a square. I am using CS3 and all the images are jpeg's. I have done research on scripts but the ones I have tried have not worked. Please help.
Thanks.

Since you do not want to crop your images to a square 1:1 aspect ratio changing the canvas to be square will not make your images square they will retain their Aspect Ratio and image size will be changer to fit within your 1020 px square. There will be a border or borders on a side or two borders on opposite sides. You do not need a script because Photoshop ships with a Plug-in script to be used in Actions. What is good about Plugins is the support Actions. When you record the action the plug-in during action recording records the setting you use in its dialog into the actions step. When the Action is played the Plug-in use the recorded setting an bypasses displaying its dialog. So the Action can be Batch. The Action you would record would have two Steps. Step 1 menu File>Automate>Fit Image... in the Fit Image dialog enter 1020 in the width and height fields. Step 2 Canvas size enter 1020 pixels in width and height not relative leave the anchor point centered it you want even borders on two sides set color to white in the canvas size dialog. You can batch the action.
The above script will also work. Its squares the document then re-sizes to 1020x1020 the action re-sizes the image to fit with in an area 1020 x 1020 then add any missing canvas. The script like the action only process one image so it would also need to be batched. Record the script into and action and batch the action. As the author wrote. The script re size canvas did not specify an anchor point so the default center anchor point is uses like the action canvas will be added to two sides.

Handling of a large number of images

Hi,
I have 2 iOS apps that have been in the market, 3 years on iPhone, 2 years on iPad HD version. The apps are a popular reference tool in the medical field. They are both comprised of 1100+ images. The current app size is roughly 52mb.
Approximately 400 images will be redone. They are currently jpg and low resolution. The replacements will be png, with higher resolution.
I'm uncertain on pixel size for these images. If they are in the 280x280 range, each file is about 100k, if in the 560x560 range, each file is almost 400k.
So I'd be looking at additional 40mb for the smaller images and 160mb for the larger.
There are plans for another 400+ images in the near future. So, I'm somewhat concerned with final app size.
If I went with the larger size for Retina devices, can I downsize the images for non-Retina devices?
If I supplied both sizes, image.png and [email protected], that would be 200mb just for these images.
I'm a little uncertain on how to manage these with regards to their individual size and, more importantly, their total size.
Any comments or suggestions are welcomed and would be helpful.
TIA,
jb

Suggest you use the iOS Dev Forums...
https://devforums.apple.com/community/ios

When loading large number of images, images begin to fail to load in IE11 with DOM: 7009 error (unable to decode) in console

When loading many images on a single page in IE (reproduced in IE11), some of them begin to fail to load, and have something similar to the following warning in the console:
DOM7009: Unable to decode image at URL: '[some unique url]'.
When I look at the network traffic, there does appear to valid responses received for each of these images from the server. It's not always the same images each time. If I use the dev tools to force the image to reload (example: I update the url to include some some extraneous url parameter "&test=1"), it loads/renders normally without error. I've reproduced this behavior with different types of images (jpegs/pngs; example png included below). Apologies for the cross-posting. I wasn't sure what the particular etiquette was for that - I've also posted this issue on StackOverflow and MS Connect under the same title. If one of those is a more appropriate place for this matter, please let me know and I'll close this issue.

yup, i have encountered this problem as well. I'm loading an array of image frames for a movie, and i'm using preloadJS (javascript preloading library) and not displaying the images upfront.

Copy and paste of images still broken?

I use Firefox 14 and Windows XP, and I can't copy and paste images from the web into, say, a Word document. I used to do this all the time for knitting patterns, and it's very frustrating to have lost this function. I see from the knowledge database that this problem existed since version 11 or 12. Is there a solution somewhere?
Or, can someone help me download an earlier version? All I can find are release notes.
Thank you.

Hello, maybe if you install the newest version of Firefox will fix this problem, here is the link for Firefox 15 http://www.mozilla.org/en-US/firefox/all.html
Also if you think that an earlier version will work for you you can find them here but i dont recommend it.
http://www.oldapps.com/firefox.php

Trouble importing large number of photos from network drive

I just purchased my first Mac. I have attempted to import my photo library from my NAS device. Iphoto takes hours to perform this import. In fact after 2 days of watching it crunch, I terminated the import.
I can see and open the photos from the iMac. I disabled AirPort and starting using ethernet just in case the wireless network wasn't fast enough to download all the photos.
There are about 12k photos (12G) to import.
I don't understand what the problem could be. I never had this problem with a PC & Adobe PhotoAlbum.
I will appreciate any help.

guadman:
As you found Airport is not fast enough for that kind of massive file transfer and you might have run into a ownership/permissions issues with a direct import from a NAS device. I suggest you copy the folders of files onto your desktop first. The download and run BatChmod on the foldesr with the settings shown here, putting your administartive name in the owner and group sections. You can either type in the path to the folder or just drag the folder into that field.
Then import those folders into iPhoto. That should be successful.
Do you Twango?
TIP: For insurance against the iPhoto database corruption that many users have experienced I recommend making a backup copy of the Library6.iPhoto database file and keep it current. If problems crop up where iPhoto suddenly can't see any photos or thinks there are no photos in the library, replacing the working Library6.iPhoto file with the backup will often get the library back. By keeping it current I mean backup after each import and/or any serious editing or work on books, slideshows, calendars, cards, etc. That insures that if a problem pops up and you do need to replace the database file, you'll retain all those efforts. It doesn't take long to make the backup and it's good insurance.
I've written an Automator workflow application (requires Tiger), iPhoto dB File Backup, that will copy the selected Library6.iPhoto file from your iPhoto Library folder to the Pictures folder, replacing any previous version of it. You can download it at Toad's Cellar. Be sure to read the Read Me pdf file.

Setting maximum number of image buffers in MAX in IMAQ vision builder

To aquire large number of images using duncan Technologies Camera (7f/s) on IMAQ PCI 1424 i'm supposed to set the maximum number of buffer images in MAX(Measurement and Automation)in IMAQ vision builder. But i do not see the option for specifying the maximum number of image buffers under the properties of PCI 1424. Please advise.
Thanks in advance.

The setting is somewhat difficult to locate.
In MAX, select "Tools" on the main menu bar. Under that, select "IMAQ". The only option that comes up is "Max number of buffers".
Bruce
Bruce Ammons
Ammons Engineering

LR 3.2 crashing when writing XMP changes to large number of files

I've been making some minor changes to a large number of images in bulk and have had LR 3.2 stop responding and crash numerous times. The changes seem to apply to the database, it's just the writing to XMP for a large number of images that crashes (it writes to many, but eventually crashes which is a problem because I'm not sure which ones have saved and which haven't).

The files are only 2MP each, and I have the same issue when I apply the changes to RAW files and JPG files. The error occurs though before any changes are applied, before the images would need to be recached, as when the error doesn't occur the dialogue box I mentioned pops up asking what to change.
Your specs sound more then enough I would think. Do you have set the option to Write cache to folders when possible and if so could you uncheck that option?
I don't have experience with this kind of numbers but I do dump the Bridge cache manually on a regular base (every new cycle it seems to be more stable so more interval in the periods of dumping cache) but my main folder contains usually around 6 to 7 K of DNG files from 21 MP dSLR. This starts caching without problems but takes a few hours before done.
Can't use the option cache for folder due to a longstanding problem with error message to replace the CacheT file, hence my question about your setting.
Also I have set the option to previews Always HQ and in the prefs have set the option to build monitor size previews.
As said, don't know the large numbers but the 2 MP files are very small and it should be possible for Bridge I would think?
Did you also try to create a new folder and place the files inthere. Or divide them in to three folders for testing?

I have a large number of photos imported into iPhoto with the dates wrong. How can I adjust multiple photos (with varying dates) to the same, correct, date?

I have a large number of photos imported into iPhoto with the dates wrong. How can I adjust multiple photos (with varying dates) to the same, correct, date?

If I understand you correctly, when you enter a date in the Adjust Date and Time window, the picture does not update with the date you enter. If that is the case then something is wrong with iPhoto or your perhaps your library.
How large a date change are you putting in? iPhoto currently has an issue with date changes beyond about 60 years at a time. If the difference between the current date on the image and the date you are entering is beyond that range that may explain why this is not working.
If that is not the case:
Remove the following to the trash and restart the computer and try again:
Home > Library > Caches > com.apple.iphoto
Home > Library > Preferences > com.apple.iPhoto (There may be more than one. Remove them all.)
---NOTE: to get to the "home > library" hold down option on the keyboard and click on "Go" > "Library" while in the Finder.
Let me know the results.

I have accidentally deleted a large number of develped images in Lightroom before I did a backup. I reimported the original raw files back into Lightroom hoping the develop settings would be re-established but no luck. Notice system mau have done an auto-

Question?
I have accidentally deleted a large number of develped images in Lightroom before I did a backup. I reimported the original raw files back into Lightroom hoping the develop settings would be re-established but no luck. Notice system mau have done an auto-backup as have an lrcat-journal file. Can I use this to restore my develop settings. I also have jpgs generated from all the deleted images.

Hello,
if you have a backup of your catalog you can do the following:
1. Backup your catalog first
2. Restore your backup catalog to some location
3. Open your current catalog and select "files->import from another catalog".
4. Select your backup catalog and your lost images. LR ask you if you want to overwrite the current settings or save them as a virtual copy.
As an alternativ you can open your backup catalog, select the "lost" images and save the development settings as xmp sidecar fiels (using ctrl-s). Then open your current catalog, seletct the images and use "Metadata->Read Metadata from files".

How to remove large number of "sent" but still keep them available in case I need to search for something?

Over several years, I have accumulated some 1400 messages in the SENT folder.
Lately my Thunderbird is taking a long time for some actions that used to be instant, like selecting another message to read or delet.
I regularly remove incoming messages to keep the in-box under 300, and I have almost nothing in the other folders.
I tried changing the "local folders" to a different directory, but when I do that, all the old "sent" messages become un-available for searching and potentially continuing a conversation.
Is there a way to move the large number of "sent" messages from the "local folders" but still keep them available for access from within Thunderbird, in case I need something from past chains of replies?

https://wiki.mozilla.org/Thunderbird:Testing:Antivirus_Related_Performance_Issues#McAfee

Importing large number of images still broken in Lightroom 1.1

Similar Messages

Maybe you are looking for