LR 4.2: "Don't import suspected duplicates" fails repeatedly

After import from CF card, then next import with "don't import suspected duplicates'' checked, failed many times. You must close and reopen the import window, repeating the operation (one or two times) to make it work properly.

Victoria Bampton wrote:
CuriousBystander wrote:
So what you are saying is this:
if filename equals "existing" AND date/time equals "existing" AND file size equals "existing" THEN its a match.
Yep.  And I agree it needs to be better.  You might want to add a feature request at the Official Feature Request/Bug Report Forum
At the risk of necroing a thread, I want to disagree that "it needs to be better" if that translates to "ignores files with small differences in the filename but otherwise the same." From the standpoint of file management, we never, ever want software thinking about this too much. I have encountered multiple situations where i was able to recover from a corrupt file precisely because the software was extremely strict on what it considered to be a duplicate. Put differently, it does not hurt us to have two copies of an important photo, while it can be devastating to have no copies—or one corrupted copy—of an important photo. When importing hundreds or thousands of shots, we absolutely want Lightroom insisting that filename, sixe, and capture date/time be identicial to be considered a duplicate. Otherwise, we want these sorts of decisions left to us. After all, there is a reason that file is different, and it could well be that an atuomated process elsewhere failed and two copies of photo allows us to choose what was the correct image to retain.
Again, sorry for the necro, but I felt this needed to be said.

Similar Messages

  • BUG: "Don't Import Suspected Duplicates" FAILS for two identical files (same name, same MD5)

    Using LR 4.4, I'm seeing duplicate files not detected when the files have the same name and identical content (same MD5).
    Adobe support takes me here, although I'd rather file a bug.
    I've isolated a small test case where I have a directory with a small number of images (taken at the same time with the same camera.)
    I can copy this directory to a different location, then try to import it and one of the files will not be detected as a dupe.
    I've tried re-reading the metadata for the existing library file.
    Files have the same name and same checksums.

    According to the Lightroom documentation
    Lightroom determines a photo is a duplicate of another file in the catalog if it has the same, original filename; the same Exif capture date and time; and the same file size
    Please confirm that your "duplicate" files meet this criterion

  • LR2 refuses to import "suspect duplicates"

    I have recently installed v2.7 with no issues until last night when LR refused to import some pictures it suspected of being duplicates. I tried importing again with the "do not import suspect duplicates" unchecked. LR still refuses to import these pictures - reason given... "suspect duplicates". I don't understand how to get around this issue as the photos are not duplicates. Can someone please help? Many thanks.

    Lightroom uses the filename as the criteria for duplicate images.  It is how Lightroom stores its information about the changes made to the images.  So you cannot have two files with the same name in Lightroom.  Many digital cameras have an option that can be set so that the file number does not reset to 1 whenever a card is replaced or formatted.  It is probably best to have that option activated as it will help to eliminate duplicate filenames.  The other option would be for you to rename all images as you import them into Lightroom.  But then the burden is on you to make sure you create unique names every time you import.

  • Despite checking the "Do not import suspected duplicates" box, my Lr4 still did re-import hundreds of photos. Anyone know how to avoid that?

    Despite checking the "Do not import suspected duplicates"box, Lr4 still did re-import hundreds of photos from the same exact card they were imported from originally. Anyone know what I should do differently next time?

    The problem with duplicate detection is that, as far as I can tell, Lightroom is using details it discovers about the file being imported (examining EXIF data and file stats) and what is already in the catalog. Unless it finds an exact match for all parameters, the file is not considered a duplicate. From my own experience, if Lightroom decides a file is a duplicate it is nearly always correct. However, when it misses, it really misses. I have not read anywhere that Lightroom is building and storing a hash count which would make the process more accurate. I also suspect that the search for duplicates is when you are importing a set of photos from one location (a memory card for example) and storing them into the same folder all the time. So, if you take a memory card and import all the photos into Folder_X and then later try and import the same photos into Folder_X again, Lightroom will catch that they are duplicates. But, if you were to import that same group of photos into Folder_Y, Lightroom will not catch it indicating the comparison is not catalog wide. I am not sure how to influence this behavior and it is not anything you did wrong or failed to do. It just is the way it is...

  • Import problem: Duplicate Files

    Like several others I have been fighting the problem of duplicate file creation when importing photos. After following and interacting with several discussions I decided to run a series of controlled tests, and may have some helpful information. The individual test results are too confusing and large to post, but here are some observations:
    1. The problem does not occur when the Don't Import Suspected Duplicates is checked.This function seems to do its job and handle duplicates whether of the users making or the programs. When it is unchecked the data base is unpredictable and at times can get into a loop creating large numbers of duplicates. This could be the cause of reported system crashes, I just speculating.
    2. Nat Coalsons book recommends that it be unchecked which could be the reason for only some users having a problem.
    3. There should be documentation of the import screen with an explaination of the function of the various options. Data bases by their nature are complex beasts, and trying to learn them by trial and error can lead to disaster.
    4. At this point I would strongly recommend using the Don't Import Suspected Duplicates function. Since LR displays the photos it is rejecting there is a way to check on the decisions it makes.
    Am I missing something?
    frank

    Your Lightroom preference file may be corrupt. Try deleting it to see if that cures the problem. Details on where to find the preferences files are provided at http://forums.adobe.com/thread/358041?tstart=0

  • Find suspected duplicates after import

    I have approximately 11,000 photos to organize.  I created a catalog name and chose to skip suspected duplicates.  Approximately 8,000 photos were imported.  This is reasonable since I consolidated photos from current drives and backups of two computers. 
    How do I find the suspected duplicates?  I want to review the duplicates and delete all duplicates to free disk space.  How do I which photos were not imported?
    Thanks, in advance, for any assistance.
    Ken 

    Hi Ken!
    Lightroom does a fairly decent job finding duplicates during an import but does not make it as easy once the images are in the catalog. Take a look at http://www.lightroom-plugins.com/DupesIndex.php. You can try it for free and see if it will help you out.

  • How does "Select Ignore Suspected Duplicates" work?

    During import, if I select "Ignore Suspected Duplicates" how does LR decide if a given picture is a duplicate? The on-line help doesn' say.

    It is looking for actual, same name and file type duplicates. Basicly with this unchecked it will re-impmort images you have already imported so you will have more than one copy and the will be reported under an 'Already in Library listing under 'Previous Import'.
    It does not apply to differently named same images or same named (including extension) different images.
    Don
    Don Ricklin, MacBook 1.83Ghz Duo 2 Core running 10.4.9 & Win XP, Pentax *ist D
    http://donricklin.blogspot.com/

  • Photos in catalouge and cards, "Suspected Duplicates" - EPIC FAIL

    Scenario:  I'm out in the field filling memory cards and reviewing them on my secondary PC (laptop), marking & editing various images at night.  I do not manage to import all of the photos off of all of my cards (and can't due to disk space requirements).  I want to keep the edits and work (and images, due to running out of cards I formated some of them that I _knew_ were in the LR catalouge AND backed up onto other devices). 
    I get home to my primary PC and export the laptop catalouge and then import it, WIN.  I start importing images from cards that ARE NOT IN THE CATALOUGE, also WIN.  I put in a card that has AT LEAST _SOME_ (but not necessarily all) images in the exported catalouge.  Lightroom FAILS to notice that images that were imported FROM THE SAME CARD into the Laptop & Desktop with THE SAME CATALOUGE are duplicates!
    What I want to do is to BE SURE that all of my images are in my primary/desktop catalouge WITHOUT dupes.  I want to insert the memory card and have LR import ONLY THE ONES IT DOES NOT ALREADY have.  This seems like somehting LR should automagically support, but apparently not.  How do I accomplish what I want to do without doing something rediculous like importing everything regardless, then buying a de-duping tool, deleting the duplicate images using file system tools, then removing the not found images manually from LR?
    I DID NOT find this fourm thread to be especially helpful for me:
    http://forums.adobe.com/message/4843896#4843896
    Please help!

    Yes, I give custom names on import  For example, right now I'm working on importing photos from a card that has early images (i.e. the compact flash file
    H:\NIKON D800\DCIM\101ND800\_PL81846.NEF
    ).  I did not alter the memory card in any way (unless importing the images to LR on the laptop somehow altered them).
    After importing the exported catalouge, my PC has
    D:\Users\liels\My Pictures\Source Pictures\2013\01\06\20130106-Bosque-del-Apache-_PL81846.nef
    But
    H:\NIKON D800\DCIM\101ND800\_PL81846.NEF
    still shows up as non-dupe.  This is different than if I import
    H:\NIKON D800\DCIM\101ND800\_PL81846.NEF
    with the Desktop creating
    D:\Users\liels\My Pictures\Source Pictures\2013\01\06\20130106-Bosque-del-Apache-_PL81846.nef
    and then insert the memory card.  In that case the "suspected duplicates" correctly identifies that
    H:\NIKON D800\DCIM\101ND800\_PL81846.NEF
    is a duplicate of
    D:\Users\liels\My Pictures\Source Pictures\2013\01\06\20130106-Bosque-del-Apache-_PL81846.nef 
    But that DOES NOT happen when
    D:\Users\liels\My Pictures\Source Pictures\2013\01\06\20130106-Bosque-del-Apache-_PL81846.nef
    is created as a result of importing an exported catalouge, even though the source for the image is the very same card, e.g.
    H:\NIKON D800\DCIM\101ND800\_PL81846.NEF.
    I can, in fact import the image with the EXACT SAME renaming scheme & keywords and LR will SILENTLY(!) create
    D:\Users\liels\My Pictures\Source Pictures\2013\01\06\20130106-Bosque-del-Apache-_PL81846-2.nef
    not bothering to ask me if that is what I want or not (my naming scheme DOES NOT ask for ZZZ-FILENAME-X, but it creates it silently anyway)
    Design FAIL

  • "suspected duplicates" are ghosts, is my catalog corrupt?

    Hi, when importing, some of my photos show as "suspected duplicates" although they definitely are NOT in my catalog.  Is my catalog corrupt?  Is there a way to correct it?  Thank you

    Please disregard:
    It turns out that if there are multiple copies of the file in the subdirectory of the directory I am importing from that Lightroom marks them as duplicate, and rightly so.  They aren't duplicate in my catalog, they are duplicate in the subdirectory when I view from the parent directory.  Sorry

  • My MacBook Pro keeps making copies of a document that I am trying to save. I don't want to duplicate the file. I only want to save it on both my hard drive and my external hard drive. I do not want to change its name for every save, which the computer see

    My MacBook Pro keeps making copies of a document that I am trying to save. I don't want to duplicate the file. I only want to save it on both my hard drive and my external hard drive. I do not want to change its name for every save, which the computer seems insistent on doing. Help!!

    11lizzyp wrote:
    can't be saved because the file is read-only.
    I did not create the file to be read-only. I created to be able to continue to add to it as I work on it.
    More on versions here:
    http://support.apple.com/kb/ht4753
    local snapshots:
    http://support.apple.com/kb/HT4878
    Sounds like a permissions problem ie read only.
    If running repair permissions from your DiskUtility.app does not sort it,
    Someone should jump in here with erudite and concise fix.

  • Data loader : Import -- creating duplicate records ?

    Hi all,
    does anyone have also encountered the behaviour with Oracle Data Loader that duplicate records are created (also if i set the option: duplicatecheckoption=externalid) When i am checking the "import request queue - view" the request parameters of the job looks fine! ->
    Duplicate Checking Method == External Unique ID
    Action Taken if Duplicate Found == Overwrite Existing Records
    but data loader have created new records where the "External Unique ID" is already existent..
    Very strange is that when i create the import manually (by using Import Wizard) exactly the same import does work correct! Here the duplicate checking method works correct and the record is updated....
    I know the data loader has 2 methods, one for update and the other for import, however i do not expect that the import creates duplicates if the record is already existing, rather doing nothing!
    Anyone else experiencing the same ?? I hope that this is not expected behaviour!! - by the way method - "Update" works fine.
    thanks in advance, Juergen
    Edited by: 791265 on 27.08.2010 07:25
    Edited by: 791265 on 27.08.2010 07:26

    Sorry to hear about your duplicate records, Juergen. Hopefully you performed a small test load first, before a full load, which is a best practice for data import that we recommend in our documentation and courses.
    Sorry also to inform you that this is expected behavior --- Data Loader does not check for duplicates when inserting (aka importing). It only checks for duplicates when updating (aka overwriting). This is extensively documented in the Data Loader User Guide, the Data Loader FAQ, and in the Data Import Options Overview document.
    You should review all documentation on Oracle Data Loader On Demand before using it.
    These resources (and a recommended learning path for Data Loader) can all be found on the Data Import Resources page of the Training and Support Center. At the top right of the CRM On Demand application, click Training and Support, and search for "*data import resources*". This should bring you to the page.
    Pete

  • LR4.2 and "Do not import selected duplicates" does not always work.

    LR4.2 and "Do not import selected duplicates" does not always work. Running a Mac, 10.6.8, I am cleaning up hard drives, organizing old files. There are times lightroom 4.2 (and before) does not recognize already imported raws and does not gray them out. These are backed up cards and folders of of raw images. Why is the "do not import selected duplicates" check box not working???!!!

    There's a known (and old) bug when duplicate identification fails on photos
    that have been imported from another catalog.
    Sent from phone.

  • In Contacts, I don't have any duplicates, but in iMessage contacts on iMac in Mountain Lion, the contacts it provides for a new message are all doubles. Why and how can I fix?  Thx.

    In Contacts, I don't have any duplicates, but in iMessage contacts on iMac in Mountain Lion, the contacts it provides for a new message are all doubles. Why and how can I fix? 
    I also notice that each contact says iCloud in it twice, but when I go to iCloud.com, there are no duplicates either. Help..

    mdd770,
    Try Contacts>Preferences...>Accounts...remove {-}/re-add {+}your iCloud account.
    If that is not successful, follow the steps listed in iCloud: Troubleshooting iCloud Contacts.

  • Itunes 5014 don't import song from CD

    I've just installed new itunes sw, and it don't import CD.
    It imports only 9 seconds for track and then skip to the next...Why? Solutions?

    Perhaps it depends on the CD, because no one of my colleague may read it on their PC. I don't have another one to prove it.
    The CD has some extra-media contents...perhaps it is the problem.

  • Photos don't import

    i tunes syncs my music correctly, imports cds, etc but MY PICTURES will not import, even though boxes are checked under PHOTOS.
    using latest itunes 8.1

    You don't import photos into iTunes. iTunes is simply used to choose the folder or album on your computer that contains photos that you want to sync to your iPod.
    Here's a simple "How To" on downloading and managing photos from a folder on your hard disk to an iPod:
    1 Create a folder on your hard drive to hold the photos you want on your iPod. Call it iPod Photos for example
    2 Drag the photos you want from your usual picture folder into the folder you just created
    2 Open iTunes, select your iPod in the iTunes Source list.
    3 Click the Photos tab and select “Synch photos from.”
    4 Choose “Choose Folder” from the pop-up menu and select the iPod photos folder you created.
    5 When you want to change what photos are on the iPod just add or remove the photos from the folder you have made and syncronise the the iPod

Maybe you are looking for