Find duplicates using EXIF data

Is there any way to find duplicates of images in iPhoto or just on my desktop using the EXIF data on the images.
I have a folder of around 4000 images that i recovered (after my hard drive went down) and now i'm left with the terrible task of trying to sort all of these images out. I know there are duplicates in the folder but I don't fancy looking through every one of 4000 images to find them!
Thanks in advance for anybodys help.

Alan:
Yes. Give Duplicate Annihilator a try. It's compatible with iPhoto 6. You do not want to remove any apparent duplicates via the Finder (Don't tamper with files in the iPhoto Library folder from the Finder). Do all culling from within iPhoto itself or with DA.

Similar Messages

QuickView uses EXIF data for preview, even when bogus. A plist to turn that off?

We moved to MBPs with SnowLeopard recently and just found that many downloaded images usually from publicity or stock-photo sites - give distorted or no preview when we use QuickView (tapping the space-bar) on them in the Finder.
Some investigation showed that the distorted images have EXIF data tha has either been corrued or purposefully messed with. Here's an example where the QV preview widget opens to the width of the screen but at minimum height:
Image width          : 4992
Image height          : 6666
Number of bits per component          : {8,8,8}
Compression scheme          : uncompressed
Pixel composition          : RGB
Orientation of image          : 1
Unknown tag (0)          : 0,0,3,0
X resolution          : 0.0 ppi (pixel per inch)
Y resolution          : 300.0 ppi (pixel per inch)
Image data arrangement          : 1
Resolution unit          : inch
Software          : Adobe Photoshop CS3 Macintosh
File date and time          : 2009:02:20 15:47:58
-- Exif IFD --          :
Color Space          : Uncalibrated
Valid image width in pixel          : 2250
Valid image height in pixel          : 3000
-- Thumbnail IFD --          :
Compression scheme          : JPEG
X resolution          : 300.0 ppi (pixel per inch)
Y resolution          : 300.0 ppi (pixel per inch)
Resolution unit          : inch
Offset to JPEG SOI          : 394
Bytes of JPEG data          : 3933
The EXIF data says the X resolution is 0.0ppi.
These files all open fine in Photoshop or Graphic Converter. Sometimes GC's resolution tool shows that the horizontal & vertical resolutions are different (300 x 0.3 for example) and I can correct it, re-save the jpeg image. and QV then previews them just fine in the Finder.
Most, however only have this bogus resolution in the EXIF data and evidently QuickView preferentially uses that info.
There are tools that can be used to simply carpet bomb the EXIF data of a batch of files, but most of it is useful to us so we'd rathr not rsort to that. Is there a QV plist where clever folks can edit it so QV uses the actual image resolution rather than what's in the EXIF data?
Incidentally, QV in Leopard ignored this data which is why we only now began to encounter images where QV is useless. Bogus EXIF resolutions have probebly been in image headers for years and we did not realize it until we found SnowLeopard's Finder payed attention to them.

We moved to MBPs with SnowLeopard recently and just found that many downloaded images usually from publicity or stock-photo sites - give distorted or no preview when we use QuickView (tapping the space-bar) on them in the Finder.
Some investigation showed that the distorted images have EXIF data tha has either been corrued or purposefully messed with. Here's an example where the QV preview widget opens to the width of the screen but at minimum height:
Image width          : 4992
Image height          : 6666
Number of bits per component          : {8,8,8}
Compression scheme          : uncompressed
Pixel composition          : RGB
Orientation of image          : 1
Unknown tag (0)          : 0,0,3,0
X resolution          : 0.0 ppi (pixel per inch)
Y resolution          : 300.0 ppi (pixel per inch)
Image data arrangement          : 1
Resolution unit          : inch
Software          : Adobe Photoshop CS3 Macintosh
File date and time          : 2009:02:20 15:47:58
-- Exif IFD --          :
Color Space          : Uncalibrated
Valid image width in pixel          : 2250
Valid image height in pixel          : 3000
-- Thumbnail IFD --          :
Compression scheme          : JPEG
X resolution          : 300.0 ppi (pixel per inch)
Y resolution          : 300.0 ppi (pixel per inch)
Resolution unit          : inch
Offset to JPEG SOI          : 394
Bytes of JPEG data          : 3933
The EXIF data says the X resolution is 0.0ppi.
These files all open fine in Photoshop or Graphic Converter. Sometimes GC's resolution tool shows that the horizontal & vertical resolutions are different (300 x 0.3 for example) and I can correct it, re-save the jpeg image. and QV then previews them just fine in the Finder.
Most, however only have this bogus resolution in the EXIF data and evidently QuickView preferentially uses that info.
There are tools that can be used to simply carpet bomb the EXIF data of a batch of files, but most of it is useful to us so we'd rathr not rsort to that. Is there a QV plist where clever folks can edit it so QV uses the actual image resolution rather than what's in the EXIF data?
Incidentally, QV in Leopard ignored this data which is why we only now began to encounter images where QV is useless. Bogus EXIF resolutions have probebly been in image headers for years and we did not realize it until we found SnowLeopard's Finder payed attention to them.

Date stamp photos in Elements 5. using.EXIF data.

Help please: Is there an extention available for elements 5. that will enable me to copey the date in the EXIF data simply with a few clicks onto the bottom right of my photos, like my old 35 mm camera used to.
I still prefer to have my pictures printed and put them in a hard back album, to add imformation afterwards is very time consuming,
Barry. UK.

Hi there
I am in the same boat as Barry. When I try to run D2C, I get the same message (except the number given is 0xc0000135).
I get the same result from stripIPTC.
I am running Windows XP Home. Would it help to play around with "compatibility modes"?
I am surprised that a convenient method of date stamping images is not more commonly provided as there must be many situations, such as documenting the progress of a building or landscaping project. Particularly if there is some dispute, photographs with reliable dates and times recorded can be very valuable.

How to find all uses of data source views in an SSIS solution

I am upgrading Visual Studio from 2008 to 2013 (with SSDT) and SQL Server 2008 R2 to 2012. I have a solution with over 30 dstx files. Each file has multiple OLE data sources and lookup tasks. There is inconsistent usage of data source views
throughout (as compared to SQL queries or table references). It is my understanding that all data source views need to be removed before upgrading SSIS packages from BIDS to SSDT. I tried searching the files as XML for the DSVs but it appears the
GUID reference changes per dstx file. It seems like I will have to look at each source/lookup. Is there quicker way to search for where they are used?
Thanks
Adding this question here. Posted question incorrectly in VSO forum.

All right, yes, they are dropped
Never upgraded a package that had them.
What happens if you just upgrade leaving a copy?
Arthur My Blog
This ended up being what I did for many of the packages. Upgrading the packages severed the data source views and left the SQL in the related tasks (e.g. OLE Source task). Sorry for the delayed mark as answered.

Finding duplicates within a date range. SQL help please!!

I have a table of records and I am trying to query the duplicate emails that appear within a given date range but cant figure it out.
There records that it returns are not all duplicates withing the given date range. HELP!!
Here is my query.
Thanks in advance.
SELECT cybTrans.email, cybTrans.trans_id, cybTrans.product_number, cybTrans.*
FROM cybTrans
WHERE (((cybTrans.email) In (SELECT [email] FROM [cybTrans] As Tmp GROUP BY [email] HAVING Count(*)>1 ))
AND ((cybTrans.product_number)='27')
AND ((cybTrans.appsystemtime)>'03-01-2010')
AND ((cybTrans.appsystemtime)<'03-05-2010')
ORDER BY cybTrans.email;

Yet another method...
<cfset start_date = DateFormat('01/01/2007',
'mm/dd/yyyy')>
<cfset end_date = DateFormat('09/30/2009',
'mm/dd/yyyy')>
<cfset start_year = DatePart('yyyy', start_date)>
<cfset end_year = DatePart('yyyy', end_date)>
<cfset schoolyear_start = '09/01/'>
<cfset schoolyear_end = '06/30/'>
<cfset count = 0>
<cfloop index="rec" from="#start_year#"
to="#end_year#">
<cfset tmp_start = DateFormat('#schoolyear_start##rec#',
'mm/dd/yyyy')>
<cfset tmp_end = DateFormat('#schoolyear_end##rec + 1#',
'mm/dd/yyyy')>
<cfif DateCompare(tmp_start,start_date) gt -1 and
DateCompare(tmp_end, end_date) eq -1>
<cfset count = count + 1>
</cfif>
</cfloop>
<cfoutput>
<br>There are #count# school year periods between
#start_date# and #end_date#
</cfoutput>

Comparing files in two folders to find duplicates using part of file name

I'm not sure if this is something Automator or perhaps Terminal can do, hoping someone might be able to offer guidance or suggestions.
I have two folders filled with files of photographs.
First folder has approx 15,000 files.
Second folder has approx 1,200 files.
I need to compare the files in the two folders and remove duplicates from the First folder. In other words, the 1,200 files in the Second folder are also in the First folder and they need to be removed from the First folder, leaving 15,000 - 1,200 = 13,800 files in the First folder.
To add a wrinkle to the comparison (nothing is ever that easy), the file names are consistent between folders for the first 17 characters (files follow the format of my name_6 digit date_4 digit # sequence, ie nickB0904087110.jpg) but in the Second folder, the files will have an additional tag added to the file name (ie nickB090408_7110Final.jpg).
Any suggestions or help much appreciated!
nick

Old post, sorry, but for the sake of trying to answer it:
The method described here can accomplish the goal, as I understand it.
http://texo.wordpress.com/2009/08/17/comparing-large-directories-fast-in-osx-or- linux/
rsync -rvn --delete /FirstDirectory /SecondDirectory
(He describes: The 'n' flag is a 'dry-run'; remove it and the files will be copied. And '--delete' deletes any files NOT in the FirstDirectory.)
I found I needed to put slashes at the end of the directory name too. ... /Directory1/ /Directory2/
That way it seems to compare those actual folders. Without the slashes, it just put a copy of Directory1 into Directory2. I'm sure there's something I don't understand about rsync though.

New Tool to find duplicates

While it doesn't appear to be Aperture-Library aware, here is a tool that may be useful to find duplicates:
http://www.lightandmatter.org/2011/software-reviews/finding-duplicates-use-anti- twin-to-locate-duplicate-or-similar-photos/

Do you know the Aperture version of "DuplicateAnnihilator"? I find it quite useful, but would like to know how it compares to your new tool.
Duplicate Annihilator: http://www.apple.com/downloads/macosx/aperture/duplicateannihilatorapertureediti on.html
Regards
Léonie

EXIF Dates - how to add/change using exiv2 . . . is there a better way?

Hi, everyone!
INTRO: I'm new to Lightroom. I've gone through a few books and lots of tutorial courses on lynda and youtube, so I feel quite comfortable with LR 5's import process. This post and question is a pre-import/organizational issue.
I have more than 30,000 old, digitized (scanned) photos dating back to the 1950s. Obviously, most of were taken with old, analog cameras. These are now organized into folders by date.
GOAL: I want to import these photos into LR and be able to find them by metadata dates (Capture Date & Time).
PROBLEM: Obviously, old scanned (or even more recent manipulated) photos often don't have the correct EXIF creation date info. Even worse, many (or most) of these old images don't even have an EXIF date field!
WHAT I'VE LEARNED: Using exiv2 filename or evix2 -pt filename immediately shows whether there is or is not date info for the photo. If there isn't, exiv2 -pt filename shows nothing. If there is an EXIF date field, it will be shown.
For all these images with no date field, if I import them into Lightroom, there of course is no date info that shows up in the Metadata panel (under Default or EXIF), nor can you change the date (because the field isn't even there).
If exiv2 -pt filename DOES show the Exif.Image.DateTime field, then in Lightroom, you will see the Capture Time and Capture Date fields, and you will see an icon to the right of those dates that allows you to change that date.
If exiv2 -pt filename DOES NOT show this Exif.Image.DateTime field, you can ADD this field by using the command line:
exiv2 -M"set Exif.Image.DateTime Ascii 1965:01:25 15:45:00" filename (or whatever your date/time is).
Now if you import this image into LR, you will find the Capture Time and Capture Date fields under the Metadata > Default panel...AND you can edit them if needed. That is, the above exiv2 -M command added the EXIF date field that LR needs in order to search by date.
WHAT'S MY POINT, AND WHAT'S MY QUESTION? I have no problem using exiv2 to add/change an EXIF creation DateTime field one folder at a time prior to importing them into LR. This will enable me to search on those date fields**.
My question is this: Is there an easier method?
Surely there must be tens (hundreds?) of thousands of "older" photographers like myself who have troves of old photos that have incorrect EXIF creation date fields, or missing the date field entirely (in which case, as I stated above, cannot be added/edited using LR, PS, FileMultiTool, Graphic Converter, etc.).
I realize that I could look at images based on the folder names or file names, or I could enter dates into tags, but such methods of finding images are not nearly as convenient as using Metadata. Therefore, if I know that an image was taken in June 1962, then I'd like the EXIF metadata to have this info so that I can search on it. To have no EXIF date field or to have a date field that is incorrect is useless.
I'D LOVE YOUR COMMENTS! If there is an easier or better way, I'd love for you to help! There are so many experienced photographers on this forum, and more than likely many of them have old photos with incorrect or missing EXIF date fields that they've brought into LR.
THANKS! I'll really appreciate any and all help you can offer.
David
** there are other EXIF date fields that can be changed using exiv2: Exif.Photo.DateTimeOriginal, Exif.Photo.DateTimeDigitized, etc. But the principal date that LR uses to search for files is the one described above.
P.S. I've also tried jhead -ds1965:01:25 filename (or whatever your date is) to change the date. This works ONLY IF there is already an EXIF date field present. If not, jhead will report an error and not create one. exiv2 -M will create the field.

John,
Thanks very much for your help! I had tried the plugin, exiv2, exiftool, and LR's Metadata menu option only on a single photo.
You are 100% correct about LR's menu option assigning different times! Thank you for pointing this out.
When I set the date and time for about 10 photos, LR's menu option assigned (seemingly random!) times to all of them. Why would LR do this? I can perhaps see offsetting each photo by 1 second (00, 01, 02,...), but simply assigning random times makes no sense at all. At least in the tests I just did, LR didn't shift the time by the same amount, but assigned totally (random?) times to every photo.
Another problem that I found with the LR menu item is that it failed to change the date/time at all for several of the images I selected! The Capture Time To Exif plugin, exiv2, and exiftool had no problem at all with the same photos.
I also looked at the ExifMeta by Rob Cole that you mentioned. It looks very powerful (and is free), but much more complex than what I need at this point.
Therefore, I purchased the Capture Time To Exif plugin, and it works great on multiple photos.
I now have good methods to change the date for multiple images:
1. Prior to import: exiv2 or exiftool
2. After import: John's Capture Time To Exif plugin
Thank you again for your help!
This brings me one step closer to importing my photos in a logical method.
David

Missing EXIF data when using other photo apps besides "Camera"

I have recently been trying to use the EXIF location and camera info information created with images in the iphone 3GS and noticed that the only image files that have the full EXIF data attached when imported to my computer are the images created using the iPhone native Camera app. I have numerous photo apps that take great photos which when downloaded are missing almost all the EXIF data.
What is up? Is apple requiring third part apps to strip the data or somehow blocking them from capturing the EXIF location data for download?
I know many of these apps are using the location data to geotag the images and link to maps.
Thanks for any info!

Thanks, I posted it there! Actually I have been searching for some site to officially post a bug report to Adobe, but didn't manage to find it myself...
Regards
Peter

How to remove Exif data using terminal

I want to remove Exif data from images using Terminal
I've googled and cant find anything
There's a Linux command, but nothing fro Terminal - or at least I cant find
Thanks
Omar

@Frank Caggiano, thanks. i only want to remove and not do anything else. exiftool allows u to write as well
my ideal solution: not to install anything
that's something that comes from windows: fearing that installing things will clog up ur system. lol
i need imagemagik for other image editing anyway
thanks for the replies

Problem creating a 'used sources' list based on EXIF data in InDesign CS5

Hello everyone,
I recently started to use InDesign CS5 to work on school projects. These projects regularly require us to have a list of sources, not only for citations and referenced work, but also for images. As I sometimes make quite long documents, keeping track of what image is where, and where I got it from, gets tedious.
I had the idea of generating a caption based on EXIF data, which I'd move to the pasteboard, and group it with the image. The text in the caption has a seperate, numbered paragraph style. On one of the last pages, I generate a table of contents, which the numbered paragraph style selected. I chose to display it using another paragraph style, without page numbers.
What I want to have as the end result is:
Table of contents
1. <Title>. <Author> (<Creation Date>). Retrieved <Date Placed> through <Description>
The captions display correctly, as shown above in the body of the table of contents. The table of contents itself however, shows only the numbering in front of it, and not the variables.
I already tried converting the live captions to static captions, but that doesn't work. Does anyone have an idea how to solve this?

Hello everyone,
I recently started to use InDesign CS5 to work on school projects. These projects regularly require us to have a list of sources, not only for citations and referenced work, but also for images. As I sometimes make quite long documents, keeping track of what image is where, and where I got it from, gets tedious.
I had the idea of generating a caption based on EXIF data, which I'd move to the pasteboard, and group it with the image. The text in the caption has a seperate, numbered paragraph style. On one of the last pages, I generate a table of contents, which the numbered paragraph style selected. I chose to display it using another paragraph style, without page numbers.
What I want to have as the end result is:
Table of contents
1. <Title>. <Author> (<Creation Date>). Retrieved <Date Placed> through <Description>
The captions display correctly, as shown above in the body of the table of contents. The table of contents itself however, shows only the numbering in front of it, and not the variables.
I already tried converting the live captions to static captions, but that doesn't work. Does anyone have an idea how to solve this?

Any way to disable "Use Relative Dates" everywhere in Finder?

Is there any way to make Use Relative Dates to NOT be on by default in Finder?
I just hate the yesterday, today, etc. crap. I want to just see the file dates. Period. I don't want to have to figure out what the date was yesterday to do a file date comparison.
Yes, you can turn it off but each time I check Use as defaults and open a new folder in finder, the relative dates are back! Argggh!
Thanks for any help on this.

Yes its very easy, with finder open, finder bar at top see View, "drop down box" Show View Options, remove the check mark for use relative dates.

Siri can't find music unless I enable use cellular data for Music

I have an iPhone 4S with the latest IOS. I ask Siri to play music but "she" can't find it unless I "enable" Use Cellular Data for Music.
As soon as I enabled this setting in the Settings -> Cellular section Siri could find and play the music.
I certainly don't understand why this is happening. Why isn't Siri able to just find what is local to my iPhone and play the music.
Can someone enlighten me on why this would happen?

Hi Chris,
Songs are on the iPhone - there is no cloud symbol (I'm familiar with that as well).
I've updated my signature - I am running the latest OSX and IOS (thanks for reminding me).

I have installed the latest version of iOS in my ipad but forgot to backup the content, what should i do!!! I don't want my media and other data erased, how can i find back all the data in my ipad? I haven't restore ipad yet, so any others way can be use?

I have installed the latest version of iOS in my ipad but forgot to backup the content, what should i do!!! I don't want my media and other data erased, how can i find back all the data in my ipad? I haven't restore ipad yet, so any others way can be use? Now my ipad is in recovery mode.

Once you are in Recovery Mode, it's too late to do any backup. I am afraid you are going to lose your data.

How to insert EXIF date time data on photo using Photoshop CS5.5

Is there any script or function available in photoshop CS5.5 which can help me in inserting date time from EXIF onto the photograph.
An automated solution which can do multiple images at once will be preferable.

Before proceeding further, it is to be highlighted that the version being referred to is Photoshop CS5 Extended which is actually Photoshop Version 12.1 and is a part of Adobe Master Collection CS5.5. A screenshot of the version information is attached below for information.
Hence, I dont understand the concern expressed by many about the lowest version eligible for scripting being available in the product.
My version is in effect 12.1 and not 7 or 8.
Accordingly someone may advise on what script to use for inserting the EXIF data onto the image. I also want that the positioning of the text is predetermined and same for a batch of images required to be processed. I dont want to fix the position of text for each individual image.

Find duplicates using EXIF data

Similar Messages

Maybe you are looking for