Lightroom strips out certain EXIF data (maker notes)

Hi there!
Simple issue: Lightroom and Camera Raw strip certain EXIF data that is extremely useful to macro photographers.
Use case: Canon macro photographer using the MP-E 65mm lens. The lens communicates its Macro Magnification value and this is passed to the camera which stores it in the maker notes. This data is extremely valuable to determine scale and measurements of photographed subjects.
This data is removed when the image is processed through any Adobe product.
Here's some supporting documents:
- RAW file from Canon 5D mark II: http://donkom.ca/lr4-makernotes/_MG_1848.CR2
- EXIF data (extracted via exiftool), please note the inclusion of "Macro Magnification" and the value "4.8x": http://donkom.ca/lr4-makernotes/_MG_1848.txt
- Processed JPG file from Canon 5D mark II through Lightroom 4 (all exif data selected to be included): http://donkom.ca/lr4-makernotes/_MG_1848-processed.jpg
- EXIF data (extracted via exiftool), please note the absense of "Macro Magnification": http://donkom.ca/lr4-makernotes/_MG_1848-processed.txt
Thanks very much,
- Don Komarechka
www.donkom.ca

Just checked this in the final release of LR4 and this issue has not been addressed. I'm hoping that someone has noticed this and can give it some attention!

Similar Messages

Lightroom strips very valuable EXIF data - details

Hey everyone - I've just been playing around with some EXIF stuff, and I noticed something very concerning.
I do a lot of macro photography, specifically with Canon's MP-E 65mm 1x-5x Macro. This lens records its macro magnification factor in the EXIF data, and does so far more accurately and conveniently than I can.
I know that Lightroom and Photoshop strip out A LOT of obscure EXIF data when processed, but this magnification data is extremely valuable when reviewing my photos at a later date.
I can provide sample files if needed, and here is my observations so far:
- data stays intact when converting from .CR2 to .DNG
- data is stripped when converting to JPG, TIFF, and other formats
- data is stripped by both Lightroom and Photoshop
Here is the EXIF data (from exiftool) right from the Canon CR2 or DNG file (both are identical):
http://don.komarechka.com/exif/exif-original.txt
Here is the EXIF data (from exiftool) from a jpg that has gone through Lightroom:
http://don.komarechka.com/exif/exif-lightroom.txt
You'll notice a HUGE amount of extra data in the original raw file. It is certainly worth noting that the EXIF data in a JPG, unaltered from the camera, contains all of the same data as the RAW file.
So, is this something that has been overlooked, is there any way to change this behaviour? Even though Lightroom might not be able to decode this data, I don't see a reason why it cannot be left intact.
Thank you.
- Don Komarechka
http://don.komarechka.com

donkom wrote:
clvrmnky, thanks for your response.
Here's an example for you, the one I've been giving:
I shoot with a special macro lensm the Canon MP-E 65mm f/2.8 1-5x Macro. This lens does not zoom, but the magnification can change from 1x to 5x.This lens communicates its magnification to one decimal point accuracy to the camera, which adds it to the maker notes.
This is important in reviewing images for a number of reasons, including calculating the effective aperture and depth fo field. This is a valuable piece of information that is stored within the makernotes that is removed from the image when sending it through LR, Photoshop, or ACR.
That isn't the only valuable information, however.
The makernotes will tell me if the image was captured using LiveView, if Mirror Lockup was used, if the shot is part of a bracketed set, what the internal camera temperature was, etc. etc.
I'm not sure you've justified your reasoning behind why this block of data shouldn't be blindly copied. If it is removed simply because it is not understood, I would like the option to understand this data on my own, using third-party tools, after the image has left LR.
I understand that this can be proprietary, but likely far less so than the RAW file formats that LR and ACR already understand. It would be trivial to understand where this block of data begins and ends and to leave it in the file on export.
I think this would allow for more in-depth searching based on metadata, for whoever wants to take up that torch. For example, what if I want to see all macro photos I took at a 4x magnification or higher. What if I want to see all photo I took using LiveView. Even if LR doesn't want to do this, stripping the data out prevents anyone else from doing it in the future.
Well, there is an SDK for metadata that has been around for awhile, which allows for custom metadata definitions. But, according to the SDK:
"Values stored in custom metadata fields are stored only in Lightroom's database. In the current release, a plug-in cannot link custom metadata fields to XMP values or save them with the image file."
So, this is more for searching and interfacing with tagset plugins.
Even so, using the SDK to get at maker notes is a losing proposition.
Note that some metadata is proprietary and will not be read into the database. This is to be expected. Lr is not an arbitrary metadata reading app, and there is no guarantee that any app could read all metadata. For example, Lr tries its best to get the serial number info, but this is because there is a lot of value in that for other Lr operations. So the contortions necessary to reliably get that is worth it. Another example is lens info (which is a twisty maze of passages; no app is ever guaranteed to actually retrieve lens info reliably in all cases) where there is a lot of value trying to extract the information that makers often store in very interesting ways. In some of those cases I think Lr will look in the maker notes, but only after exhausting other avenues, and with the caveat that it may never be able to get some information. The app does its best to get at the most valuable info it can get that fits with the standardized metadata models in place.
However, the key here is that maker note data is not in exported files that Lr makes, because it is not normalized data that belongs to the vendor. (This obviates the recommendation of using Metadata Wrangler, which can filter out only that metdata that exists in Lr; I had vaguely remembered a setting that referred to this section but was wrong.)
The field and data formats are not standardized, so you are asking Lr to understand most or all data from all or most lenses and bodies (all of it in varying degrees of similarity and difference) not just data from this lens and this body.
This is also not a trivial matter of "copying" the maker notes over, because copying implies parsing and duplicating what is essentially unknown formatted data containing proprietary data, possibly by custom serialization routines. Remember that maker notes were never intended to be editable, and could be composed of any number of data formats. Some cameras make maker notes that are megabytes of nulls and nothing else!
I think you are out of luck for this specific case. Perhaps with EXIF 3 we will have a more standardized interface cameras and software can more easily interoperate on shared data. Makers need to stop using the maker notes! It was always an egregious hack.
One workaround I can think of is to have a post-export action that uses EXIFTool to update exported images. For those cases where it matters, you could create your own "sidecar" file that has only the maker notes, and then shove those into the JPEG after they are created, or just read it from the on-disk copy and then put it in the new file (possibly in the same directory and added back into the catalogue for convenience.)

How do you strip out certain groups of characters from a String variable

for exapmle...
String date = "11-Feb-2005";
String day;
String month;
String year;
how would you strip out '11' from date to assign it to 'day', and 'Feb' to assign it to 'month' and '2005' to assign it to 'year'.
in my program the variable 'date' will always be in the format of:
ist two digits are numbers followed by '-'
then three digits (letters) followed by '-'
then four digits that are numbers.
i think it has something got to do with charAt or something, im not sure how to do it.
any ideas?

yea i tried the first method and it works fine.
thanks very much.
also... i tried the other one and it outputs... 11 1 2005
which means it works but you see i wanted to put the date in the format of...
Calendar date = new GregorianCalendar(2005, Calendar.FEBRUARY, 11); so i can compare it to another Calender object to see which one is earlier.
that is why i am doing it like this...
Calendar date = new GregorianCalendar(+ year + ", Calendar." + month + ", " + day);
for example...
Calendar xmas = new GregorianCalendar(1998, Calendar.DECEMBER, 25);
Calendar newyears = new GregorianCalendar(1999, Calendar.JANUARY, 1);
// Determine which is earlier
boolean b = xmas.after(newyears); // false
b = xmas.before(newyears); // true
anyways i am just curious.

I had my iphone 4s synced to itunes on my work laptop. The IT group at work stripped out that installation and will not allow me to reinstall. My iphone insists it has to sync to my work laptop itunes. How do I change iphone settings to look at an itunes

I had my iphone 4s synced to itunes on my work laptop. The IT group at work stripped out that installation and will not allow me to reinstall. My iphone insists it has to sync to my work laptop itunes. How do I change iphone settings to look at an itunes installation on my personal laptop?

dcotejr wrote:
I had my iphone 4s synced to itunes on my work laptop. ... How do I change iphone settings to look at an itunes installation on my personal laptop?
You cannot.
By Design the iPhone can Only Sync to One iTunes Library at a time.

EXIF data shown / not shown. How come?

Hello,
if I store a photo (taken with a digital camera) on the internal hard disk of my MacBook Pro, select it in the Finder an press CMD-I, to show the file informations, then under 'More Info", the EXIF data is shown.
If I copy this picture to my NAS drive (a Synology, running DSM 3.2) and do the same, the "More Info" field is empty.
If I copy the file back to the internal drive, do the same again, the "More Info" field shows the EXIF data again.
Why?
And is there a solution for this?
Kind regards
emeu1

Start at the home page for the entire OTN forum web site
https://forums.oracle.com
See the category that is named Oracle Database?
Right-click that and open the link in a new browser page or a new browser tab (your choice).
That will show you a list of absolutely every current forum related to Oracle's database products.
ApEx is the sixth forum in that list.
Alternative method?
Go back to that home page for the forum web site.
See the `+` sigh in front of the words Oracle Database?
Click on that to expand out the first layer of topics.
See the choice that labeled "More"? Select that.
You end up at the same view as with the first method I described.
Nether method is particularly difficult.

Lightroom 4 Export - EXIF data missing

I noticed that the EXIF data did not seem to be included in the jpeg file resulting from EXPORT.
I have double checked to make sure that under the METADATA section to select "ALL" and have both boxes (Remove Location Info & Write Keyword as Lightroom Hierarchy) unchecked.
Doing the same export in Lightroom 3 has no problem to include EXIF data in the JPEG file.
I am running the MAC version of the released Lightroom 4. Thank you in advance.

Hi Dorin, thank you for your reply. After reading your reply, I went back and checked my jpeg files carefully. You are correct that all the EXIF metadata are there.
My statement of 'missing' EXIF data was based on my EXIF data did not show up after I uploaded my JPG files to pBase, while all still worked well with Lightroom 3. Uploading the same set of jpeg files to other photo site like Picasa, the EXIF information is all there. Also, when I import those jpeg files in Lightroom 4, t=all the EXIF metadat are there too. It implies that it is a problem with pBase having probelm reading the EXIF of jpeg file from Lightrrom 4. Not sure what is the difference in Lightroom preparing the jpeg files, but I believe this 'missing EXIF' problem is site specific (i.e. pBase).
I will modfify the Topis to show pBase problem only if I can. Thank you.

Exif maker note gets lost

I have a custom camera that saves some information in the exif maker notes (calibration data). The output is in normal JPEG.
I can see the custom data on all original file. But whenever a file goes through Adobe Lightroom 5 or Photoshop CS6, the maker note seems to be lost. I made sure to have the 'Include all metadata' option on.
Is this by design or is there something I am doing wrong here?

Yes, it is by design.
That is because maker notes are not preservable -- they contain unknown data that cannot be preserved after editing (or really any change to the file).
Previous attempts to preserve maker notes resulted in crashes on various devices and programs because the contents of the maker note were preserved and not updated (but couldn't be updated because the contents are unknown).

Stripping out data from unstructured documents

I have hundreds of word and html documents that I need to strip out certain information. The html docs are completely unstructured. The word documents may or may not have the same structure. How can I leverage PL/SQL to extract out the data that I need? I have seen scripts where using PL/SQL you can give a byte position number. This may work for extracting out some of the data if positioned in the same place but I am looking to simplify the process and get the right information out in one pass. Any help would be greatly appreciated. I am not necessarily looking for an exact answer but rather information that can lead me in the right direction. Of course the exact answer wouldn't hurt.

I read all of the thread for that particular post and I still don't believe I have what I need.
Maybe it is the instr function that you wanted me to look at and maybe not. I just don't know how I would use that to extract data.
What I am looking to do is to use some kind of PL/SQL statement to extract a unique identifier that will be in the document, dates that the document was created or appended, and then some region numbers. So can I use instr to find a value from each document, hold it in a flat file and then import this information back into the database? The value of course will be different in every document.
These files are currently not in a database. I am trying to get this information out of the document to store as metadata for each document. Am I looking at the right way to do this using PL/SQL or is there some other method of data extraction that I should consider

Any way to change/replace EXIF data like the original date of photo?

I'm importing into Lightroom several thousand photos I took with my first digital camera, back in 2000-2004. It's all gone very smoothly. But here's my problem:
In my old workflow, photos I spent time editing wound up as TIF files, and whatever program I used to edit them stripped out the EXIF information from them. As a result, for example, a photo which was actually taken on March 4, 2001 will have EXIF information showing it was taken on March 10, 2001, the date on which I edited it and made the TIF. All of the other EXIF data is stripped as well, the exposure data, lens information, ISO, whether the flash fired, etc. The TIF file basically seems to have no EXIF data other than the file size and my name.
I can live without the other info, really, but the changing of the information about the original date/time means that the TIF file doesn't sort next to the original file in Lightroom, which I'd like it to do. There's not thousands of photos for which I have TIFs, just a few hundred at most.
Is there any way, with a plug-in or some external program, to copy the EXIF information from the original program and insert it into the TIF file?

I'd suggest just using ExifTool.
The command is:
exiftool -tagsFromFile {SRCFILE} {DESTFILE}
So, if you have a tif sans exif named my.tif, and an original jpg with exif named my.jpg, it would be:
exiftool -tagsFromFile my.jpg my.tif
There may be a batch-y way to do this with exiftool, or you could make your own batch file to do this in bulk...
Main link: http://www.sno.phy.queensu.ca/~phil/exiftool/
Examples: http://www.sno.phy.queensu.ca/~phil/exiftool/exiftool_pod.html#copying_examples
PS - To sync changes from files into catalog, use 'Read Metadata from File' function on Library Metadata menu.
Rob

LR 6.0.1 EXIF-Data are buggy after export

We export a Nikon D810-photo with Lightroom.
Here you can see it: http://bilder.uchrin.de/test/DSC_1917.jpg
With a simple batch in php - like this (array exif_read_data ( string $filename [, string $sections [, bool $arrays [, bool $thumbnail ]]] )) -
we read out the EXIF data. here see the result: http://bilder.uchrin.de/test/simple.php
Now you can see COMPUTED.Copyright, COMPUTED.Copyright.Photographer and COMPUTED.Copyright.Editor are corrupt.
COMPUTED.Copyright: efan Uchrin, (C) by St
COMPUTED.Copyright.Photographer: efan Uchrin
COMPUTED.Copyright.Editor: (C) by St
In LR 5.7.1 are the EXIF-data OK.
Is there any help?

Stefan,
I examined the test file closely with Exiftool, and it shows all the metadata correctly. I think the issue is another one: Lightroom CC: JPEG format tripping up other programs. Notice that many of the string-valued fields are corrupted, e.g. IFD0.ImageDescription, IFD0.Model, and IFD0.Make. LR 6 writes JPEG metadata in a way that strictly conforms to the standards but is atypical of the common layout of metadata, tripping up other programs that aren't strictly conforming.
Which version of PHP are you using?
The end of the thread I linked to contains a workaround, using the Run Any Command plugin and Exiftool.

Canon EXIF Data

When I try and export images taken with a EOS 1DS MKII or a EOS 20D, iPhoto conveniently leaves out the 'Owner Name' and 'Serial' fields. Is there any way to add this data in JPG export. All data is present in the initial RAW files but is not passed in the conversion/export process. It is highly important that this data remains with the JPG's for organisation purposes and I dont want to have to launch EOS Viewer just to acomplish this simple task.

Yes, by default, JPG images from the camera have that EXIF data in them, but I shoot in RAW for obvious reasons (which also contains the exact same data). I dont use iPhoto for image managment, but sometimes use it for quick preview jobs, but on conversion, it strips the key EXIF data that I need it to keep. The only way for me to add this back is in the form of IPTC captions which is both time consuming and annoying. EOS viewer is the only utility that I use for exports now as a result of this. Any ways around it?

EXIF data lost from many photos

I was looking through some old pictures taken with a Canon EOS 5D which I sold some time ago.
There were around 3800 pictures.
I discovered that 480 had no entry in their EXIF data fields for BODY SERIAL NUMBER and LENS. Other fields seem intact.
All the other photos had all their data fields present and correct.
Admittedly these pictures have been copied/moved from one PC to another more than once over time, but there again, so have all the thousands of others which have not lost their data.
I did find duplicates of a handful of the errant pictures and the EXIF data fields for these were complete.
Perhaps something has been lost in the copying/moving of these pictures.
The copying/moving has been done with both Adobe Bridge and Windows.
Has anyone experienced this phenomenon?
How might I ensure that it does not happen again in the future?
Or is there some reason other than copying/moving by which the data could have been stripped and why only two fields of EXIF data and not all of it?

I've been having the same trouble for a few months now. All EXIF is lost, including GPS and focal info. It only occurs when you edit a RAW/DNG file and have the "save edits as 16-bit tiffs" selected in the preferences. Please, Apple, help! This is a significant issue when exporting photos! That info is essential.
thanks,
Brett

EXIF data incomplete

Some of the EXIF metadata is not imported. ISO Speed Rating for Canon S1 IS is missing. No camera I have tested has th Focal Length (35mm) filled in and some lens information is missing. I know the data exist because I can see it in IView and Graphic Converter. Is there any way to know Aperture's import settings for EXIF for different camera models?

The S1 IS is only JPG but the EXIF data is available as I can see it in other apps. (iview and Graphic Converter). I have also imported raw images from many other cameras and the EXIF data is not consistent. Sometimes the Focal Length (35mm) is filled in and sometimes it's not. (yes for Nikon D2x, no for Canon 20D) sometimes the serial number is filled in (yes for Nikon D2H, no for Nikon D2X). It makes me very uncertain of the accuracy of all the information.

Script to get Exif data on text layer in PhotoSHop CS4

I am trying to find (or learn how to write ) a script that will include certain exif data on a spearate text layer in an open image. I do not want the full, verbose exif rather soemthing that reads
D3; 70-200 f2.8 @ 89mm; 1/60; f8; ISO 200; Matrix; 0.0 Ev; Apertrure Priority; Flash Y/N
Is there something liek this available? If not, any (polite) suggestions as to how I write same? Especially how do I callup the various fields that I require?
Thanks,
Dave

There are scripts that place metadata from the documnet into a text layer. I don't know of one that uses those exact fields. You could try modifying one of those or create your own.
If you want to create your own, the doc's metadata can be accessed with app.activeDocument.info , app.activeDocument.info.exif, and app.activeDocument.xmpMetadata.rawData

Modify EXIF date?

iPhoto '11 (9.2.2) lets me set a date for photos, but apparently this new date is known only to iPhoto. Even if I check the "Modify original files" box when I set the date, the original date of the photo in its EXIF data is unchanged. This can be a problem, as when exporting photos or uploading photos to Flickr, which either can't see or ignores the date set by iPhoto and uses the date in the EXIF data instead. Is there a way to change the date in the EXIF data?
I saw one post (from 2007) that said checking the "Modify original files" option WOULD change the EXIF date and another post that described changing individual photo dates through the Info mode. Neither works for me. Is that a bug? I have to use Batch Change to modify the date for even a single photo, and even if I do that with "Modify original files" checked, the EXIF data is not changed.

Sorry if I'm not being clear. Here's a summary:
1. A photo is taken in August of 1966 and developed as a slide.
2. Last summer the slide is digitized: EXIF date is 6/7/11.
3. A month or so later I add the photo to iPhoto, which still reports the date as 6/7/11.
4. On 3/7/12, I edit the photo in iPhoto and use the Batch Change feature to set the date to when the photo was actually taken: 8/1/66. As expected, iPhoto Info now shows the date as 8/1/66.
5. On 3/12/12 I use the Flickr uploader in iPhoto to upload the photo to my Flickr set. Flickr reports the date of the photo as 6/7/11.
6. Today, 3/21/12, I look at the file information for the photo in two places: Finder and Tools Inspector in Preview. Both of these places report the same Created and Modified date: 3/7/12 (the date I edited the photo in iPhoto).
So, what is unexplained is:
1. When I change the date in iPhoto, why does the file creation date and modification date change to the present day instead of the date I set?
2. When I upload the photo to Flickr, why does the creation date revert to the date when the image was first digitized from the slide?
And, of course, my only goal is that the date I set in iPhoto show up in Flickr when I upload it there.

Lightroom strips out certain EXIF data (maker notes)

Similar Messages

Maybe you are looking for