Massive Aperture cleanup of duplicates and renaming of files...

Hi,
I have been wanting to clean up a massive (tens of thousands) cleanup of duplicates for quite some time, and work out a more sustainable workflow and filehandling.
The combination of several small tools seems to give me what I want, and by using:
1. Aperture to export masters with XMP sidecars
2. Mr. Clean (http://www.arcobaleno2001.it/), to clean out duplicate files
3. EXIFRenamer to rename files to createiondate_creationtime.ext
4. DateTree (http://www.orange-carb.org/DateTree/) to place files in a hierarchical structure based on creation date
...leaves me only to figure out how to bring along the XMP sidecar files and have them renamed together with the image files and I would love any input on that.
Obviously, any work done in Aperture in terms of manual sorting/grouping will be lost, but I am willing to make that sacrifice in order to avoid a manual cleanup. Anyone with a similar type of job under the belt - willing to share the experience?
Best regards,
Kjell Are Refsvik

Broken Links
It depends a bit on why things aren't where iTunes expects to find them but if they are in sensible Artist & Album folders in some common location then my FindTracks script should be able to reconnect them to iTunes. FindTracks uses some fuzzy matching routines and searches for multiple potential locations within a media folder. For more details see this thread.
Duplicates
Apple's official advice is here... HT2905 - How to find and remove duplicate items in your iTunes library. It is a manual process and the article fails to explain some of the potential pitfalls.
Use Shift > View > Show Exact Duplicate Items to display duplicates as this is normally a more useful selection. You need to manually select all but one of each group to remove. Sorting the list by Date Added may make it easier to select the appropriate tracks, however this works best when performed immediately after the dupes have been created. If you have multiple entries in iTunes connected to the same file on the hard drive then don't send to the recycle bin.
Use my DeDuper script if you're not sure, don't want to do it by hand, or want to preserve ratings, play counts and playlist membership. See this thread for background and please take note of the warning to backup your library before deduping.
(If you don't see the menu bar press ALT to show it temporarily or CTRL+B to keep it displayed)
I intend at some point to improve DeDuper so that when there are multiple duplicates, where at least one is connected to a file while others are missing, it can throw away the entries to any missing files, however the current version needs all duplicates to have been repaired first.
tt2

Similar Messages

What is causing this? The file "iTunes Library.itl" does not appear to be a valid iTunes library file. iTunes has created a new iTunes library and renamed this file to "iTunes Library (Damaged) 4". This happens everytime I start iTunes lateley. Help!!!

Everytime I open iTunes lately...I get all my music thrown out of the library and this annoying message come up...The file “iTunes Library.itl” does not appear to be a valid iTunes library file. iTunes has created a new iTunes library and renamed this file to “iTunes Library (Damaged) 4”. Is this how an apple works? It doesn't? Why all of a sudden is it doing this? Please help. Thank you.
David

Did you happen to bring this iTunes library over from a windows machine? You might read this kb article to see if it helps http://support.apple.com/kb/HT1451

Why has this occurred The file "iTunes Library.itl" does not appear to be a valid iTunes library file. iTunes has created a new iTunes library and renamed this file to "iTunes Library (Damaged)".

My itunes library suddenly that the file “iTunes Library.itl” does not appear to be a valid iTunes library file. iTunes has created a new iTunes library and renamed this file to “iTunes Library (Damaged)”. I use an external hard drive for my Itunes.

The library file appears to have been corrupted. You say you use your external drive but is the whole library on it or only your media? No matter, you will have to rebuild the library file:
iTunes: How to re-create your iTunes library and playlists - http://support.apple.com/kb/ht1451

How to do search with multiple texts across documents and rename the file with found text?

Hello:
I'm trying to do the batch search across the multiple documents and rename the file (or save as) after the found word?
In example:
I have many unique texts and would want to search across the multiple documents.
If a document is found with that unique text then, the document is either renamed or save as with that unique text.
So, I could know what unique text that file holds.
How do I do that?
Let me know.
Thanks

Welcome to the forum!
When you want to post a block of code, you can enclose it with the mark ups { code }
That is the key word code surrounded by curly brackets, but without the spaces
You seem to be running a very old (and unsupported release of the database)
7.3 has not been a current release for about 10 years.
It's probably been that long since I've used this technique, but i think it should work.
You should consider welcoming your system to the 21st century by upgrading to a supported release ;-)
If you used split to chop up your export file, use cat or dd to reassemble it.
So, something like this:
mknod bk.dmp p
cat xaa xab xac xad xae xaf xag xah xai > bk.dmp &
imp SYSTEM/$PASSWD parfile=imp_bk.parfile
rm bk.dmp
$ cat imp_bk.parfile
file=bk.dmp
log=imp.log
full=y
buffer=1048576
ignore=y
commit=y let us know if still have problems.
Good Luck!

Is there an alternative to Canon CameraWindow to import photos and rename the files to include shooting date?

I've used Canon's CameraWindow software for years to import large quantities of photos direct from my SD card, specifically because it renames the files based on date taken and nicely orgnizes them into folders. I save those to an external HD and import them to my iphoto library. Now after moving to Lion, CameraWindow isn't compatible because it's a PowerPC app I guess. I can't find any update via Canon. I don't really use any of the other EOS Utilities, I just want to be able to rename those files by dates, which is why I don't use iphoto to import and I've seen that suggested in other places. I'm happy to abandon Canon software all together if there is an alternative out there. Thanks for any suggestions!

Most professional photo management software can batch-rename files using metadata such as date, and can organize into date folders on import. I know that Adobe Lightroom and the Photo Downloader in Adobe Bridge can do this, and I think Apple Aperture and PhaseOne MediaPro can too. All of these programs are maintained for OS X compatibility better than Canon and Nikon software are.
Have you looked at Canon's camera software page? They have Canon software that works with Lion and later, the only question is whether the software for your specific camera has been updated.

Duplicates and referenced photographs(files)

Aperture recently and quite mysteriously started downloading photographs from my camera with duplicates, original file and original file(1). I note others have had similar issues but those who posted with the issue did not indicate if the issue was resolved.
This is also happening with attempts to do local file imports. Aperture is copying both the original file and than a duplicate to the hard drive if I attempt to import from the external drive.
Solutions anyone?
Message was edited by: ryanka

All files are imported as referenced and stored on the internal hard drive, and manually copied to the external drive. Until my last TM backup I was manually copying the Aperture library to the external drive, unfortunately my last copy was 6/13 after the issue started.
When working images I generally work within Aperture while occasionally using Photoshop. Referenced files used for version creation and maintained within Aperture. If any images are needed for printing or recently for a digital frame, specific images (referenced or version) are exported to a temporary file and thus are jpeg, printed and/or used for other purposes.
It appears that this issue started with a folder that had a Photograph that was edited via Photoshop and is consistent since that time frame.
I shoot primarily RAW plus JPEG, though occasionally JPEG . Having shot both within the time frame of duplicates occurring. I also noticed if RAW files+JPEG are shot it is only RAW that are duplicated. IF JPEG only are shot, JPEG's are duplicated. All display the additional file name involving the (1) while those actually on the CF Card with the nomenclature on the local drive that is the same as that on the CF card. The referenced file in Metadata displays as the original file while the file name in metadata displays as the (01) image.
As a note of interest more recently the Aperture library did not indicate an increase in size when downloading a large amount of JPEGS and until yesterday in rebuilding the library, was not accounting for any July images, checking calendar nothing was appearing. Though images were visible in the browser.
Yesterday I noticed all file attributes (open with) for RAW images had changed to Photoshop, thinking this may be a part of the issue changed attributes back to Preview. I also attempted to rebuild and "VACUUM" Aperture library. Tried a slow day of photographs and again files were duplicated with the same naming process. (1)
I shot some images this morning, manually copied them to hard drive (in lieu of importing into Aperture with Aperture) with the appropriate dated folder and then imported into Aperture. The same issue occurred.
If by import settings you mean the configuration Aperture uses when I import a CF card, the setup is Year/month date.
Message was edited by: ryanka

Moving and renaming image files

I want to move & rename image files to folders on the hard drive by dragging and dropping them into my application. I read about the problem with renameTo() method with windows. Is this possible to do in java? I heard about a method in which you read,write and delete the old file? How do I go about making this happen?

Well, what happens if you create the folder C:/Test/testfile1.txt ?
Or alternatively remove the part that says "testfile1.txt" from the directory path in your program.
Or alternatively call dir.mkdirs() before trying to rename.
What I am getting at is that when you create a file with the constructornew File(dir,newdest.getName())the parameter dir is treated as a directory no matter what its name is. If its name is "C:/Test/testfile1.txt," the name of the new file will be "C:/Test/testfile1.txt/name_of_newdest"where name_of_newdest is the name of the "newdest" file. This might not be what you wanted

Ssis - move files from one directory to another and rename destination file if present

Hello,
How is it possible to move files from one directory to another directory and if the file already exists in destination directory then rename it?
Thanks

1. Use a foreach loop with file enumerator pointing to first directory.
Inside loop have a ssis variable of type string to get filename (@[User::FileName])
Choose option as Fully Qualified in loop
2. Add another variable called @[User::DestFileName], set EvaluateAsExpression true for it and set expression like this
REPLACE(@[User::FileName],<source directory path>,<destination directory path>)
put actual paths in above expression in your case
and another variable called @[User::RenameFileName], set EvaluateAsExpression true for it and set expression like this
REPLACE(@[User::FileName],".","_old.")
3. Create a boolean variable say @[User::FileEXists]
4. Add a Script Task inside the loop and pass @DestFileName variable in ReadOnly mode and FileExists in ReadWrite mode
Inside Script Task write code as per below
http://blog.dbandbi.com/2013/11/13/check-file-exists-ssis/
5. Add File System Task choose operation as Rename File, Select IsSourcePathVariable as true and select @[user::DestFileName] variable and IsDestinationPath variable as true and select @[user::RenameFileName] variable
6. Choose ExpressionAndConstraint option for precedeence constraint from ScriptTask to above File System Task and choose constraint as OnSuccess and expression as
@FileExists == True
7. Add another File System task with operation as Move File Select IsSourcePathVariable as true and select @[user::FileName] variable and IsDestinationPath variable as true and select @[user::DestFileName] variable. Join Script Task as well as
File System Task above to this task and choose constraint as OnSuccess and Multiple Constraint option as Or (dotted line)
Then once executed it will work as per your requirement
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

How to duplicate and rename programatically the basic VI and all his subVI

Hello everybody!
In my sequencer I used a basic VI to control a device. This basic VI has 100 subVI's, most of them use some shift register and clusters for handling data.
Now I have to use simultaneously 2 devices of the same type (so I'm afraid that is not a good idea to use same subVI's for both devices because I can get wrong results).
I need two different names for my devices to control them separately via GPIB.
So I want to duplicate this basic VI control and his subVI's using new names (old name+index2 e.g. read.vi=>becomes read2vi). Of course the new duplicated VI has to use the indexed subVI's.
The solution I used in the past is to open the basic VI save it using new name...... and then...... repeat this operation for each subVI. This takes a lot of time and each time when I change somethings in the VI, I have to change the same in the duplicate VI. Some times other persons makese the changes and is very difficult to verify if the changes are also done in the duplicate VI.
Can I do this programatically?
Or there is another way to solve my problem?
Thank you!

Hi Nicku,
and when you get a 3rd device you create a 3rd copy of the whole hierarchy to control that device too?
Instead you could:
- use VI templates instead
- make an array of measurement data and use your VIs in an autoindexing FOR loop
- separate data aquisition from data analysis to ease point 2
Best regards,
GerdW
CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
Kudos are welcome

How Do I Get Rid Of Multiple Duplicates AND Relocate Numerous Files?

Basically I'm fed up of iTunes.
A couple of months ago, i had a problem with my itunes library due to a message regarding the iCloud. This practically deleted my whole iTunes library and forced me to relocate every single track, which took a lot longer than it needed to.
I was already annoyed with iTunes by this point, until yesterday around 1/3 of my tracks were still unlocated, however I could cope with this because I had the majority of my songs, despite this not being ideal.
Yesterday I was informed I needed to update my iPod, naturally I did. Then...this is when I start to get mad, my iPod crashed, then restored itself COMPLETELY back to factory settings, removing my songs and all my apps. I reopen my iTunes library to see that, that has also restored and NONE of my music is there.
Now, after a bit of fiddling, I have an iTunes library full of songs which have been duplicated twice or even three times, to add to it, hardly any are actually located. It's not just as simple as redownloading from iTunes, because I expect half my library is music from CDs. So now not only am I faced with trying to get rid of all the duplicates, I also have to locate all the songs (I have checked the preferences and redirected it to My Music > iTunes - basically what it should be) and I have to get rid of all the songs that I didn't want in the first place such as old songs that should be long gone off my iPod/Library from now.
If anyone could help, that would be great, because I'm so tired this time-consuming mess my iTunes has become.
Thanks in advance!

Broken Links
It depends a bit on why things aren't where iTunes expects to find them but if they are in sensible Artist & Album folders in some common location then my FindTracks script should be able to reconnect them to iTunes. FindTracks uses some fuzzy matching routines and searches for multiple potential locations within a media folder. For more details see this thread.
Duplicates
Apple's official advice is here... HT2905 - How to find and remove duplicate items in your iTunes library. It is a manual process and the article fails to explain some of the potential pitfalls.
Use Shift > View > Show Exact Duplicate Items to display duplicates as this is normally a more useful selection. You need to manually select all but one of each group to remove. Sorting the list by Date Added may make it easier to select the appropriate tracks, however this works best when performed immediately after the dupes have been created. If you have multiple entries in iTunes connected to the same file on the hard drive then don't send to the recycle bin.
Use my DeDuper script if you're not sure, don't want to do it by hand, or want to preserve ratings, play counts and playlist membership. See this thread for background and please take note of the warning to backup your library before deduping.
(If you don't see the menu bar press ALT to show it temporarily or CTRL+B to keep it displayed)
I intend at some point to improve DeDuper so that when there are multiple duplicates, where at least one is connected to a file while others are missing, it can throw away the entries to any missing files, however the current version needs all duplicates to have been repaired first.
tt2

File - Get info and Renaming a file

Get Info on a file.
In the Name and Extension box, rename it to something already in the same location.
Click the close window dot.
A window pops up telling you that the file name is already used (or somethign similar). Close the window and the Get Info window is also closed.
Should't the Get Window stay open since a change was attempted but didn't happen?

No?

How can i copy and rename the file i have copied to a different folder

i have a file in a source folder and i want to copy it to a different folder.
all these file coming from source have the same name and i am putting them into one folder that is the destination
and i want to rename it as 1_1.txt 1_2.txt and so on.
below is my copy fuction
UTL_FILE.fcopy ('FLX_SIGNATURES',
filesource, -- source of image which i get using a loop above
'DELTA_SIGNATURES',
filesource --destination image which i want torename
the above is in a loop
so for each filesoure the name will be 1_1.txt for all folders that have the same file name and i want to change the name any time i copy can you help

Dear kama021!
Please have a look at the following link. It shows UTL_FILE.FRENAME. That should be the procuedure that fits your needs.
[http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14258/u_file.htm#i1003641]
Yours sincerely
Florian W.

Trying to import and rename Raw files in an automated process

I have been managing for quite a while with Bridge and ACR but recently started playing with the demo of Lightroom and bought the software yesterday. There have been no problems key wording or processing existing Raw files etc. but I have become a bit unstuck on the process of importing new Raw files to the catalogue and I wondered if anybody can offer some advice on best practices. I am trying to maintain the formula I adopted after reading the DAM book.
My plan was to have Lightroom see the raw files as the card is mounted on my desktop and add them to the catalogue in a predesignated place, while automatically renaming them according to my standard file name format e.g Karyl_Raw_090402_V5F8581.dng, then adding copyright data and converting to DNG all at the same time.
I just ran a test with a small number of files and Lightroom was able to import the files complete with the copyright data stored in the IPTC section, which I had previously edited as a metadata preset, but it didn't rename them apart from adding the .dng suffix and they were all dumped in a subfolder within my user's picture folder on the Mac. In ACR I used to import the original .CR2 files, make any adjustments and then do a batch rename before copying to the final folder, which all worked. Obviously the hope is to make this all very automated and efficient so I'd be grateful for any pointers and good advice.
Thanks
Ashley

I seem to be getting there now and have discovered the renaming presets on the right hand side of the import panel. It's actually all working rather well but I'd like to find out more about the various IPTC fields to see if there is more information I should be adding.

Aperture 3, iPhoto-08 and Locate Referenced Files

I usually import my photos to iPhoto-08 and work with my favorite ones in Aperture as Referenced Files.
After upgrading my hard drive and using SuperDupper to restore my system to the new drive, the referenced masters are missing. I have tried Locate Referenced Files but the problem is that the iPhoto-o8 Library is shown as empty which is not. Navigating the bottom panel in Relocate Referenced Files, iPhoto-08 Library only shows 2 folders: Events and Last Import, with nothing inside them.
Using Aperture iPhoto Browser I can see that all the files are in there. Using Finder I can see all my files under iPhoto-08 Library->Originals. No problem under iPhoto either.
The problem seems to be that Aperture doesn't recognize iPhoto-08 Library structure since I upgraded my hard drive.
Has any one had this problem? Any solution?
Thanks in advance,
Adolfo

I just found out this piece of information:
"Yep - Aperture 2 lets you reference files in your iPhoto libraries, while Aperture 3 does not... I have imported all my iPhoto libraries to the Aperture library now in a separate location from the iPhoto libraries."
(http://discussions.apple.com/thread.jspa?threadID=2328349)
Can somebody confirm this?
Adolfo

Frustrated - Duplicates and "download@2008" files in library

Hi,
I had to reformat my computer. I had all my songs on a backup drive. When I downloaded itunes, it found all my songs, but it duplicated everything. I think it's because it searched for my files, and somehow imported them as well, who knows.
I deleted all the files, uninstalled itunes. changed my folder structure around so that it was all a clean slate. Basically, I now have only an itunes music folder, with all the files categorized by artist.
When I import the folder using the import folder to library, it will import all songs, but there are a bunch of songs that still duplicate. Also, it is then creating "download" files. I have about 20 of these, and also a download file called "download@2008 12-27T07;59,20". When I look at the paths to any of these "download" files, it points to songs that are already in my library.
Please please help. I'm losing my mind.
Thanks,
Denise F.

I haven't been through as much as you, but I still feel frustrated (and perhaps about to lose my mind).
I've been using Windows Media Player (and therefore I have all wma files), and that's been fine. All my music is well organized, and the albums and artist information in WMP is very clear and easy to access. People make fun of me for speaking highly of WMP, but so far it's been a great program with no problems.
Recently, I won an iPod Shuffle, so I realized I would have to download iTunes if I wanted to use it. I downloaded it, and have had non-stop problems converting my music into the iTunes format. I have duplicates, albums have been split up... It's just structured everything in a horrible, non-intuitive way.
Everyone talks about how easy-to-use iTunes and Apple software is, but it has caused me nothing but frustration thus far. I'm just glad I won the iPod, and that I didn't actually pay for it.
Sorry to rant (and not say anything constructive related to your problem), but I had to get that off my chest. Ah, the Internet can be a wonderful thing...

Massive Aperture cleanup of duplicates and renaming of files...

Similar Messages

Maybe you are looking for