Faster 2 TB external drive throughput?

Hi.  I'm a heavy user of Aperture, and am looking for ways to overcome system waits (spinning pinwheel) when using very large Libraries.  The system waits happen when making adjustments, loading containers, and always when emptying the Aperture Trash.
The Library in question is all up-to-date and has been recently repaired (I run "Repair Database" on all Libraries as part of regular maintenance).
My System:
MacBook Pro
Retina, 15-inch, Early 2013
Processor  2.7 GHz Intel Core i7
Memory  16 GB 1600 MHz DDR3
Graphics  NVIDIA GeForce GT 650M 1024 MB
System Drive  APPLE SSD SD512E
For this discussion, let's say "very large" for Libraries means >500 GB and/or >250,000 Originals.  These large Libraries can have millions of files in them.  (I've seen Libraries with almost 9 M files.)
Because of their size, I keep these Libraries on external drives.  Due to cost, I put these on USB-3 drives.  (I do have two powered USB-3 hubs.  I have tested using no hubs, and found no difference.)
I am running Aperture 3.5.1 on 10.9.3.  Smaller Libraries, whether stored locally or on external drives, work flawlessly.
Blackmagic Disc Speed Test gives me a rating of 370 MB/s for my SSD system drive.  The ratings for my several external USB-3 drives range from 50 - 70 MB/s.
Watching Activity Monitor (sad to report, I don't know how to use it under Mavericks to trouble-shoot performance issues) with Aperture loaded, I notice that it reads "Aperture not responding" when I get the spinning pinwheel.  ("Aperture not responding" has been common since 3.3 or so, and never, IME, indicates a hang or crash.)   Afaict, the problem comes from disk i/o.  Memory, however, is maxed out (typically, e.g.: 15.60 - 15.99  GB used).  CPU for Aperture sometimes get to c. 110%, but many times is at c. 10% or less when the spinner appears.
The Library that is giving me the most problems is c. 900 GB on a 2 TB drive.  The Originals occupy 1.75 TB on a second 2 TB drive.
Apple Store employees tell me a Thunderbolt drive will give me hundreds of of MB/s throughput.  I am skeptical because, afaik, USB-3 should give me up to 500 MB/s and I'm not getting anywhere near that (assuming -- perhaps ignorantly -- the the Blackmagic test is comparable to others).  A large TBolt magnetic drive has been recommended.  Will it make a big difference?
What can I do to eliminate the system waits? 
How can I better trouble-shoot what is causing them?
Will Thunderbolt be faster in practice?
Is there any way to get, say, >250 MB/s performance from an external drive holding a very large Aperture Library with millions of files?
Is this the best forum for this?
Thanks.

First problem most hard drives (Besides SAS 15k) have a throughput less than 100MB/sec.
Thunderbolt won't really help in throughput becuase the drives are already maxed out.
Three options for moving forward:
1. Making smaller libraries is going to really help fix this issue.
For reference, your large photo library is like reading the entire encyclopedia to the computer, it takes a long time to look through the entire database (book) to access the files Aperature wants.
When you make said libraries smaller, your computer can read the cliffnotes version in no time at all.
2. Get a Server or NAS that can do RAID 5 and with the right drives you could reach 300MB/sec.
But that's expensive. I've been able to max out a 1gbps(125MB/sec) link with my photo server while copying assorted photos between drives, but I have zero wait times when working with my images.
3. Switch to Photoshop or work with files natively on the disk, not inside a database.
Lightroom works on the same photo database principle as Aperature so I cannot recommend it for your case as you won't see any performance improvement.

Similar Messages

  • Is large iTunes library faster on external drive

    If i have a large library of music and movies, will I get better performance on an external disk drive?

    The answer used to be you'd see worse.  Now I think it probably won't make a differene but not any faster unless you have a truly ancient (15 year+) internal drive.

  • New external drive choices -- what's best for Aperture?

    Hi.  Hardware, I'm sorry to say, generally makes my head hurt.
    Today Apple's delayed Thunderbolt-to-FW800 adapter made it appearance in Apple Stores.
    Purchasers of the new MacBook Pro with Retina Display (rMBP) now have a nearly full set of options for using external drives with Aperture.  I had been using a stable of FW800 drives (with my MBP 5,5).  I'm looking for recommendations on what to upgrade to.
    (Aside: I've been too busy to post a comment recommending the rMPB.  It's my main Aperture machine (I use Aperture every day, but work in two different locations) -- I'm _very_ happy with it.  Highly recommended.  My machine is 16 GB RAM and 500 GB SSD.  But there's still this ports problem ... .)
    The options I know of:
    - use the new adapter and use the old FW drives.  These can be daisy-chained, as before.  Afaik, the total throughput is limited by what TBolt allows (which may be more than enough).
    - move drives to USB3 enclosures.  I did this as a stop-gap measure while waiting for the adapters.  I got my enclosures from OWC.  The drives are not daisy-chainable.  The rMBA has two USB3 ports.
    - buy eSATA hubs and use the eSATA ports on the drives.  This one just became available.  Expensive, imho.  Not sure how the Mac will handle it (I always have Originals referenced to external drives; I sometimes have Libraries on external drives).
    - move drives to TBolt enclosures.  These are slowly coming on the market.  They are very expensive (imho).
    - replace the drives with TBolt drives.  Also very expensive.
    - replace the drives with USB3 drives
    I'm looking for a reasonable middle-term (3-5 years) solution.  Fwiw, I'm not convinced that external drive throughput is even an issue with running Aperture.  It seem to run well on my rMBA even when a large library is connected via USB2.  (I assume Aperture is good at taking advantage of the 16 MB RAM and the SSD "scratch drive".)  I need to have one USB2 port, and one TBolt port, available at all times (various peripherals; the TBolt is for external monitors).
    Thanks!

    Good stuff.  Thanks.  Agree in principle re: "TBolt for displays; USB3 for storage".
    I did get a USB 3 hub.  (Amazon link.  There is a 7-port hub as well.)  Highly recommended (at least for rMBP users).  This works well with how I use Aperture: I have several external drives with mostly Referenced Originals and some Libraries.  Since I rarely use more than one of these at a time, it doesn't matter that the hub throughput is limited to a single USB 3 channel.  The USB 3 hub, for me, functions as a quasi-data-server for Aperture, and takes up only one of the two USB 3 ports on the rMBP.  (Fwiw, with the rMBA I don't think there's much reason for storing Referenced Originals on a fast drive; because of the efficiency of the way Aperture caches, USB 2 may be fast enough.  I haven't measured this yet.)
    I mentioned eSATA only because almost all my external drives came with eSATA ports and cables.  I have never used eSATA.  At this point, I don't plan to.
    I have moved a few drives into USB 3 enclosures (purchased from OWC).  With the USB 3 hub, and the newly-available Apple TBolt-FW800 adapter (which supports daisy-chained FW devices), I am no longer in any practical way limited by the four ports on the rMBP (2x TBolt, 2x USB 3).  Whew. 
    I backup my system drive wirelessly to a Time Capsule every night (by design, the machine doesn't have access to the TC during the day when I'm working), and use SuperDuper to backup all Libraries and Referenced Originals to specific sparse bundles kept on leap-frogging external drives, with one always off-site.  At this point I make no practical distinction between FW800 and USB 3 drives for back-up, as they are all fast enough and the back-ups run unattended.  (But USB 3 seems to be much faster.) 

  • External drive better for virtual machines?

    I've been running VMWare Fusion to run my Windows under Mac (just fine too). But a friend just told me would perform even better if VM was on an external drive. Is that true? If so, USB or FW matter?
    Confused and curious.
    Thanks.

    Internal drives are faster than external drives, so the VM should perform better on the internal drive. If you put them on the external drive, then Firewire is faster than USB.

  • I want to add more capacity on hard drive of time capsule. Can i add a normal usb driver? I will see it as an external drive in the time capsule network? It will work as fast than time capsule? Thanks

    I want to add more capacity on hard drive of time capsule. Can i add a normal usb driver? I will see it as an external drive in the time capsule network? It will work as fast than time capsule? Thanks

    Can i add a normal usb driver?
    Yes, but be sure that the drive is formatted correctly for Mac in Mac OS Extended (Journaled)
    I will see it as an external drive in the time capsule network?
    The drive will appear as a shared network drive, like the Time Capsule.
    It will work as fast than time capsule?
    No, the drive will operate at about half or 50% of the speed of the Time Capsule.

  • Which is faster for music production? internal hard drive or external drive

    hey there. simple question. i'm looking to run music poductin software on an apple mac - would sound files be retrieved faster from a new mac book pro internal hard drive or an external drive? (am thinking one of those lacie orange rugged things that spin at 7200 rpm)
    and if the sound files would play better coming form the internal hard drive, would it compromise processor speed for running soft synths / effects units etc etc?
    please note am not talking about my current mac book, but a new mac book pro
    chanx in advance - horton ;o)

    For what it is worth here is my tuppence worth on the subject, horton. (and a warm welcome to the forums , by the way!)
    One of the major reasons why many sound professionals (and others worried about speed) use fast external FW800 or (when possible) eSata drives for their work, rather than the internal drive of an MBP or the like, is that the internal boot drive is already carrying the OS and a bunch of apps on its fast, outer sectors. It is usually doing a fair bit of work keeping things running, too. An external FW 800 drive can be kept unencumbered of such things.
    On top of this the 2.5" drives in notebooks are slower at the best of times than 3.5" drives. If you want real speed, my suggestion would be that you keep the internal drive for your OS and Apps as much as possible, and get a fast 7200 rpm 3.5" FW800 external with its own power supply for your sound files (assuming you will have access to mains power).
    If you use the internal for this sort of purpose too, you are going to find that the internal fills up fast, that it soon develops free space fragmentation issues, and that it gradually slows to the speed of mollasses!
    Cheers
    Rod

  • Fast External Drive Options Macbook Pro 15"

    Hello.
    I own a 15" Macbook pro 15" core i5 processor in it etc.. I have a dock style enclosure for 2 SATA hard drives that has USB connect and also eSATA. The USB is INCREDIBLY SLOW. I am waiting sometimes 2-3 minutes just to have a song start playing in iTunes... I am looking for a way to use eSATA on this laptop. I bought an Expresscard/34 with eSATA on it because I read that would work with Macbook pros but I was dissapointed when I found out that this generation of them does not support it!! I am running ProTools M-Powered 8, which requires me to use my only Firewire port to hook up my audio interface.
    I love my Macbook and the MacOS, everything about it is better but this small problem is a large hindrance to my workflow. I guess I should add that the hard drive dock is plugged into a Hub. Perhaps If I plug the dock into the second USB port which I hope has it's own separate bus I should see SOME improvement. =(
    Perhaps somebody here has something that might help.

    I knew it wasn't going to cut it, I just don't know much about all these small revisions to the macbook pro. Having never seen an expresscard before I assumed that the SD card slot doubled as the expresscard slot. The people at my apple store said nothing about the expresscard not being on the 15" model when I bought it and asked questions about it. In fact they went looking for expresscards for eSATA at the apple store and ended up recommending Newegg to purchase one. I've just been really mis-informed about this whole expresscard thing.
    I guess I can sell this eSATA/USB dock and look for a firewire hub and enclosure. are there any docks that are reasonable priced?
    By the way, My internal drive works fine for playing back audio that has already been recorded. Mixing is actually faster than on my desktop! The mac screams compared to it. I have sessions in excess of 5gb of audio that play back fine off the system drive, but I will need a decently fast external drive in order to record audio. No Digital Audio workstations respond well when recording to the system drive. =/

  • USB 3.0, fast, portable, external hard drive for HD video editing

    I'd like a 1TB or 2TB, bus-powered, fast, portable, external hard drive for HD video editing on MacBook Air i7 (2013).
    Any recommendations?
    Thanks!

    best options for the price, and high quality HD:
    Quality 1TB drives are $50 per TB on 3.5" or  $65 per TB on 2.5"
    Perfect 1TB for $68
    http://www.amazon.com/Toshiba-Canvio-Portable-Hard-Drive/dp/B005J7YA3W/ref=sr_1_ 1?ie=UTF8&qid=1379452568&sr=8-1&keywords=1tb+toshiba
    Nice 500gig for $50. ultraslim and perfect
    http://www.amazon.com/Toshiba-Canvio-Portable-External-Drive/dp/B009F1CXI2/ref=s r_1_1?s=electronics&ie=UTF8&qid=1377642728&sr=1-1&keywords=toshiba+slim+500gb
    2.5" USB portable High quality BEST FOR THE COST, Toshiba "tiny giant" 2TB drive (have several of them, LOT of storage in a SMALL package)    $117
    http://www.amazon.com/Toshiba-Canvio-Connect-Portable-HDTC720XK3C1/dp/B00CGUMS48 /ref=sr_1_4?s=electronics&ie=UTF8&qid=1379182740&sr=1-4&keywords=2tb+toshiba
    *This one is the BEST portable  external HD available that money can buy:
    HGST Touro Mobile 1TB USB 3.0 External Hard Drive  
    $75
    http://www.amazon.com/HGST-Touro-Mobile-External-HTOLMX3NA10001ABB/dp/B0062FZ2WS /ref=sr_1_1?s=electronics&ie=UTF8&qid=1379185002&sr=1-1&keywords=hitachi+extern a l+hard+drive
    Most storage experts agree on the Hitachi 2.5"

  • Looking for a correct solution for fast external drives

    It is unfortunately after having bought already 8 LaCie external drives of 500 Gb to 1 Tb a few years ago (Firewire 400/800) for my MacPro that I heard from this forum that I should never use these drives for video backup because being unreliable. The poeple who said that were right. Out of the 8 drives, 6 are now dead (disc failures) and lost some precious files.
    So now I am looking for a more reliable solution : I read somewhere that I could have for external storage a PCIe SATA controller w/ RAID performance; a solid SATA case for 4-8 drives perhaps. But when looking at SATA controller on the web, I am not certain whether all these cards work on a MacPro (the first Intel 2006 model with Mac OS Tiger 10) or just with Windows. Can someone advise me on what would be the right SATA card to buy for that computer, where to find them and what case I could link it to to install several hard drives ?
    (By the way, my 4 hard drive racks inside the MacPro are all used already.

    I’m on my third G-Tech external drive and I love their quality. I simply grew out of one and gave it to my son. The new mini works great too although my MacPro doesn’t like it when I partition the drive. It tends to stutter a bit and can lock things up on the MacPro. Still, I plan on buying the G-Safe as soon as I can. They certainly offer RAID Enterprise units although I haven’t used them. G-Tech uses Hitachi drives as the company is owned or associated with Hitachi. Either way, they’re hard to beat.
    http://g-technology.com/products/g-speed-q.cfm
    Message was edited by: Digital Dude

  • SHARING A LR4 CATALOG/PREVIEW VIA AN EXTERNAL DRIVE - A FAST ONE

    Does anyone have experience sharing a LR4 catalog via an external drive. My stuff all come in at different times so we would not be accessing it simulteaneously. Trying to keep the maintenance time down as I spend a lot of time working on my catalog then having to syncronize and import the catalogs on the other MACs to reflect my changes to my local catalog. My thinking is to use an external drive and when the other team member comes in to use the external to work off of. We pass it back and forth.
    Any pitfalls or problems I should be aware off???

    Any pitfalls or problems I should be aware off???
    See similar threads in this forum http://forums.adobe.com/message/4858802
    Also, similar comments apply to those in the replies to your previous post about sharing an LR catalog. It can be done but a meticulous workflow is required.
    http://forums.adobe.com/thread/1148937

  • Re:  Leone's post May 2014 about how to best use an external drive with Aperture

    I am trying to find Leone who had a great post May 2014 to Diane. I posted tho same message as a 'Reply' to the Leone/Diane posts but then was worried it would not show up since that was some time ago so I decided I should post it as new.  Apologies if it comes through twice.   I am having trouble as indicated below:
    I found this response to the question about Aperture and external hard drives from last May.  I bought a WD My Book 4TB and need to back up photos I have in Aperture (many!) to free up space.  I am a photographer and need to be able to plug the external drive in as needed, pull a photo out from the WD and back into Aperture to work on it if needed.
    I read your directions to Diane and have the external drive formatted Mac OS Extended (Journaled).  I read the two ways you suggest to move part or all of my library to an external drive and still be able to use it in Aperture with all the metadata saved, as I need to continue to work with the images.  I am not completely clear about the advantage of the 'referenced' method but decided to go with the Split Library because it sounded like the Referenced method would still keep originals (and take space) in Aperture.  I'm not sure about this, but that was what I chose.
    I have backed up my computer, formatted the drive then went to Aperture to begin.  I do the 'Export' and it shows the external drive it will go to but when I click 'OK', it says "EXPORT LIBRARY FAILED - Library could not be create because the file system of the destination volume is not supported."  I doubled checked to be sure the drive was Journaled which it was.  I did call WD and talk to them but they told me this was outside their area.
    Also, in Aperture, I have my photos in Projects by yymmdd.  Is it possible to transfer Projects into the ext. drive without having to break them out of the Projects?
    Any direction anyone might give would be greatly appreciated, Sandy

    Hi Sandy,
    I suggest taking a week or two to get to know Aperture better before proceeding.  Aperture can do many things, and can do what you want.  It's important to be specific about what you want, however.  From what you've said, it appears that you don't yet know.
    bybeeler wrote:
    [1] I found this response to the question about Aperture and external hard drives from last May.  I bought a WD My Book 4TB and need to back up photos I have in Aperture (many!) to free up space.
    [2] I am a photographer and need to be able to plug the external drive in as needed, pull a photo out from the WD and back into Aperture to work on it if needed.
    [1] A back-up is a copy of digital files stores on a separate device.  A back-up is recommended because drives fail, and humans make mistakes.  A back-up is not used to free up storage space.
    [2] Aperture can be set up in many equally-usable ways.  The program files reside (almost always) on your system drive.  The data files can be anywhere you want them, as long as they are on locally-mounted drive(s).  The main data file is your Library.  The best place for it is on the drive that has the fastest throughput to your logic board.  This is, in nearly 100% of machines, the system drive.  But Aperture functions well with Libraries of secondary drives — internal or external — with sufficient throughput.  USB-3 and Thunderbolt I (& II) provide sufficient throughput for using an Aperture Library on a secondary drive.
    Nearly all photographers will fill whatever storage space is available (making data is what photographers do).  The question is: what do you do when your Library no longer fits on your system drive?  (And remember, you should leave at least 10% (I recommend 20% for heavy users of Aperture) of your system drive free.)  The answer depends, primarily, on whether your computer is portable or fixed in location. 
    If fixed, just buy a more-than-large-enough secondary drive of USB-3 or faster throughput, mount it permanently, and move (using Finder) your Library to it.
    If your computer is portable (and you can't increase the on-board storage), you have to select the best from several confusing alternatives:
    • Put your Library on an external drive with throughput at least as fast as USB-3
    — Pros:  Easy to maintain and back-up.
    — Cons:  Must have drive with you in order to use your Library.
    • Leave your Library on your system drive, but relocate your Images' Originals to an external drive.
    — Pros:  You can work on your Library without having the external drive available.
    — Cons:  You can't export (except Previews), Print, or make adjustments until your external drive is mounted.  Significantly more difficult to administer, especially importing and backing-up.
    • Leave your Library and and _some_ of your Images' Originals on your system drive, and relocate most of your Image's Originals to an external drive.
    — Pros: You can do any work on those Images whose Originals are stored in the Library regardless of where the external drive is.
    — Cons: Yet another level more difficult to administer.
    If you are comfortable with the administrative overhead, the third set-up will be the most rewarding.  Keep all _current_ Images Originals inside your Library, and routinely relocate the Originals of Images no longer current to the external drive.
    In no case is it recommended that you at any time remove from your Library an Image (not the Original — the Image in Aperture) that you expect to ever use again.
    HTH,
    —Kirby.

  • Backing up Events on an external drive... but FCP don't like it ??...

    I connected an external drive on my Mac mini for dual purpose of:
    1) backing up Events (captures from DV tape camera), especially that I cannot work will all projects in mind at same time... And capturing a 63 minutes DV tape takes... 63 minutes !!... So don't want to redo it over and over again, should something happen on the working HDD...
    2) Eventually store ''finished projects'' with all their files to free up space on working disk.
    However, it looks like FCPX becomes a little mixed up at opening (''cannot open event twice'' kind of message, as it sees it on both drives).  Unfortunately, it will open (for some of the events) the version on the USB2 drive... which is not the one from which I want to create, edit, and finalize, of course.
    The only turnaround I found was to disconnect the USB drive before launching FCPX ...
    Can't believe there's not a way to set FCP to use from the main HDD in some settings or so ? 
    (I also read in a tutorial not to copy files other than doing that from ''inside FCP'' - In this case, I recognize I did the backup manually outside of FCP... But yet: this is aimed to be a backup of Events (not yet linked to a project).  I can foresee it could become a nightmare once events will be linked to a project...
    What would be the ''best practice'' in what I aim to do (2 objectives above ?)
    Thanks,
    Rob

    However, the idea of a backup here is not to ''use'' the backup to edit/finalize, so I don't think USB2 will make any difference (except taking longer to backup/re-import.  I just returned a so-called Thunderbolt LaCie RuggedUSB3 that claimed to do 10GB/s but took over 5 minutes to transfer 12 GB !!... (Tried it at Apple Store and it took 3:06 minutes to transfer 30GB, which in my maths does ... 10GB per minute (I can afford a ''margin'' but... 60 times more sounds to me like ... a **very big** margin. So I did not judge the drive worths $200 to gibe me a TB storage at that speed when I can get a USB drive at a fraction of that price. (Just my statement of the day )
    You need to temper your expectations... no drive today can do 10GB/s - and even 10GB a minute may be only theoretical. Plus, remember that many factors may be involved. The bottleneck may be in the processor, the bus and, of course, your internal drive. A Ferrari stalled in rush hour traffic goes as fast as the next car...
    A regular hard drive in a USB3 box is mor likely to be limited in throughput by the drive itself, not the connection; but with USB2, it's the other way around: the connection is slower than the drive.

  • Travelling with access to no external drive - show what's available now

    Ok this is kinda like another unanswered post I have.
    If I am travelling with my MB and want to listen to my music in itunes it still shows my entire library which is 80% not available because its on an external drive at home.
    How do I get itunes to only show what is available on the laptops internal drive?

    Good stuff.  Thanks.  Agree in principle re: "TBolt for displays; USB3 for storage".
    I did get a USB 3 hub.  (Amazon link.  There is a 7-port hub as well.)  Highly recommended (at least for rMBP users).  This works well with how I use Aperture: I have several external drives with mostly Referenced Originals and some Libraries.  Since I rarely use more than one of these at a time, it doesn't matter that the hub throughput is limited to a single USB 3 channel.  The USB 3 hub, for me, functions as a quasi-data-server for Aperture, and takes up only one of the two USB 3 ports on the rMBP.  (Fwiw, with the rMBA I don't think there's much reason for storing Referenced Originals on a fast drive; because of the efficiency of the way Aperture caches, USB 2 may be fast enough.  I haven't measured this yet.)
    I mentioned eSATA only because almost all my external drives came with eSATA ports and cables.  I have never used eSATA.  At this point, I don't plan to.
    I have moved a few drives into USB 3 enclosures (purchased from OWC).  With the USB 3 hub, and the newly-available Apple TBolt-FW800 adapter (which supports daisy-chained FW devices), I am no longer in any practical way limited by the four ports on the rMBP (2x TBolt, 2x USB 3).  Whew. 
    I backup my system drive wirelessly to a Time Capsule every night (by design, the machine doesn't have access to the TC during the day when I'm working), and use SuperDuper to backup all Libraries and Referenced Originals to specific sparse bundles kept on leap-frogging external drives, with one always off-site.  At this point I make no practical distinction between FW800 and USB 3 drives for back-up, as they are all fast enough and the back-ups run unattended.  (But USB 3 seems to be much faster.) 

  • External drives copying slow

    Both of my external drives have been copying at a snail's pace. My computer hasn't shown any other issues.
    Both manually uploading files and the automatic Time Machine backups both take forever. They appear to be copying, but at an incredibly slow rate (20mb / hour). In fact, Time Machine hasn't been able to complete a backup since I erased/reformatted the drive last week. I've tried excluding Time Machine from Spotlight indexing.
    Please let me know if you need more information. Any guidance would be much appreciated! My rig details are below:
    COMPUTER
    MacBook Pro
    - OSX: 10.9.1 (Maverick)
    - Processor: 2.66 GHz Intel Core i7
    - Memory: 4 GB 1067 MHz DDR3
    DRIVES
    1. Western Digital MyBook (3TB - 3.0 usb)
    - Mac OS Extended (Journaled)
    2. Western Digital MyBookLive (3TB - ethernet)
    - Mac OS Extended (Journaled)

    I have a similar problem. I have a late 2013 MacBook Pro 13 inch with 8GB RAM and 256GB SSD. OS X Mavericks version 10.9.4 installed.
    I am writing an ISO file to a USB flash drive using the dd command in a terminal window. When doing this against a Supersonic Magnum 12GB USB 3 flash drive I achieve around 800 KB/sec. System information confirms that the Magnum is connected at 5Gbit/sec. When monitoring the throughput with iostat I see this:
        4.00 559  2.18
        4.00 556  2.17
        4.00 556  2.17
        4.00 564  2.20
        4.00 560  2.19
        4.00 557  2.18
              disk2
        KB/t tps  MB/s
        4.00 568  2.22
        4.00 385  1.51
        4.00 311  1.22
        4.00 312  1.22
        4.00 291  1.14
        4.00 306  1.19
        4.00 273  1.07
        4.00 255  1.00
        4.00 246  0.96
        4.00 238  0.93
        4.00 230  0.90
        4.00 170  0.66
        4.00 209  0.82
        4.00 165  0.64
        4.00 147  0.57
        4.00 122  0.48
        4.00  97  0.38
        4.00 103  0.40
        4.00  63  0.25
        4.00  65  0.25
              disk2
        KB/t tps  MB/s
        4.00  50  0.20
        4.00  39  0.15
        4.00  31  0.12
    When doing the same to a SanDisk 16GB USB 2 flash drive I get around 2.4 MB/sec - about 3 times faster than the USB 3 Magnum drive...
    I am in the process of setting up a Windows 8.1 Boot Camp partition on the internal SSD. When finished I will test the same under Windows to see if it's better or worse.

  • External drive for main library

    I'm reading about external drives to find one to hold main Lightroom library. I want to be able to import and develop photos from either of 2 workstations: MacPro with 2 2.66GHz dual core Intel Xeon and iMac with 2.33 GHz Intel core 2 duo. I have other externals on each workstation for Library backups. And original nefs and dngs, master copy psds, and print ready tiifs are all burned to CDs or DVDs.
    Drive wouldn't need to be bus powered, but I can't find any with a second power adapter available. Doesn't need to be smaller than a paperback. Don't know enough about Raid or SATA drives yet, except that some photographers use them for this purpose. Main concern for me is that editing speed be close to what it is now on the internal drives.
    Will a Firewire 400 external at 72,000 rpm be close to same speed or is SATA faster and as reliable?
    Thank you.

    SATA is marginally faster. You have to determine where the bottlenecks are. For example, on my 1.8GHz Centrino notebook, running Lightroom, with my catalog database file on the notebook's drive, but the actual image files on a network hard drive (Gigabit network; 1000BaseT), it takes a second or two for a 12MB RAW (DNG) file to find its way from the network drive to my notebook, but many seconds for Lightroom to process it (for example, loading it into the Develop module, or performing the calculations for an export to local drive).
    An export to local drive can take ten seconds per 15Megapixel image. That's about 1.5 seconds of IO time reading from the network drive, and about 1 second write time to the local drive. That means there are 7.5 seconds spent in reading the database file, applying corrections, rendering the image in its export format, and other associated calculations.
    So I'm 25% IO bound, and 75% computationally bound (processor speed and RAM speed).
    This being the case, even if I doubled my network drive's performance, I would only improve my overall performance by 12.5%. If I doubled my computational power, I would improve my total performance by 37.5%.
    You may find that you are IO bound to a more significant degree. But even then, you're unlikely to notice an appreciable real world difference between Firewire400, USB2.0, and Gigabit networking. Yes, there are differences, but in the grand scheme of things, the difference between them in real world total throughput is not enough to make a huge difference to your Lightroom performance.

Maybe you are looking for