Unresponsive system when copying large files drive-to-drive (x86_64)

I'm running Arch x86_64 on a quad core Xeon processor/P35 motherboard w/ 4 gigs of RAM.  I also have two SATAII, 7200 RPM HDDs.  For the most part, Arch is a VERY responsive platform.  I am noticing some really odd unresponsiveness that only happens when I copy large files from one hdd to another hdd.
Symptoms:
-Mouse cursor skips (doesn't move smoothly)
-Windows such as firefox or shell don't move smoothly across the screen if I move them
-Keyboard lag - as I type this post ) my fingers are going faster than the text is appearing
Once the copy is finished, everything is normal again.  I swear I read someone else reporting this behavior, I just can't find it. Two questions:
1) Is normal for the x86_64 kernel?
2) If not, what can I tweak to remedy it?
EDIT: Ack!  Found the post I remembered reading:
http://bbs.archlinux.org/viewtopic.php?id=70525
Last edited by graysky (2009-07-04 10:51:35)

if the file is bigger than 4gig(uncompressed) then u need swap partition, as the first thing it does is copy the file to memory and if it overflows it is bad. then your server is 1/3 options, either server/middle/desktop. if it is server, it doesn't care what framerate u get on X. then there is the timer. I'm running mine at 300 but arch's default should be 1000. the higher it is the more it "checks" what needs to be done with files, events, etc. then there is the file system type and block size factor. if ur block size is really low like me(1024k) then ur hd has to write more times(on and off) just to write out the huge file. so for huge files, format with huge block size(4096k?) so that the hd does less work.
Last edited by darthaxul (2009-07-04 19:49:07)

Similar Messages

  • Error message -36 when copying large  files from Firewire drive

    I have kept several large audio files as backup on an external LaCie Firewire drive. When trying to copying them back, almost all of them starts to copy, then stops and (after a minute or so) report error message -36.
    I have run both Apple's Disktools and the latest Diskwarrior, but no errors are reported. I gues the audio files must have become corrupted... What do you suggest that I do? The contain valuable audio information that I really don't want to get lost.
    Helge K.

    Not helping but others are having the same problem...
    http://discussions.apple.com/thread.jspa?messageID=2564624

  • TC and WD500 External drive - Locks up when copying large files

    I have a TC with a Western Digital 500GB my Book connected to the USB port on the TC that I use for network Storage. Everything works fine until I try to copy large files or directories from the Finder mounted share. After the copy freezes the external drive can no longer be seen by airport utility. If I look at disks it sees the disk but no partition. I have to power cycle the external drive to have TC see the drive again. Then I disconnect the drive and plug it in directly to the MAC and run disk utility and his repairs the journal. I have to do the repair every time it locks up. Should the external drive be formatted different or does it have to be connected to a USB hub. Or is this just a bug with the TC and afp ?

    I have this very same problem.
    I tried to copy a 4GB+ folder from the Macbook to the 500GB MyBook attached to my TC and it froze.
    Now the the files on the MyBook are invisible when attached to the TC ("0 Items") but are available when the drive is connected directly to the Macbook. I have run disk utility but it hasn't helped. The disk is FAT 32 formatted and the files on the MyBook are still invisible over the network.
    When the drive attached to the Macbook directly I can see a 'phantom' file with the same title as the 4GB+ folder I'd tried to copy. This file is "ZERO KB" and it cannot be deleted (error code -43).
    Anyone have a clue what is happening here?

  • Copying hangs when copying large files from DVD

    I'm having trouble copying large files (>2GB) from DVDs to my built-in hard drive. When I drag the file icon from the DVD window to the desktop, the progress bar pops up almost immediately, and says "0 KB of 2.3 GB copied" and "Estimated time left: 1 minute" -- and then it just sits there, doing nothing. In some cases, after five minutes or so of inactivity, the copy finally begins... but most of the time it never does. Force-Quit doesn't help; the only way out is to do an emergency restart and try again.
    This problem began when I upgraded to Tiger, and several members of my office group have been experiencing the same problem on their own computers as well.
    I've poked around the forum looking for answers but the only thing I could find that looked related was a conflict between iSight and some third-party external hard drives... but none of us have iSight, and none of us are using third-party external drives, so clearly that's not the issue we'rehaving.
    Any help out there?
    iBook G4   Mac OS X (10.4.6)  

    Michael, I occasionally notice anomolous behaviour when files get dragged between volumes. Mostly the copying window shows an accurate and immediate indication of what's going on, but other times it just looks like nothing's happening, the display never changes, yet, it is in fact copying the files over. Now, if you're copying 2gb files from DVD to HD, it's gonna take some time, more than 5 minutes, so I'm wondering how long you've left it before forcing it to quit?

  • Error code -36 when copying large file

    Aperture (Apple's pro photo software) stores all of it's data (pictures, metadata, etc) in what appears to be a large file called the Library. In fact, it's a large folder with all of the contents hidden so you don't mess around with it. I back this file up periodically to both an internal and external drive. After a hard drive failure and recreating my whole machine, everything seemed fine and Aperture is working normally. I have tried to drag copy my Aperture Library (rebuilt from my Aperture vault, a back up file created by Aperture) file to my internal second drive, a process that takes about 2 hours (300 Gb). The drive I'm copying to has over 451 GB available and was freshly formatted during this rebuild process. A little more that half way through the drag copy I get the following message.
    "The Finder cannot complete the operation because some data in “Aperture Library” could not be read or written, (Error code -36)"
    Here's what I've done to so far.
    1. Aperture has a function to repair permissions and rebuild the file, done both several times.
    2. I found (by looking at all 20,000 plus pictures) some corrupt picture files and deleted them, then repeted step one.
    3. Tried a duplicate file on the same drive, same error.
    Thoughts? Help? I can't find anything on a Mac OS error -36.
    By the way, I'm running Mac OS 10.5.8 and Aperture 2.1.4 on a Quad Core G5.

    This what it means:
    Type -36 error (I/O Errors (bummers)
    This file is having difficulty while either reading from the drive or writing to the drive. The file
    may have been improperly written data to the drive or the hard drive or disk may be damaged.
    This is almost always indicative of a media error (hard error on the disk). Sometimes (rarely) it is transient.
    Solutions: Try copying the file to another drive. Use a disk recovery software, such as Disk First Aid to examine the disk. You can try rebooting with all extensions off. Once in a while this will allow you to read the data. The file in question should be restored from a backup that was stored on a different disk. Regular backups can reduce the time to recover from this error.

  • Error code 8084 when copying large files from VNX servers

    Hi,
    We are experiencing problems when attempting to copy large files from our central VNX servers (EMC) using the connection format of smb://<host>/.  With Mavericks this will be SMB2, presumably.  Anything over a few MB in size fails with the error:
    The operation can’t be completed because an unexpected error occurred (error code -8084)
    Looking in the Console logs we see the following:
    kernel[0]: smb2_smb_read_write_fill: len got reduced, must be running low on credits
    If we attempt this on OS X Mountain Lion or below we have no problems.
    If, with Mavericks, we connect using the format cifs://<host>/ then file transfers work.
    Has anyone come across this before?  Thinking I should also post a bug...
    Cheers,
    Ian
    IT Infrastructure, Open University, UK

    Not helping but others are having the same problem...
    http://discussions.apple.com/thread.jspa?messageID=2564624

  • Can't copy large file to FW drive

    I'm not sure who to ask, but when I try to copy a 7gb file to an external Lacie FW drive I keep getting Error Code 1309. I've copied the file to another drive successfully, but wonder why I can't and what the Error Code means.
    Is there anything I can do besides reformat the drive? If not, and I must reformat shouldn't it be as HFS+?

    I assume your external drive is formatted FAT32, so it can be read by both a Mac & PC. However, FAT32 has a limitation of 4GB files due to the fact that 4GB is the largest 32-bit number, and the length of the file in the directory entry is 32-bits.
     Cheers, Tom

  • Can't Copy Large Files To External Drive

    This is driving me nuts. I'm running 10.4.11 with an external Newer Tech Ministack 320GB hard drive that's only ten weeks old. Yesterday I downloaded some large (50mb or so) QuickTime files to my desktop, which is to say my internal drive. I then tried to copy them to my external drive, since that's where I keep my movie files since they take up so much room. One copied over without any trouble, but numerous attempts to copy the others result in the process freezing after anywhere from 1/4 to 3/4 of the data has been copied, or else I get the "error 36" message. My first thought was that the external drive was failing, but I can copy small movie files (10mb or so) back and forth between the two drives with no problem. What's the point of having a large external drive if you can't use it for your large files? Repaired permissions on both drives, no improvement.

    I have repaired permissions and run disk repair on the internal drive as well. Yes, I've played the clips in their entirety, but I'm going to do it again and look for any hiccups. That's an interesting theory and I want to check it out.
    It has occurred to me that a workaround, although it by no means addresses the underlying problem, is to use QuickTime Pro to chop the clips up into several smaller files, copy them to the external drive, and then reassemble them via QuickTime Pro on the external drive.
    FWIW, I neglected to mention (although I don't know if it's pertinent or not) that immediately after installing the external drive ten weeks ago I used SuperDuper to clone my entire internal drive onto the external firewire drive. I then erased the movies from the internal drive, which was bumping up against maximum capacity. I am able to boot from the external drive, and I want to retain this capacity should the internal drive (which is, after all, six and a half years old) fail.

  • OS X 10.4.7 server: Samba leaking ram when copying large files from windows

    Hi.
    I'm having problems with:
    Copying files from windows clients to OS X Server 10.4.7 uses up the RAM needed for the files to be copied.
    If I copy a 3GB file, it uses 3GB of RAM
    If I copy a 5GB file, it uses its 4GB of RAM, plus VM.
    If I copy 11GB of files (that is several little files, plus some big by dropping a folder to the share), it consumes all the RAM the machine has, and because of VM paging, whatever other clients are reading from the disk (XRaid) start to have hiccups.
    The RAM of the machine NEVER gets flushed after the copying has finished. So Samba is unusable as it is. I have four Xserves with 4GB of RAM, with 4 XRaids connected each one to each Xserve with its Apple Fiber Channel card and cables.
    I already did the ack=0 thing, got the size of inet.tcp.sendspace and rcvspace to 8388608 and the buffer to 16777216.
    The transfers rates are up to 70MB/s with 2 channel 1gb trunking, and at very sustained rates..
    We are using these to edit video content (DV 25) in Sony Vegas with 2 or 3 clients for each server.
    Any suggestions?
    Thanks very much.
    XServe G5 cluster node (4) / XRaid 7TB (4)   Mac OS X (10.4.7)  

    Michael, I occasionally notice anomolous behaviour when files get dragged between volumes. Mostly the copying window shows an accurate and immediate indication of what's going on, but other times it just looks like nothing's happening, the display never changes, yet, it is in fact copying the files over. Now, if you're copying 2gb files from DVD to HD, it's gonna take some time, more than 5 minutes, so I'm wondering how long you've left it before forcing it to quit?

  • Airport Network goes down when copying large files to USB network drive

    My apologies if this has been covered before. This is my first post and I am new to the forums.
    For several months my wife and I have been using the Airport Extreme 802.11n (Gigabit Ethernet). I use Windows and she uses Leopard. We recently purchased a Western Digital MFL Pro (500GB). If the external drive is connected directly to my PC via USB I can copy to it without any problem. If the external drive is connected to the Airport via USB then if you copy files (generally) over 2GB it takes the whole network down. At that point we have to unplug the Airport wait a few seconds and then plug it back in. It's frustrating because the drive works when connected directly, but not when it's connected to the Airport.
    Also, I am hardwired to the Airport (Ethernet) so it is not a wifi issue. Our firmware version is 7.2.1 which is the latest, plus I also updated the software that runs under Windows (5.3.1).
    Does anyone know what is happening here? Is this a known issue? Is there a work around or fix available?

    I've also experienced this problem with my AEBS and an Iomega 500GB MiniMax drive. My Iomega Drive was formatted for HFS+ from the beginning and I've had no problems accessing it from both my Mac and my Windows PC.
    I've been monitoring these groups for signs of a solution, I've talked to the geniuses at one of the Apple Stores near me and so far there's no sign of a resolution. I've sent in feedback to Apple but had no response to it so far (don't know if that's usual).
    The only suggestion that has been put forward so far is to take my AEBS, Iomega Hard drive and laptop to an Apple Store and demonstrate the problems there in the hope that a solution can be reached.
    I've since purchased a 500GB Time Capsule but haven't had a chance to do the same test on that yet, but as far as Time Machine backups go its worked flawlessly so far (touch wood).
    Regards,
    Jason
    Message was edited by: jbroomfi

  • Time Capsule WiFi stops when copying large files to Windows 7 (Bootcamp) using WiFi

    I've got a new Time Capsule (Purchased less than a month ago) and a new Macbook Pro.
    I copied a large set of files (large in QTY & some Large in size > 2GB) to my Time Capsule from a Windows 7 computure via a Wired connection.
    When I access the time capsule from Mac OS X (10.8.2) I can copy all of the existing files to my Mac without any issue (Time machine also seems to be working fine).
    However when use I Bootcamp (Windows 7 Ultimate) from my MacBook (The Time Capsule / Airport software for windows has been installed) I can only copy about 100 MB before the WiFi in the time capsule stops working. The WiFi doesn't just stop working for Windows, it stops working on the actual Time Capsule; I can tell because my phone and iPad both lose their connection and the AirPort Utility on the iPad can't detect the Time Capsule any more.
    The issue is reproducable every time with the set of files I am trying to copy.
    I've called Apple Support and they said there was nothing they can do to help (It took a long time to even convince some one that this is a supported configuration even though the Technical Specifications of the time capsule clearly state that Windows 7 is supported - http://www.apple.com/timecapsule/specs.html "For AirPort Disk with a USB hard drive - PC with Windows XP (SP3), Windows Vista (SP2), or Windows 7 (SP1)")  at which point they told me to take it to a Genius bar. I've subsequently done that and been told that they will not support the Time Capsule because I am trying to connect to it using Bootcamp.
    From what I've seen on this forum some people previously had this issue and worked around it by downgrading the firmware. However, since my Time Capsule is new, I am unable to downgrade the firm ware (& it is the latest).
    Any suggestions?

    No, it's not a Windows driver issue. 1) If it was a Windows driver issue the network copy would drop out on the Windows machine or fail rather than the whole Time Capsule losing WiFi connectivity for all devices in my house. 2) I am able to copy the exact same set of files, via the Time Capsule WiFi, when the files are stored on my PC which is plugged in to the Time Capsule via an Ethernet cable.
    It's not a problem copying the same files from another location on my network with the MBP in Bootcamp therefore it' not a windows driver issue and it's not a network IP issue. It's a Firmware issue with the Time Capsule.
    At best this is a bug that has been reintroduced in the latest firmware which is why the suggestions have been to downgrade the firm ware.
    At worst this is a major security issue with the Time Capsule as copying a set of files from it's hard disk via it's WiFi, using a Windows computer, cause the Time Capsule to be subseptiable and result in a Denial-of-Service.

  • Copying large files hangs at "less than a minute"

    hi,
    When copying large files around my intel mac mini system the Finder appears to freeze just before the end - when the dialog window is telling me that there's "less than a minute" left. It doesn't happen ALL the time, just enough times to be a real nuisance.
    Killing the finder doesn't help - I need to power off to regain control of the Finder.
    This recently started to happen after I opened up the mac mini to add more memory. Not sure if this is related - everything else seems to be ok. I have a mixture of USB and Firewire external drives - the mac mini is used to hold all my HD camcorder files and process the iMovie rendering to disk.
    I'm running the latest version of os x with all the updates.
    Any suggestions?
    P
    Mac Intel Mini   Mac OS X (10.4.8)  

    Hi,
    Hello! It's likely a firmware issue with an external
    drive. Check the ext drive's site to see if there's a
    firmware upgrade. Tom
    Thanks for the reply Tom. I've downloaded a firmware updater from the Lacie site, and I'm apparently uptodate. However, I also have a USB Seagate external drive, but the Seagate site seems to only provide support for Windows. grr.
    Is this a known problem with certain drives/firmware?
    thanks,
    P
    Mac Intel Mini   Mac OS X (10.4.8)  

  • Finder issues when copying large amount of files to external drive

    When copying large amount of data over firewire 800, finder gives me an error that a file is in use and locks the drive up. I have to force eject. When I reopen the drive, there are a bunch of 0kb files sitting in the directory that did not get copied over. This is happens on multiple drives. I've attached a screen shot of what things look like when I reopen the drive after forcing an eject. Sometime I have to relaunch finder to get back up and running correctly. I've repaired permissions for what it's worth.
    10.6.8, by the way, 2.93 12-core, 48gb of ram, fully up to date. This has been happening for a long time, just now trying to find a solution

    Scott Oliphant wrote:
    iomega, lacie, 500GB, 1TB, etc, seems to be drive independent. I've formatted and started over with several of the drives and same thing. If I copy the files over in smaller chunks (say, 70GB) as opposed to 600GB, the problem does not happen. It's like finder is holding on to some of the info when it puts it's "ghost" on the destination drive before it's copied over and keeping the file locked when it tries to write over it.
    This may be a stretch since I have no experience with iomega and no recent experience with LaCie drives, but the different results if transfers are large or small may be a tip-off.
    I ran into something similar with Seagate GoFlex drives and the problem was heat. Virtually none of these drives are ventilated properly (i.e, no fans and not much, if any, air flow) and with extended use, they get really hot and start to generate errors. Seagate's solution is to shut the drive down when not actually in use, which doesn't always play nice with Macs. Your drives may use a different technique for temperature control, or maybe none at all. Relatively small data transfers will allow the drives to recover; very large transfers won't, and to make things worse, as the drive heats up, the transfer rate will often slow down because of the errors. That can be seen if you leave Activity Monitor open and watch the transfer rate over time (a method which Seagate tech support said was worthless because Activity Monitor was unreliable and GoFlex drives had no heat problem).
    If that's what's wrong, there really isn't any solution except using the smaller chunks of data which you've found works.

  • Using Windows 8.2 and copying large files over USB 3.0 to Segate Backup Plus USB hard drive - I get the following error:-

    Using Windows 8.1 and copying large files over USB 3.0 to Segate hard drive -  I get the following error:-
    Error 0x80070079: The semaphore timeout period has expired
     Using Windows 8.1 with a 3 - 4TB USB Segate drive that is using Microsoft's bitlocker.    It seems I can copy small files w/out issues; however, copying large files and directories causes this error.  Connectivity is USB 3.0 from a Dell
    Latitue3 e6520 to Segagate drive. 
    Can anyone share fix or determine methodology to fix?

    Hi Joe,
    Was the error gone when you turned off the Bitlocker from this drive?
    If no, please refer to this similar thread's solution to resolve:
    https://social.technet.microsoft.com/Forums/windows/en-US/c3fc9f5d-c073-4a9f-bb3d-b7bb8f893f78/error-0x80070079-the-semaphore-timeout-period-has-expired?forum=itprovistanetworking
    Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact [email protected]

  • The operation can't be completed because an unexped error occurred (error code-50).   This appears when I'm copying a file to the drive and then I wasn't able to edit to my drive.  Then this morning I can't open my project file.  What to do?

    Message: The operation can't be completed because an unexped error occurred (error code-50).
    This appears when I'm copying a file to the drive and then I wasn't able to edit to my drive.
    Then this morning I can't open my project file.  I get this message: The project appears to be damaged, it cannot be opened.
    What should I do!??
    I  have moved my project onto 2 different external hard-drives now.

    Hi There,
    After looking around for this error, it seems to be related to OS, we would recommend you to contact Apple support for this.
    Thanks,
    Atul Saini

Maybe you are looking for

  • How to create a back-up version of your helpsystem

    My institution is going through a conversion of our core systems in September of this year and I need to develop a process for updating the 700 helpfiles I have within my helpsystem.  Is there a way to create a mirror image of my helpsystem so that I

  • Problem parsing XML with schema when extracted from a jar file

    I am having a problem parsing XML with a schema, both of which are extracted from a jar file. I am using using ZipFile to get InputStream objects for the appropriate ZipEntry objects in the jar file. My XML is encrypted so I decrypt it to a temporary

  • Report Painter question (FGI1) How to limit output up to a specified period

    Hello I have a report painter question. I am trying to create a BS report using tcode FGI1 (FALGFLEXT), that lists out the BS values by month (Jan - Dec). But the problem I am coming across is, if I specify selection parameter 01 2008, the report als

  • Modifying an element in an array of objects - HELP!

    Hello - I would appreciate any help on this project I am working on for my beginning Java class. One of the requirements of my project are to update a string that I have already populated with a new balance, through an update balance method. I'm conf

  • Standard XML Diff Format

    Hi! I have a requirement for expressing the difference between two very large (XML) hierarchies in a (structured) format. XML would be a good fit here. Naturally I could design my own schema for expressing the difference information, but I started th