Faster copy over network? [Solved] Use Linux!

I'm wondering if there is a different way to copy files over a network that would be faster.
I'm running an updated version of ArchLinux, no gui, just command line.
I have samba working to see windows shares and have mounted a share.
I use "cp" to copy a file from the win98 share to my local harddrive.  The file is about 670 megs. Every thing works great.
It takes 5 min 40 seconds to copy. 
When I copy the same file using "copy" from a win98 computer it's done in just under 4 min.
Any suggestions?
smbmount //comp_lab_server/admin /mnt/winshare
cp /mnt/winshare/images/admin.zip /mnt/localdrive/admin.zip

jerem wrote:If I correctly understood what you exactly did, I would **guess** that :
Yes, not real clear, I wrote this real fast before running out the door...
jerem wrote:
* using cp : the copy uses the smbfs module in the kernel to retrieve the file from the win98 server.
* using copy : well, linux running samba is known to be generally faster than native windows services...
  generally faster... that's what I was looking for, but it just seams quite a bit slower
jerem wrote:
The two methods have different results because the copy goes through different processes, different layers, on different systems.
Using smbfs apparently involves some overhead(given your figures).
ok, that helps, I was just making sure I wasn't missing some other great tool that was known to copy files faster.
jerem wrote:Disks could also have different I/O speeds...
nope, same computers (dual booting), same disks..
Thanks for you help!
Rick

Similar Messages

  • Missing files when copying over network

    I've had a good search for people with similar problems on Discussions, and there are a few mentions of similar occurences. Here's my summary though.
    I have 2 Macs, and frequently transfer files from one to the other by sharing drives and using the Finder.
    However, quite often, when transferring lots of files, they are sucessfully copied but do not show in Finder on the receiving machine. The files are there (using Terminal to explore the directory reveals the files in question), but Finder just doesn't acknowledge any existence of the "missing" files.
    This problem can usually be cured by creating a new folder in one of the affected folders - this somehow kicks Finder into refreshing the folder's contents.
    Removing the .DS_Store file(s) (again, via Terminal) in the copied folder also resolves this issue, leading me to believe that the problem lies with the .DS_Store files.
    I cannot believe I am not the only user who frequently finds themselves having to do uneccesary Terminal work to reveal files which appear to be missing after copy over the network.
    Is Apple aware of this problem? Does anyone else have any workarounds?

    I don't think I have experienced that exact problem however, I am such a Unix geek, I typically do my in-network transfers between Mac machines using SCP at the shell prompt in Terminal.
    Finder refresh on the other hand I have experienced before although I cannot provide a situation or example.
    Usually if it needs a refresh, I believe all I ever do is navigate away from the folder, then back to it. Or if it is the Desktop in question, using Exposé to show it, a single click on an empty space there will make the newly copied items appear.
    Beavis2084

  • Finder freeze while copying over network

    i have two mac on a network at home, both are now with 10.4.11 - but ever since i updated to this system version i am having a problem with the laptop. whenever i copy a file over the network from the desktop to the laptop, the laptop's finder freezes for the duration of the transfer - i can't open other apps, can't access anything else. the status bar of the copy doesn't change. if another app is open before the copy starts, it works fine. mouse works fine.
    i can't figure out why this is happening... any clues?

    Same problem here, I think: Finder hangs (beachball & Not Resopnding in activity Monitor) during file copy then comes back when copy finishes. Hang starts when I click in the finder to view another directory on the remote machine. When copy is done on PowerBook via Airport, Finder hangs. 100 Mb/s ethernet stutters but does not hang up, but 10Mb/s hangs up.
    Same issue on this thread in Feb: http://discussions.apple.com/thread.jspa?messageID=6299419&#6299419
    Some things I've tried to no avail:
    Fixed Permissions.
    New user does the same.
    Reinstall 10.4.11.
    Etehrnet 100Mb/s - No freeze, but finder still jerky.
    Ethernet 10Mb/s and Airport 802.11g hang.
    Other mac, wireless to laptop - ok.
    Used file appleairports2.kext from 10.4.9, no help.
    Deleted Finder.plist, no help.
    Re-reinstall 10.4.11
    Tried airport with no security settings
    Trashed recent servers file.
    When airport is faster, finder works slightly better, clearing freeze occasionally.
    Activity monitor Finder not responding, sampling does not clear freeze.
    I think it is interesting that Finder does better with higher data transfer rates. In fact, the problem is evident on an ethernet connection when I slow it down to 10 Mb/s, OK at 100. So it may be purely a Finder problem.
    What I have not tried is going back to 10.4.9 nor a clean install of 10.4.11.
    Has anyone figured this one out yet?
    Thanks to UltraSoul for clear postings on this.

  • Comparison of number of bytes transferred over network while using HTTPService and RemoteObjects

    If I have to transfer data(say records of 100 employees in a DB) from Server to Client, I could use HTTPService and fetch the data as an XML file and then convert it to ArrayCollection in the Client. Or use RemoteObject and transfer the data in binary. Lets ignore other methods(Web Services etc) of data transfer for the moment.
    Now, for the same data, if I implement the application using HTTPService and RemoteObject, I notice that the number of bytes transferred over the network is less in case of HTTPService(XML) when compared to RemoteObject(AMF) which is a shock to me. My understanding is that AMF transfer should be more compact than XML. Ofcourse, once the data is available, RemoteObject result processing is noticeably faster than HTTPService result processing. My concern is why data transferred using AMF is larger than XML. As an example, you may refer to the samples provided in TourDeFlex. Refer to the following:
    HTTPService:
        Found in : Flex Data Access->HTTPService->BasicExample
        Link: http://www.adobe.com/devnet-archive/flex/tourdeflex/web/#docIndex=0;illustIndex=0;sampleId =12700
        Click on the 'Get Data' button to fetch the data.
        Bytes transferred - 1050
    RemoteObject:
        Found in : Flex Data Access->RemoteObject->BasicJavaRemoting
        Link: http://www.adobe.com/devnet-archive/flex/tourdeflex/web/#docIndex=0;illustIndex=0;sampleId =13300
        Click on the 'Get Data' button to fetch the data.
        Bytes transferred - 1440
    This is a significant size difference. You may see the data transfer size by using developer tools like the HTTPFox Firefox extension.
    Am I missing something here? Any help will be very much appreciated.
    Thanks,
    Balu

    There is definitely problem with your tool or you looked at something else. Please check the attached snapshots of the session using charles capture tool. The response sizes are way bigger than what you mentioned but remoteobjects is almost half of httpservice for the complete transfer including request and response. Check below -
    httpservice -
    http://tinypic.com/view.php?pic=2q2le2e&s=7
    amf -
    http://tinypic.com/r/10wmx4o/7

  • Slow copying over network

    I seem to have a major issue here. I upgraded to Leopard today using a fresh install on a wiped hard drive (I prefer it this way - I'm old fashioned ). Everything is going OK, apart from a few hiccups. One of those is to do with copying files off a network server.
    I backed up all my files from my Mac Pro (totaling around 80GB) to my NAS Server (until now very reliable FreeNAS x86 box) over 100MBit Ethernet. In TIGER everything wokred dandy in both directions and the server worked fine. In Leopard it's a different story.
    Over either NFS or SMB connections browsing a folder is ice-age slow, and often folder displays just fail to finish drawing. I've locked the Finder solid at least twice doing this (a feat considering AutoFS is supposed to stop it happening!). When I try to copy a folder of files it takes a very long time to collect up the files it needs, pausing often for several seconds every so often during the operation, then it starts to copy at a very slow rate, something like less than 2MB/s. It keeps pausing when it's copying and has on several occasions stopped altogether and the share has spontaneously disconnected and timed out. Copying has also locked the Finder solid on one occasion, and on several others I couldn't get the 'Copying' dialog to close at all.
    Using AFP the connection is stable and works fine, browsing is instant, when you go to copy counting up the files still has a few sub-1 sec pauses, but copying is still ice-age slow. As a rough idea it's still sub-3MB/s.
    This is a huge issue for me as I have all my data on the server and need to get i back in, ut every time I try to copy something I have to leave it for hours. As a good gauge, a 20GB pile of movies took about 5 hours to copy. According to my math it should have taken less than an hour. A 100MBit LAN connection should, in ideal circumstances, be shifting over 20GB of data an hour on a continuous copy operation. Mine barely manages 4-5GB.
    I tried pinging the server and got a 0.2-0.3 ms response. I don't get any horrific packet loss (non at all in fact). Nothing has changed on the network since I backed up from Tiger. Again, I've been using the Mac Pro with this server and 10.4 for months copying to and from and it's been faultless.
    Extremely frustrated. Hope someone can help!

    After installation of Leopard I did have a lot of problems with reduced speed transferring files to and from other Macs on my network as well as to and from my Airport disk. All the way down to 0.5 MB/sec
    Leopard sets AppleTalk to be active as default. Turn off AppleTalk in network setup and you will hopefully see a significant increase in speed on file transfers. I am back to 5-7 MB/sec to and from my Airport disk, which is okay.
    Karsten

  • Using a disc over network to use for Time Machine?

    I've been using an external HD as my disc image for Time Machine. Recently, both of my USB ports failed due to a juggling accident with cables connected to the ports. I'd like to send my computer for repair, but'd feel safer if I could backup before that.
    Through file sharing and an ethernet cable I'm connecting to my old mac and can see the my HD for Time Machine, but how do I configure Time Machine to use that disc?

    If you are connected to the other Mac via network, you should be able to see the external hard drive on that Mac.
    Take a look at Pondini's Time Machine FAQ: http://pondini.org/TM/22.html

  • Transferring file over network? what can I use besides ssh?

    What can I use to transfer file over network besides using ssh?
    This is only for experimental purposes. I have used ssh before, by using command like this:
    (time cat /run/shm/test/input/totalInput.tar | ssh username@ip-server "cat > /dev/null") 2>>/run/shm/test/p3_UC_ctime_tar.txt
    or this, if I tried to compress a file and then transfer:
    (time bzip2 -kfc1 /run/shm/test/input/totalInput.tar | ssh username@ip-server "cat > /dev/null") 2>>/run/shm/test/p3_ctime_tar.txt
    However, I think ssh is killing my transfer speed. I am getting only 10-20Mbps.. Router should support over 200-300Mbps.
    What can I use besides ssh? I was thinking about netcat, but what I don't like is that I have to open port on the other side for each new file transfer.

    Well, what I am conserned with things like scp and ssh (I tried scp too) is encryption.
    I just moved one file over to a server with scp, and I got about 2.1MB/s... which is about 16.8 Mbps..
    I am using Linksys E900, which is wireless-N router. Connection exist between two computers only, nothing else is using that router. However, there is another wireless point outside of our room, which is used for public University network. I don't know how much of effect it would have on our set up.
    Both computers have plenty of disk space. One computer (actually development board) uses sd-card for its OS and other disk space.
    About 200-300Mbps.. is just something I saw on router's specs.
    Last edited by kdar (2012-08-19 03:22:28)

  • "Movement type 123 is not planned (Entry is not copied over)".

    Dear All,
    While executing Movement Type 123, for reversal of a vendor return i get an error message "Movement type 123 is not planned (Entry is not copied over)".
    Transaction used : MIGO
                                   Goods Receipt  | Purchase Order | Movement Type 123
    Any specific reason as to why the system is not allowing me to execute the movement. And what is the procedure to overcome this error.
    Shall await your reply
    Thanks
    Shabeen Buhary

    dear shabenn 
    It is absolutely true, you can perform 123 movement i .e. cancellation of return delivery only through reversal procedure of movement type 122.
    If you are trying to do MIGO for 123 movement, the system supposed to throw out same error.
    If you returned a goods receipt using movement type 122, you can reverse the return delivery using movement type 123. This movement type has the same effects as movement type 101.
    Please revert back if any query still exist...
    Rahul

  • I have a windows vista pc and want to use migration assistant to copy files over. From what I understand, it will copy over my user profile and settings as well. Is there anyway to just copy files?

    Hey everyone, I just bought a new macbook pro 13-inch (late 2011 model) and I want to use migration assistant to copy over my photos, iTunes library, documents, etc. I know this can be done wirelessly or by connecting the two computers by Ethernet cable (windows vista pc --> macbook pro). Which is faster?
    I also have heard that using migration assistant copies over the user file as well and makes it the new one on the mac. I would only like to copy over files, not user settings. How do I do this?
    Thanks!
    P.S. I'm assuming that when my iTunes library is copied, the mp3 files are copied too. Could someone please confirm this?

    http://www.apple.com/support/switch101/
    http://www.macworld.com/article/153952/2010/09/superguide_switchingtoamac.html?l src=nl_mwweek_h_cbstories

  • Can't copy files to network share using migrated account

    Man this is so bizarre. I got a new MacBook Pro and used the Migration Assistant to copy over everything from the old MacBook Pro. Everything seems to work except I can't copy files to my desktop via a network share.
    What's totally bizarre about this is that I can delete and rename files from the network share! I can also drop into the command line and try copying - at first, I get "Operation not permitted", but if execute the command again, it works!
    In the Finder, when I try to copy a file, I get a window that says:
    "You may need to enter the name and password for an administrator on this computer to change the item named "xxx". If I click stop at this point, a zero-byte file is created on the target machine.
    If I click Continue, I get another window that says "The item "xxx" contains one or more items you do not have permissions to read. Do you want to copy the items you are allowed to read?
    If I click Continue, I get a final window that says "The operation cannot be completed because you do not have sufficient privileges for some of the items".
    Note that this also happens in the opposite direction when I connect to my notebook from my desktop.
    Also note that this only happens with the account that was migrated. I can successfully copy files if I setup a new account.
    I've repaired permission on both machines. My old account on the old MacBook Pro still works fine, btw.
    I've seen other posts with people having this problem, but I've yet to see a good solution.

    I had the same problem, but I managed to fix it.
    In WGM check that the sharepoint of your users Home Folder is set to owner root with Read and Write permissions.
    I also created an ard_admin group in WGM and enabled open directory management on the client Macs. (Page 62 of the ARD admin Guide.)

  • Urgent help:send image over network using rmi

    hi all,
    i have few question about send image using rmi.
    1) should i use ByteArrayOutputStream to convert image into byte array before i send over network or just use fileinputstream to convert image into byte array like what i have done as below?
    public class RemoteServerImpl  extends UnicastRemoteObject implements RemoteServer
      public RemoteServerImpl() throws RemoteException
      public byte[] getimage() throws RemoteException
        try{
           // capture the whole screen
           BufferedImage screencapture = new Robot().createScreenCapture(new     Rectangle(Toolkit.getDefaultToolkit().getScreenSize()) );
           // Save as JPEG
           File file = new File("screencapture.jpg");
           ImageIO.write(screencapture, "jpg", file);
            byte[] fileByteContent = null;
           fileByteContent = getImageStream("screencapture.jpg");
           return fileByteContent;
        catch(IOException ex)
      public byte[] getImageStream(String fname) // local method
        String fileName = fname;
        FileInputStream fileInputStream = null;
        byte[] fileByteContent = null;
          try
            int count = 0;
            fileInputStream = new FileInputStream(fileName);  // Obtains input bytes from a file.
            fileByteContent = new byte[fileInputStream.available()]; // Assign size to byte array.
            while (fileInputStream.available()>0)   // Correcting file content bytes, and put them into the byte array.
               fileByteContent[count]=(byte)fileInputStream.read();
               count++;
           catch (IOException fnfe)
         return fileByteContent;           
    }2)if what i done is wrong,can somebody give me guide?else if correct ,then how can i rebuild the image from the byte array and put it in a JLable?i now must use FileOuputStream but how?can anyone answer me or simple code?
    thanks in advance..

    Hi! well a had the same problem sending an image trough RMI.. To solve this i just read the image file into a byte Array and send the array to the client, and then the client creates an imegeIcon from the byte Array containing the image.. Below is the example function ton read the file to a byte Array (on the server) and the function to convert it to a an imageIcon (on the client).
    //      Returns the contents of the file in a byte array.
        public static byte[] getBytesFromFile(File file) throws IOException {
            InputStream is = new FileInputStream(file);
            // Get the size of the file
            long length = file.length();
            // You cannot create an array using a long type.
            // It needs to be an int type.
            // Before converting to an int type, check
            // to ensure that file is not larger than Integer.MAX_VALUE.
            if (length > Integer.MAX_VALUE) {
                // File is too large
            // Create the byte array to hold the data
            byte[] bytes = new byte[(int)length];
            // Read in the bytes
            int offset = 0;
            int numRead = 0;
            while (offset < bytes.length
                   && (numRead=is.read(bytes, offset, bytes.length-offset)) >= 0) {
                offset += numRead;
            // Ensure all the bytes have been read in
            if (offset < bytes.length) {
                throw new IOException("Could not completely read file "+file.getName());
            // Close the input stream and return bytes
            is.close();
            return bytes;
        }to use this function simply use something like this
    public byte[] getImage(){
    byte[] imageData;
              File file = new File("pic.jpg");
              // Change pic.jpg for the name of your file (duh)
              try{
                   imageData = getBytesFromFile(file);
                   // Send to client via RMI
                            return imageData;
              }catch(IOException ioe){
                           // Handle exception
                           return null; // or whatever you want..
    }and then on the client you could call a function like this
    public ImageIcon getImageFromServer(){
         try{
              // get the image from the RMI server
              byte[] imgBytes = myServerObject.getImage();
              // Create an imageIcon from the Array of bytes
              ImageIcon ii = new ImageIcon(imgBytes);
              return ii;
         }catch(Exception e){
              // Handle some error..
              // If yo get here probably something went wrong with the server
              // like File Not Found or something like that..
              e.printStackTrace();
              return null;
    }Hope it helps you..

  • My JPEGS are no longer being copied over to Finder.  Only a random fraction are copied.  It use to work perfect.  Is there a bug in the updated versions of iPhoto?

    My JPEGS are no longer being copied over to Finder.  Only a random fraction are copied.  It use to work perfect.  I can move them 4 or 5 at a time, but it is very time consuming.    Is there a bug in the updated versions of iPhoto?

    OK - here is what I've done in the past.  As I want to be able to save my photos on  a DVD that can be read by both a PC and a Mac, I am burning them in Finder.  I start by downloading into IPhoto.  I'll flag and edit the ones I want to print or post to the web.  After that I want to take all the keepers and move them from IPhoto to various files I create in the document  section of Finder.  I've done it both ways in the past, copy and paste or just drag over, all the files would transfer over.  Now there may be dozens of pictures that do not move over - very random, in one case there were only 6 photos and the 3 vertical ones did not copy over.
    I'm wondering if this is a software issue or if there is just too much data being moved around.  FYI there are 2 Nikon cameras I use and the files from both do this.
    Thanks

  • This item is over 20MB. You must connect to a wifi network or use iTunes on your computer to download it.

    Verizon wireless network - unlimited data plan.
    iPhone 4 - iOS 5.0
    "This item Is Over 20MB
    You must connect to a Wi-Fi
    network or use iTunes on your
       computer to download it."
    This message was given when trying to update an app I already had installed on the phone. My question is why? Is this a problem with the programming making you connect to the internet via link or Wi-Fi. Or is this a limitation on the Verizon network? Or perhaps a limitation set in place by Apple to prevent long downloads? So I came here hoping to get some hard cold facts. (since Verizon associates would not or simply could not help me)
    Personally I could care less if it took 6 hours to download an update. I do however have a problem paying a telephone service an insane rate to get "unlimited data" and not being able to receive unlimited data.
    Any help would be greatly appreciated.
    -Luna

    Telstra Australa
    I dont have Wifi in the countryside and theres no DSL, only 3G and 4G. why should I have to buy another 3G service when I already have one? This is one of the problems of globalisation, because AT&amp;T cant handle the volume, the whole world has to suffer.
    I pay per gigabyte, so dont need these restrictions Apple! Its mine to use.
    Daniel.

  • Problem with permissions when copying files over network

    This is my setup. Our design studio have several iMacs that the designers use for open projects, when they are finished I copy them over to a G4 which has a SATA raid in it which is used as a file-server for all closed jobs, photos and logos. The file-servers mount point was created using an app called 'Sharepoints'. The iMacs run 10.5.7 the G4 runs 10.4.11.
    When I try and copy over a folder full of folders/files for a given project into the given clients folder. I keep getting the error, "the operation cannot be completed because you do not have sufficient privileges for "filename".
    If I get info for the given file the owner, group and everyone have read & write access. The client folder on the file-server has the owner, group and everyone having read & write access. I can drag that file by itself over to the file-server and it will copy fine with out the error.
    This is doing my head in, the quickest way around the problem is to archive the folder, copy it over and then un-archive it.
    Can anyone shed any light on why this is happening and what I should to to fix the problem. Thanks

    Bump

  • Using CCC,what to copy over from itunes

    I have already copied over 200 GB of music via the drag,drop method to an EHD.  I now what to copy over just the recently added items using Carbon Copy Clone.  Do I just check the music folder?  It contains the following. DS store,localized.Amazon mp3 ,itunes, garage band. Is there another easier way anyone can recommend.  Thanks

    Ok so let me understand this correctly.  You want one EHD for iTunes and another for Backup?  If this is correct that yes I would use Time Machine.  Here is what I would suggest:
    1.  Create a folder in your ... lets call it iTunes EHD called iTunes
    2.  Drag the iTunes Media folder you already copied to the EHD into the iTunes folder you just created
    3.  From your internal HD copy (copy not move) the other contents of your iTunes folder into the iTunes folder on your EHD, stuff like the Album Artwork folder, iTunes Library file, iTunes Library.xml file etc.
    4.  Quit itunes, and relaunch holding down the alt/option button.
    5.  A dialog will appear asking you to choose a library.  You can either choose an existing one or create a new one, click "Choose Library"
    6.  Navigate to your iTunes folder on your EHD and click OK.  iTunes will launch and load your library
    Once you get your Backup EHD select it for time machine through Preferences --> Time Machine --> Select Disk
    Click on option and remove the iTunes EHD from the list so Time machine will back up that volume as well.
    Hope this helps

Maybe you are looking for