How to increase AFP data transfer speed?

When I connect to our server from a WAN source outside of our facility the file data transfer rate is extremely slow. We just upgraded to a 10Mps fiber service and that has dematically increased our website data tranfer speed. I would like to find a way to access the file server from remote location and work, but the data transfer rate makes productivity impossible. I would appreciate hearing how other organizations are set-up and functioning with file transfer sizes at an average of 10 to 15 Mb.
Thanks,
Brian
OS10.6.8 Server,

If you don't have enough network bandwidth for your time requirements, you have little chance of success with the direct approach.  Techniques such as file compression and such can only provide limited help.  If you're transfering multiple copies of the files, then you can push one copy of the file to a hosted provider, and then serve additional copies from there.
As for your network, a ten million bits per second network connection is the speed of first-generation Ethernet.  That Ethernet was a fast network, back in 1985.  In the era of a one billion bits per second Gigabit Ethernet and increasingly commonly with the ten gigabit Ethernet links, a 10 Mb link is glacial.
A typical DSL network is asymmetric, meaning you'll have 10 Mb down (theoretically) and some fraction of that up.  So you might not be getting that 10 Mb in the direction you're coppying files.  And this is best case; various of the ISP network links around aren't providing their rated speeds.
AFP stinks on a network, and you're also opening up your file system to remote attackers. 
As for WebDAV, read this.   In addition to WebDAV, you can also try an sftp or other "simpler" copy command as a test, and see what you get for that.  (sftp is also encrypted, which has benefits, though the encryption also requires more processing time.)
But beyond techniques such as data compression (and which may or may not be an option here) or incremental or "delta" changes to the data (which probably isn't an option here) or working locally and batching over the changes, there are few good ways to contend with a too-slow-for-your-needs link.

Similar Messages

  • Problems with Photoshop performance and data transfer speed on iMac

    Two months ago, I started noticing slow performances using Photoshop (above all using clone stamp tool) on my 27" iMac (late 2012). I did the AHT and I found that 8GB of 32GB RAM were broken.
    I removed them but the problem didn't disappered, I also noticed that data transfer speed (both copy and paste from/to internal HD and from CF card/external HD) was really slow.
    I tried many solutions suggested by Apple support, none of them worked out. At the end, I tried uninstalling and re-installing Photoshop: no more problems!!!
    10 days ago, I received a new 8GB RAM module and so I installed it back... suddenly, the problem came back, I tried re-installing again Photoshop but the problem, this time, still persist!
    Does anyone had the same experience? All other CC programs work well (LR, AE, Premiere...)

    yes, it does!
    what seems to be very strange to me is how data trasnfer speed could be affected!
    (just to say, I've already tried reset of SMC and PRAM, I've tried with different accounts and I've also re-installed the OS, next step would be formatting the disk and installing the OS from zero)

  • Internal Disk to Disk Data Transfer Speed Very Slow

    I have a G5 Xserve running Tiger with all updates applied that has recently started experiencing very slow Drive to Drive Data transfer speeds.
    When transferring data from one drive to another ( Internal to Internal, Internal to USB, Internal, Internal to FW, USB to USB or any other combination of the three ) we only are getting about 2GB / hr transfer speeds.
    I initially thought the internal drive was going bad. I tested the drive and found some minor header issues etc... that were able to be repaired so I replace the internal boot drive
    I tested and immediately got the same issue.
    I also tried booting from a FW drive and I got the same issue.
    If I connect to the server over the ethernet network, I get what I would expect to be typical data transfer rates of about 20GB+ / hr. Much higher than the internal rates and I am copying data from the same internal drives so I really don't think the drive is the issue.
    I called AppleCare and discussed the issue with them. They said it sounded like a controller issue so I purchased a replacement MLB from them. After replacing the drive data transfer speeds jumped back to normal for about a day maybe two.
    Now we are back to experiencing slow data transfer speeds internally ( 2GB / hr ) and normal transfer speeds ( 20GB+ / hr ) over the network.
    Any ideas on what might be causing the problem would be appreciated

    As suggested, do check for other I/O load on the spindles. And check for general system load.
    I don't know of a good GUI in-built I/O monitor here (and particularly for Tiger Server), though there is iopending and DTrace and Apple-provided [performance scripts|http://support.apple.com/kb/HT1992] with Leopard and Leopard Server. top would show you busy processes.
    Also look for memory errors and memory constraints and check for anything interesting in the contents of the system logs.
    The next spot after the controllers (and it's usually my first "hardware" stop for these sorts of cases, and usually before swapping the motherboard) are the disks that are involved, and whatever widgets are in the PCI slots. Loose cables, bad cables, and spindle-swaps. Yes, disks can sometimes slow down like this, and that's not usually a Good Thing. I know you think this isn't the disks, but that's one of the remaining common hardware factors. And don't presume any SMART disk monitoring has predictive value; SMART can miss a number of these cases.
    (Sometimes you have to use the classic "field service" technique of swapping parts and of shutting down software pieces until the problem goes away. Then work from there.)
    And the other question is around how much time and effort should be spent on this Xserve G5 box; whether you're now in the market for a replacement G5 box or a newer Intel Xserve box as a more cost-effective solution.
    (How current and how reliable is your disk archive?)

  • NI8451 SPI data transfer speed and SCLK setup time adjustment

    I'm using NI USB-8451 SPI bus to do communication. I can not reach the speed of communication 4MHz (NI USB-8451 module advertises speeds up to 12MHz). Actrually the data transfer speed is much slower than 4/8 Mb/s. The 16k*16bit data cost around 800ms while it should be 128ms if the data transfer achieves 4Mhz speed. In the manual there is a SPI timing clock figure like this:
     In the 4Mhz communication case,  the t2 should be 0.25us. I wonder whether the low data transfer speed is due to t1,t3 and t4 since they occupy too much "dead time". If my guess is right, is there any method to reduce the t1,t3 or t4, espetially t3? I know that in the advanced API there is a way to add delay while I did not figure out how to reduce delay(t3).  If my guess is wrong, what is the exactly maximum data transfer speed NI8451 can support? (not the clock rate)
     Thanks for help.

    Hi everyone. Im using the SPI communication with 8451 and Im having the same situation., since the serial flash memory I need to program is big enough, t3 (SCLK Setup time) and other "dead time" which I think is the time when buffer on the 8451 needs to be re-filled those are killing my expectation on the final results. I can't see a way to decrease t3 (~10uSec) and in the same way Im seeing something like buffering up to 100~110 bytes then, a ~1.5mSec delay appears on the signal waveforms. Did somebody have good results trying to avoid this?
    Thank you.
    Javier
    Attachments:
    t3 - SCLK setup time.jpg ‏156 KB
    Data byte Transfer_109.jpg ‏137 KB

  • NSS2000 - Data transfer speeds over gigabit ethernet

    I've just installed a NSS2000 on a gigabit network.  I'm aware that some of the promised features (like support for jumbo frames) are not currently supported by the current firmware (version 1.13).
    However, even without jumbo frames, I'm puzzled of why I am seeing data transfer speeds of only 50megabits per second, or about 5% utilization of the 1000Mb/s connection.  I was expecting at least 20% utilization.
    Is this another limitation of the current firmware version, or is there a setting somewhere on the NSS2000 which I need to to tweak to increase data transfer speeds?
    More background - it is the only significant traffic on the network during test, the ethernet controller driver on my PC is the latest available, and the NSS reports that it is connected at 1000MB/sec.  The unit has two 1.5Tb SATA drives in it, which are configuered as RAID1.
    Also - does anyone know when the next firmware version is going to be available, and which of the current known issues it is likely to address?
    thanks
    Graham

    I should mention that the volume I am writing to is encrypted - is the answer simply that this is the fastest that the onboard CPU can decrypt the content?
    An experiment to an unencrypted volume increased the LAN utilization to around 10% - so an improvement, but still not as high as I had hoped.
    thanks
    Graham

  • Very slow network directory listing - but fast data transfer speed once listed?

    Hello,
    I have really tried to sort this myself before opening up to the community, however I have run out of ideas, and hope someone can offer the magic solution I have missed.
    I am currently using the 3.4ghz i7 iMac on a 1GB LAN, running OSX10.7.2 - connecting to a Windows Server 2008 (Running Release 2) over ethernet.
    If i go to a network directory that i haven't recently accessed it can take up to 60 seconds to show the contents of that directory. Once i have accessed that folder, if i come out of it and go back in it will be instant again - but the first time it lists the directory it looks like i have opened an empty folder - which after anything from 10seconds to 1 minute will suddenly show the files that are there.
    Internet connectivity is fast through the network, and file transfers across the LAN are fast. (showing as approx 300mb per second) I can play and edit HD content across the network with no slowdown so I am confident that this issue is not related to the network speed itself, and is more to do with a setting on this mac.
    Symptoms are very similar to this post: https://discussions.apple.com/message/12245148?messageID=12245148&amp%3b#1224514 8 - however i understand that in OSX Lion - SMB was removed - so i cannot find this file to edit.
    I have tried bypassing additional hubs in the network by wiring direct cables to the switch that is connected to the file server, this made no difference.
    I have also tried disconnecting the ethernet cable, and running over wifi. This fixes the listing problem, but when editing HD content over a network drive, this connection is not fast enough to carry the data without interruption (some projects are linked to up to 900gb of hd video content!)
    Using ethernet, I have tried DHCP, DHCP with manual address, and manual mode. All reproduce this problem. i have tried using the windows workgroup, and tried without it.
    I have also followed this suggestion: https://discussions.apple.com/thread/2134936?threadID=2134936&tstart=45 and used OpenDNS. this did not fix the issue.
    For argument sake, I have also just tested a Macbook Pro running Snow Leopard to see if it was OS related. This reproduces the exact same problem, near instant directory listing on the wifi, a long and arduous wait on ethernet.
    I cannot work out why directory listing is instant over wifi, but not over ethernet on 2 different macs, running 2 different versions of OSX. I also do not understand why if the network is having trouble listing the directories - the data transfer speed is 300mbps when i copy files across the wired network from the file server to the mac.
    Does anyone have any other ideas as to what could be the problem here? We are about to start work on a very large project, where the content we are editing is spread out across around 200 different network folders (different shoots captured over the past 2 years). We really don't have the time to wait 60 seconds each time we need to access one of those directories to look for a file, and I am very close to pulling all my hair out!
    I really look forward to hearing from anyone who can offer any insight.

    If you are suspecting that the Windows update had something to do with your LAN going slow, then try the following:
    1.  Look for updates for your clients LAN NIC driver; or
    2.  Un-install the updates.

  • How to know the data transfer is complited? there is any message will get l

    how to know the data transfer is complited? there is any message will get like 'data uploaded is successfully complited' ?

    Hi,
    You can check SY-SUBRC = 0 or if there is an exception raised then an error occured.
    Regards,
    Ferry Lianto

  • Limit data transfer speed

    Hi,
    How could i limit the transfer speed of a standard URLConnection InputStream.
    Explanation would be appreciated.
    Thank you very much.

    I'm not sure if i understood you correctly, whether the following is a bad idea or good, but this works for me, the os BW monitor shows around 25kbps:
            try{
                URL url = new URL("ftp://ftp.sierra.com/pub/sierra/tribesvengeance/demos/tribesv_mpdemo.exe");
                URLConnection conn = url.openConnection();
                InputStream in = conn.getInputStream();
                BufferedWriter out = new BufferedWriter(new FileWriter("tvd.exe"));
                int c;
                double now = 1.0;
                long startTime = System.currentTimeMillis();
                long written = 0;
                double maxBw = 25;
                int sleepTime = 0;
                while ((c = in.read()) != -1){
                    out.write(c);
                    written++;
                    now = ((System.currentTimeMillis()-startTime)/1000);
                    parent.putSharedValue((written/now)/1024);
                    if(parent.getSharedValue() > maxBw){
                        Thread.sleep(sleepTime++);
                in.close();
                out.close();
            }catch(Exception e){
                e.printStackTrace();
            }I will perfect this to ensure it doesn't eventually slow down to 0kbps and then implement the concept into my app.
    Thanks for your help.

  • How can I increase the data loading speed

    Hi Expert,
    I need to populate a table cross dblink from another database each night. There are about 600,000 rows. It takes about two hours. This is the steps:
    delete from target_table;
    insert into target_table
    select * from source_table@dblink;
    commit;
    I can't use truncate in case the loading fails that I still have the old data.
    How can I increate the loading speed?
    Thanks!

    DELETE and INSERT /*+ APPEND */ aren't a good combination, as the high water mark will keep going up.
    With a trivial number of rows like this I would not expect the delete or insert to be the problem. (How long does the delete take anyway?) It's more likely to be to do with the query over the db link. Is it just one table or is that a simplified example? Can you check the equivalent insert over on the remote database? If it's much faster I would investigate the network connection.

  • RT - How can I make data transfer to host faster?

    Hi 
    I have created a program that acquires data on FPGA then transfers them to RT so RT can send them up to the windows host once UI is connected.
    The program is based on message type structure as in NI's examples.
    However, I have one problem the data to windows host is not transferred fast enough.
    Pic1 shows the offending bit of code and FPGA.png what's hiding in the subVi.
    FPGA is meant to acquire to cycles of a sine wave. In this case it approximately 40 ms of data at 25us sampling rate (40kS/s 8 channels). Later the data is sent to the host. As you can see I have a dedicated stream for data only and a different one for message passing.
    If I disable the code in the case structure this loop executes in 39-40 ms, however when I start sending the data to the host the rate drops to 57-60 ms per iteration and that sooner or later leads to buffer overflow.
    I have experimented with passing the acquired data to a different loop using a queue but that wasn't faster. I have also tried pipelining but that did not speed it up either. Would you have any suggestions how I could improve my transfer rates?
    Thank you.
    Bartosz
    Attachments:
    Pic1.png ‏100 KB
    FPGA.png ‏75 KB

    Hi barteklul,
    There are 2 main methods of achieving fast data transfer between RT and Host PC:
    1. Using the "Shared Variables", they allow you to transfer data deterministically from
    RT to Host PC, usually are used to monitor data.
    Please have a look at this article:
    http://zone.ni.com/reference/en-XX/help/370622J-01/lvrtconcepts/rt_projectvariable/
    This is the example code:
    https://decibel.ni.com/content/docs/DOC-15928
    The only disadvantage of such method is that if for example RT gets data really fast
    your Host PC can miss some samples.
    2. In order to receive all data from RT
    (guaranteed 100% data transfer without missing any samples) "Network Streams" should be used.
    It is a little bit more complex to implement, but if you want to store data to the file "Network Streams"
    are strongly suggested. In addition "Network Streams" are not deterministic.
    For more details about network streams please read this article:
    http://www.ni.com/white-paper/12267/en/
    At the moment I see that you are using "Network Streams" to transfer data and also I can see that you have some timing on RT
    which can slow down the data transfer rate. I suggest you to transfer data to Host PC as soon as it comes into the FIFO.
    Also if you transfer data just to monitor it, I suggest you to try Shared Variables method.
    I hope that you will this information useful!
    Kind Regards,
    Max
    Applications Engineer
    National Instruments

  • How to know the data transfer amount (MB o KB) between SAP and BW

    Hello everybody,
    Somebody know how calculate the data transfer amount between SAP and BW. Would be fantastic to know the transfer speed  and other similar data. Is there any transaction where you can see this information?
    thanks for your help.
    Manolo

    A quick, although less accurate, way is to add up your field lengths to get your total record size and then multiply it by the number of records.
    So, 5 fields, with 10 char length = 50 chars * 8 bytes /char  = 400bytes.
      8 bytes / char may be higher on unicode systems.
    with 500 records ... you get 200,000 bytes = /1024 = 195kb.
    This is just a rough estimate and it is pretty quick to figure out.  Not all fields will be completely filled, so this is the maximum size for this recordset.
    Brian

  • SuperDrive slow Data Transfer Speeds

    I have several home movies DVDs I would like to loadback onto my mid-2011 27" iMac but it is taking for ever to complete the transfer. One DVD disk takes 6 hours because the transfer speed is crawling.  I read up onthis and info says my HL-DT-STDVDRW GA32N (FirmwareVersion KE06) is made by HLDS and they have implemented riplock which slows the data speed way down to preserve SuperDrive life expectancy anddecrease noise level. How can I disable this riplock to restore the data speed. I bought this fast/expensive machine and the SuperDrive of all things is slowing medown. Completely unacceptable.

    I was having a problem ripping store bought CD's to ITunes and opened a case with Apple for suspected hardware issue. Turns out the problem was Norton AntiVirus by Symantec which was blocking my external drives. Even though the CD is internal it was killing it. Once I shut off Norton everthing started working.
    The way I came to figure out it was a Software and not hardware issue was that the Superdrive worked perfectly under Windows 7 inside of VMWare Fusiion.
    If you have any sort of AntiVirus, try shutting and down and using the Superdrive.
    My machine is the same , late 2011 with Firmware KE06

  • How to increase the date of expiration

    Hi,
    I have 4.7 version installed at my home PC, it's license has been expired.How to increase its expiry date to future.And also it shows the system date 30-01-2005.
    How can i change it to 30-01-2006.
    Regards,
    Veda Kumar.

    Pick yourself up by your own bootstrap too?
    Reinstall after restoring to HFS only then.
    You want something that works, then spend the $20 on Paragon CampTune or WinClone 3.

  • How to do Bulk data transfer  using Web Service

    In my application I have to write various web services but majority of the web service has to
    query database and return back bulk data(rows>10K) through web service.
    So I would like to ask what is the efficient way of transferring bulk data using web service as presently
    Iam returning the dataset as xml String (using StringBuilder) from web service and consuming the same at client end.
    Is there a better way to this in web service?
    My env:
    Front end can be in any other technology ,UI like C#
    Back end : Tomcat 6 on Java 6 with Axis2
    Thanks in advance

    Innova wrote:
    But then also I have to mention a return type although its xml that is getting transferred.
    Can you provide me a with a small sample code.Like if I have Emp obect with properties
    Empname,EmpID,DOJ,DOB,Dpt . In this case what will be the return type.
    My major concern is that my resultset is going to be huge in terms of >10,000 rows so
    that much time for formation of xml and then the transfer so how can I reduce the transfer
    time ,I meant a faster optimised approach for transferring large data as part of web service.
    Simply putting , how can I transfer bulk data in minimum time so that I can reduce the
    waiting time at client side for the response.
    Thanks in advanceI've done this with thousands before now, and not had a performance problem...at least nothing worth writing home about.
    Your return type will be an array of Emp objects. You can use a SOAP array for that (you'll need to look that up for the syntax, since I can't remember it off the top of my head), which gets restricted to being an array of Emp.
    Should the normal technique prove to be too slow then you should look at alternatives, but I would expect this to work well enough. And you have no faffing about with devising a new transfer system that then has to be explained to your client system...it'll all be standard.

  • Data Transfer Speed

    I inserted a data CD and copied & pasted a file from the CD to my MacBook hard drive. I could see that the speed of file transfer was about 2mb per sec. I also tried to copy and paste a file from a data DVD, and the result was the same. Has anyone tried moving files from a disc to MacBook hard drive? My optical drive is HL-DT-ST DVDRW GS21N.

    same problem here...
    burning speed is fine..when reading from the same media, the transfer speed hardly hits 1mb / sek
    this affects DVDs and CDs...
    LG GS21N

Maybe you are looking for