FTP/SFTP/FISH (etc) slow file transfer rate over LAN

Hi everyone,
I have a problem with transferring files over my home network that has been bothering me for quite some time.
I have a 802.11n router which should provide me with the transfer rate up to 150 Mbps (afaik). When I download files from the Internet, 3 MB/s data transfer rate is of no problem.
However, when receiving or sending data over LAN, the transfer rate is much slower (1.8 MB/s).
My rough guess is (after reading some papers on this topic) that TCP protocol is causing this (its flow control feature to be exact), since TCP max window size is too small on Linux by default.
So, setting TCP max window size to a greater number should solve this.
I tried putting this:
# increase TCP max buffer size setable using setsockopt()
# 16 MB with a few parallel streams is recommended for most 10G paths
# 32 MB might be needed for some very long end-to-end 10G or 40G paths
net.core.rmem_max = 16777216
net.core.wmem_max = 16777216
# increase Linux autotuning TCP buffer limits
# min, default, and max number of bytes to use
# (only change the 3rd value, and make it 16 MB or more)
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
# recommended to increase this for 10G NICS
net.core.netdev_max_backlog = 30000
# these should be the default, but just to be sure
net.ipv4.tcp_timestamps = 1
net.ipv4.tcp_sack = 1
in /etc/sysctl.conf but to no avail.
So either there is no problem with the max window size setting, or the Linux kernel ignores it (maybe because /proc is no longer supported?).
Thanks for any neat ideas.
Last edited by Vena (2012-06-01 21:48:14)

Bump? No ideas whatsoever?

Similar Messages

File transfer protocol over LAN

Hello every wizards of this world...i extemely need ur help...plz...can i ask for ur helping hands to give us a running codes for file transfer. on socket programming over LAN(local area network)..we nid this codes for our project...we find hard searching for it on the internet...there are lots of examples but it doesn't work...

FTP

How to achieve the maximum file transfer rate from PXI to local host?

I will have to copy a huge amount of data (as big as 50 GB) from a PXI-8106 unit on site to a laptop. Currently it would take several hours. It is critical to max out the data transfer rate.
The standard method we've been using is just drag and drop using Windows Explorer via FTP. I tried to use FTP VIs with Filezilla Server as well but the transfer rate is only like 1.5 MB/s. Is this normal? Once I saw it was 3.0 MB/s but for some reason, that isn't happening now.
For another option, I tried to transfer data to a USB flash drive but it's even slower. As far as I know, USB 2.0 transfer rate is supposed to be around 60 MB/s but why would it be slower than 1.5 MB/s? What could be the speed limiting factor in my file transfer setup?
Any tips on improving file transfer rate would be appreciated!

Sustained 40 MB/s? That is my dream speed! The maximum speed I've ever seen here was about 25 MB/s, which is still very good, and that happened only after copying back and forth, which I explained above. Let me go through what I did with screencaps first.
These are the test tdms files to transfer in the PXI: an original file witten in the PXI and its copy file. I copied the original file from PXI to laptop and renamed it (added '_copy') and then copied it back to PXI.
FTP module is transferring the original file to the Filezilla server on laptop. Note the low speed.
FTP module is transferring the copy file to the Filezilla server on laptop. Note the higher speed.
This is the FTP sub VI I'm using. It transfers files in sub-folders (one level lower), too. The data connection is set to 'passive' on the FTP Put Multiple Files VI but it doesn't seem to make any difference. I attach the sub VI.
You tried the file transfer with a 500 MB text file. Would there be any difference if the file type was tdms? Would the RAM size matter? It is 2GB here.
And the LED is orange, which means Gigabit.
Another question: Is there any way to programmatically stop file transfer in progress? Currently, I just have to restart the PXI.
Thank you!
Attachments:
FTP.vi ‏40 KB

File transfer rate is very bad on my new W520. Help needed....

Hello,
I have a usb 2.0 hi speed flash drive which has transfer rates of 15Mb/s. But When I am trying to copy a movie (under 3 gb) from my W520 to the flash drive the speeds that I observe is 6Mb/s which is very slow. Initially, I though I have an issue with the flash drive but when I used my 3 year old dual core xps laptop to copy a file, I observed the speed of 15 Mb/s. If not high speed atleast I am expecting to see 15Mb/s with my W520. Really wierd!!!
BTW... I am running my W520 at "Maximum Performance" power profile. And I see my clock speed always at less than 1 ghz while copying the file but when i do other stuff i see my clock speed hitting 3.2 ghz....
Any thoughts on whats going on???
My system is Thinkpad w520 2710 with 8 gb of ram....
Thanks
Robustm

Hi robustm
From what I know, the problem lies with Windows 7 (throttling)
How about copying to USB drives? the speed should be around 30+ - 60MB, depending on the file type also.
1. You could also try updating Intel Chipset driver
http://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y&ProdId=816&DwnldID=20019&ProductFamily=Chipse...
et+Software&ProductProduct=Intel%C2%AE+Chipset+Software+Installation+Utility&lang=eng
2. You could try using SpeedGuide TCP Optimizer, which resolves Network Throttling and Slow file transfer problems for some. (Set as Optimal)
http://www.speedguide.net/downloads.php
3. You could go to Computer Management (compmgmt.msc), Device Manager, Disk drives, double-click your USB device, policies, set as Performance.
* Note: This may require you to Safety Remove the device, due to caching for performance.
Hope it helps
Happy Holiday
Peter
ThinkPad: W520 (4284-A99)
=============================================
Does someone’s post help you? Give them kudos as a reward, as they will do better to improve
Mark it as solved if the solution works for you, so it could be reference for others in the future
Dolby Home Theater v4 (Essential/IdeaPad/ThinkPad)
http://forums.lenovo.com/t5/General-Discussion/Dolby-Home-Theater-v4-for-most-Lenovo-Laptops/td-p/62...

Slow file transfer - ethernet + firewire issue?

Here's the setup -
Win98PC > ethernet (direct cable connection) > iMac G5 > Lacie d2 FW drive
Connection (100BaseT) works, logins work fine, browsing folders & files is fine. But when I transfer files from the WinPC to the Lacie drive through the iMac G5 it is unbelievably slow. Same thing if I use one of my other Macs in place of the WinPC, so it looks like a network or iMacG5 issue, not a WinPC issue.
On the other hand, if I use Airport to connect a WinPC, eMac or MacBook to the iMacG5, the file transfers are blindingly fast.
Is this perhaps because the FW & ethernet controllers in the iMac G5 are the same PHY chip? Is this some kind of contention for bandwidth through the PHY chip? (The Airport card in the iMacG5 is on a separate bus, not connected to the Ethernet/FW PHY chip, which makes me suspect something is up with the ethernet/FW controller.)
Anyone else encounter a problem like this with slow file transfer through your iMacG5 to an external FW drive?

Martin, that's really interesting. I've noticed slow network transfers in the past but always racked it up to overhead and parity errors inherent in the OS's. Never thought it might be the PHY chip, though it certainly could be. Apple has a broadband tuner which might help you by increasing packet size (but you probably knew that as a Level3). My stopgap is to do the file transfers with firewire, but your laptop may not have that option.
You could maybe copy to the mac over the network, then copy a second time to the LaCie. Not elegant or clean, but will save you time. Kinda like taking the backroads to avoid rush hour traffic - it's farther to go but you get there faster.
I'll look into the controller question. Let us know how you're doing,
Ed

FILE TRANSFER RATE SLOW FROM WIN SERVER 2012.

Dear Team
The File Transfer problem From my Windows Server 2012R2 (File server) showing 200KB transer rate in 1g network. Please help

Hi,
What's the operation system are you using, Windows XP/2003 or Windows 7/8/2008/2012?
You can test to disable SMB2/3 and see if issue is related:
Set-SmbServerConfiguration -EnableSMB2Protocol $false
See:
http://support.microsoft.com/kb/2696547/en-us
Note: This is just for testing and you can enable it after testing.
If it is SMB related, try to disable the TCP Chimney Offload, Receive Side Scaling and Network Direct Memory Access features.
Information about the TCP Chimney Offload, Receive Side Scaling, and Network Direct Memory Access features in Windows Server 2008
http://support.microsoft.com/kb/951037
Here are the steps to disable RSS, TCP Chimney Offload and NetDMA:
netsh int tcp set global rss=disabled
netsh int tcp set global chimney=disabled
In HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters, double-click the EnableTCPA registry entry.
Note: If this registry entry does not exist, right-click Parameters, point to New, click DWORD Value, type EnableTCPA, and then press ENTER.
To disable NetDMA, type 0 in the Value data box, and then click OK.
Let us know if issue still exists.
Meanwhile we have an Forum FAQ article which provided some suggestions and quick-fixes for network slowness issue. Please see if it could help:
[Forum FAQ] Troubleshooting Network File Copy Slowness
http://social.technet.microsoft.com/Forums/windowsserver/en-US/7bd9978c-69b4-42bf-90cd-fc7541ccb663/forum-faq-troubleshooting-network-file-copy-slowness?forum=winserverPN
If you have any feedback on our support, please send to [email protected]

KT3 Ultra ARU Slow HD Transfer Rates

Hello,
First, please see my system information at the bottom of this message.
I have a MSI KT3 Ultra ARU motherboard and have installed a Maxtor ATA133 60GB hard drive with 2 MB cache. The hard drive is jumpered as Master and is connected all by itself on the IDE1 ribbon cable. On IDE2 I have a CDRW (Master) and a CD-ROM (Slave). My other hard drive (WD 120GB ATA100 8 MB cache) is on IDE3 and is set up in RAID 1+0 stripe.
I recently ran the Sandra file system benchmark on my hard drives with what I think are very discouraging results. My Maxtor drive on IDE1 scored 32 MB/s and my WD drive on IDE3 came in at 23 MB/s. Those are some stinky results aren’t they?
I checked my Device Manager under IDE ATA/ATAPI Controllers and it indicates that for my Primary IDE Channel the current transfer mode for device 0 is Ultra DMA Mode 6. I don’t know how to check the transfer mode on my IDE3 hard drive.
Question #1: Are my 32 MB/s and 23 MB/s results slow for my hardware?
Question #2: If these results are slow, how can I increase the transfer rates?
Please help!
Thank you!!!!
My System
AMD Athlon XP 3000+
MSI KT3 Ultra ARU MOBO
2 x 256MB DDR PC2700 SDRAM
ATI Radeon 9600XT 256MB
Western Digital WD1200JB 120GB Caviar HD ATA100 8MB Cache 1+0 Stripe/RAID0
Maxtor 6Y060L0 60GB HD ATA133
Pioneer DR-A04S CD-ROM 32X
Lite-On LTR-48125W 48x12x48 CDRW
TTGI TT-350SS (350W) Power Supply
PSU Ratings: +3.3V/28A +5V/35A +12V/16A
Windows XP Home SP2

These tranfer rates seem fine for sequential read rates. The maxtor drive is at mode 6 and the WD should be at mode 5 if its ATA100.

Slow file transfer between Mac & PC Network - bad checksums?

Howdy all. I've been having a persistent issue with transferring files from my Mac to my Win2003 server. The transfers are always much slower than they should be (compared to the PCs on the network with lesser connections), but even more puzzling, is that it will often go to 95% (or thereabouts) and then take twice as long to finish the remaining percentage as it did to transfer the vast majority of the file.
It's all gigabit from point to point and I've swapped patch cables, router ports, etc.. with a known good performing WinXP box to see if that would make a difference, but it didn't.
I've searched the forums and found some mention of mysteriously slow file transfers using SMB, but nothing conclusive.
I ran a LAN monitoring util on the Mac during a xfer and below is a snippet of the results from the log. No dropped packets, but lots of bad checksums?
Any help would be greatly appreciated.
Thanks,
Ed T.
Start: 6/14/06 4:36:26 PM
16:36:41.676157 localhost.1017 > localhost.1033: P 367145920:367145992(72) ack 93878562 win 65535 <nop,nop,timestamp 2029087960 2029087900> (DF) (ttl 64, id 56412, bad cksum 0!)
16:36:41.676189 localhost.1033 > localhost.1017: . ack 72 win 65535 <nop,nop,timestamp 2029087960 2029087960> (DF) (ttl 64, id 56413, bad cksum 0!)
16:36:41.676207 localhost.1033 > localhost.1017: P 1:61(60) ack 72 win 65535 <nop,nop,timestamp 2029087960 2029087960> (DF) (ttl 64, id 56414, bad cksum 0!)
16:36:41.676224 localhost.1017 > localhost.1033: . ack 61 win 65535 <nop,nop,timestamp 2029087960 2029087960> (DF) (ttl 64, id 56415, bad cksum 0!)
16:36:49.676576 192.168.1.111.50949 > 255.255.255.255.2222: udp 152 (ttl 64, id 2189)
<SNIP MORE OF THE SAME>
320 Packets Received
0 Packets dropped.
• Monitor Completed •

While I have never tried it, Mac supports Firewire networking (TCP/IP over FW) and I know that some PCs do likewise. Mine does.
That being said, it's possible to link your Mac to your PC with a FW cable (both ends must be the large type of connector) and if so, you can transfer at 400 MB/s.
To enable FireWire networking on your Mac, in the Network preferences, at the bottom of the left pane, click the + sign and in the popup window, add Interface: Firewire.
As I said, I have never used it but in theory it would work. It's not at all like using the Target mode, this is a "hot" FW network link that can directly connect two computers.
IMO, it's worth a shot.

Slow file transfer between Macs

Hello,
I am getting slow transfer speeds (<3 MByte/sec) while transfering files between Macs.
Macbook Air 11" (late 2010) - Lion 10.7.4
iMac 20" (2007) - Lion 10.7.4
Airport Extreme (4th Gen)
Wireless specs:
Firmware 7.6.1
WPA2 Personal
2.4 Ghz on Channel 3 (no one near me is on this channel)
5 Ghz on Channel 149 (I am the only one with 5 Ghz band on the neighborhood)
AEBS, Air and iMac in separated rooms, with one wall between then (forming a triangle)
Tested all channels; low, medium and high multicast; with and without wide channels; separated and unified 2.4 Ghz and 5 Ghz bands
Average transmit rate at 2.4 Ghz on Air: 108-130
Average transmit rate at 2.4 Ghz on iMac: 117-130
Average transmit rate at 5 Ghz on Air: below 81
Average transmit rate at 5 Ghz on Air: below 54
Wirelss signal on both Air and iMac: maximum
The files were all video files, ranging from 500Mb to 1.5Gb and the speed was measured using the Activity Monitor - Network Tab. The transfers were made through Finder by drag and drop method using shared folders, both Air to iMac and iMac to Air. The transfer was the only activity running on both computers.
I know the wireless N is not supposed to work at 130 Mbps in real world (2.4 Ghz), but I was expecting at least 6-9 Mbytes/sec speed while transfering large files. (5 Ghz also tested but the transmit rate would never reach values above 100 Mbps and transfer speed was even worse).
I have been reading a lot of topics in many forums but no tip was able to help me.
Can someone give me a hint to solve this and at least double my transfers speed (6 Mbytes/sec)?
Thanks.

I just had some more important information...
I was over at my inlaws house...on their wireless network receiving files works just fine. Something must be conflicting on the wireless network in the office.
Any ideas of what it could be. I've tested several other macs there and they transfer files just fine over the network. But for some reason mine seems to have a problem.
We have an SBS 2003 network and a linksys wireless g router.

Extremely slow file transfer speed

Hello,
Has anyone else had problems transferring files between computers over a 802.11g network? Recently, I found that transferring files via wireless has become incredibly slow. This morning it took about 10 min to transfer a 25MB file from my MacMini to my MacBook Pro. This was not the case several weeks ago.
In terms of updates, neither have the notorious Airport Extreme 2007-001 update installed. Though, I did have to reinstall OS X on the Mini to roll it back. The MacBook Pro does have the Security Update 2007-001 installed where as the Mini does not.
Specs:
Wireless Router: Linksys WRT54GSv4
MacBookPro - 2GHz Core Duo
MacMini - late 2006 - 1.66GHz Core Duo
Thanks

Golybs wrote:
is there a way to find out why "a file is in use" / what process is using it, and kill that process?
Yes. Launch the Terminal utility and enter this command:
sudo lsof | grep "sometext"
That character after "lsof" is a "vertical bar", which should be on the far right of the row with "P". The first character of "lsof" is a lower-case letter "L". The text "sometext" should be replaced with at least part of the name of the file that seems to be locked. The quotes aren't necessary unless there's a space (or one of a few other odd characters) in the text you put in the command. After you type the text, press <return>. You'll be prompted for your administrative password.
If the culprit turns out to be Finder, try clicking on the Finder icon on the Dock while you hold down an "option" key, then choose "Relaunch".
how can I find out if some process is accessing the Time Capsule hard drive, keeping it busy and making the transfers slow?
That's a little harder. You could launch Activity Monitor and click on the "Network" tab in the lower part of the window. I'd also check the quality of the signal to the Time Capsule
If you have an Apple AirPort base station, I'd use the advice in this thread to investigate the signal and noise levels that each Mac sees, as described in this thread:
http://discussions.apple.com/thread.jspa?threadID=2347845&start=1

Incredibly slow firewire transfer rate

Hi fellas
my firewire drive (formatted ext3) has an incredibly slow 2MB/s transfer rate?
Is this normal? Anything I can do about it?
Cippa Lippa

I have a FireWire 400 HD, it has a JMicron chipset (pretty generic but works great). I worked wonderfully on Leopard without a single glitch ever.
Now, after upgrading to SL, I experience the same as you and the drive is not responding well, hanging constantly and experiencing really slow transfer rates, that make it unusable (all applications that try to open something from it eventually hang). It's not a temporary glitch, even after several reboots and connecting/disconnecting the drive. The same drive under USB2 (it also has USB2 interface) works perfect (but I really want my firewire back).
I hope Apple fixes it! Definitely a bug.

Lenovo Thinkpad X1 - Extremly slow file transfer through e-sata

Hi there! I have got another issue with my notebook - the file transfer through e-sata is extremly slow (about 5MBpS). Using Windows 7. Where could be the problem? Thanks.

Hi Gabbi,
thanks for posting. You might want to check in your control panel which Lenovo preloaded software are installed. One software which I've seem has caused this issue is the Lenovo Rapid Shield and and Lenovo Airbag Protection.
Could you try disabling them and check for the changes.
do let me know..
regards

Slow data transfer rates

I have a MacBook Pro - Retina with an Apple thunderbolt to gigabit ethernet adaptor which is connected directly to one port of a synology 412+Nas with Cat6 cable. I am experiencing low data rates when transferring large files (>1GB) usually less than 25Mb/s though sometimes peaking at 100Mb ( fora few seconds) The average rate declines throughout the file transfer. I have noticed that there is a repeated/ self recovering crash which occurs which is co incdent with a dip in the date rates. Having eventually found the crash report its detail is associated with Finder. I am not technically savy enough to interpet the report nor have I been fortunate enough to find the crash reports again!
Has anyone else had this data rate performance issue?

your profile will sort itself out after that period but if you are having disconnection with the hub resetting then there is a more serious noise problem. Check your phone line by dialling 17070 option 2 - should hear nothing - best done with a corded phone
Are you connected to the master or test socket or somewhere else? do you have extensions sockets and if so have you removed the orange bellwire from terminal 3 from the master and all the extensions as this can act like an aerial for noise. http://www.jarviser.co.uk/jarviser/bellwirenutshell.html
there is no point in getting the mods to fix your profile if you have a noise problem as you will be back to square 1 in a few days so better sorting problem first
If you like a post, or want to say thanks for a helpful answer, please click on the Ratings star on the left-hand side of the post.
If someone answers your question correctly please let other members know by clicking on ’Mark as Accepted Solution’.

Slow file transfer to Azure File Service

File transfer to Azure File Service (Beta) is very slow. Is this something that will be solved, or is there a trick to this?
Sean

Yes. Pretty sure.
Based on MSDN Blogs > Microsoft Azure Storage Team Blog > Introducing Microsoft Azure File Service
Description
Azure Blobs
Azure Files
Durability
Options
LRS, ZRS, GRS (and RA-GRS for higher availability)
LRS, GRS
Accessibility
REST APIs
SMB 2.1 (standard file system APIs)
REST APIs
Connectivity
REST – Worldwide
SMB 2.1 - Within region
REST – Worldwide
Endpoints
http://myaccount.blob.core.windows.net/mycontainer/myblob
\\myaccount.file.core.windows.net\myshare\myfile.txt http://myaccount.file.core.windows.net/myshare/myfile.txt
Directories
Flat namespace however prefix listing can simulate virtual directories
True directory objects
Case Sensitivity of Names
Case sensitive
Case insensitive, but case preserving
Capacity
Up to 500TB containers
5TB file shares
Throughput
Up to 60 MB/s per blob
Up to 60 MB/s per share
Object size
Up to 1 TB/blob
Up to 1 TB/file
Billed capacity
Based on bytes written
Based on file size
Regards

Slow file transfer from pc to mac

I've got two windows xp home pcs and two macs (a mac mini and an ibook). The windows PCs are connected to the wired network and both macs are wireless.
When I try to initiate a file transfer on either pc to either mac, the file transfer is really slow (slower than I think it should be). It's very annoying.
Does anyone have any idea what causes this and how to fix it? Thanks.

I've got some more information: when Windows NT initiates a file transfer to the mac using windows file sharing, the transfer speed is fast. It's XP that has the problem. Is this a windows XP problem or a Mac OS X problem? Last time I checked, the macs were both able to communicate with each other just fine.
Ok, here's the transfer speeds approx: a 100mb file is normally quickly transferred in about a minute. When the windows xp machine tries to send to the mac, the transfer will take many times longer to complete.
Can anyone help with this problem? Anyone at all? Please? I'm annoyed about this issue.
So, what's the fix? Please. Thanks.

FTP/SFTP/FISH (etc) slow file transfer rate over LAN

Similar Messages

Maybe you are looking for