OS X 10.4.7 server: Samba leaking ram when copying large files from windows

Hi.
I'm having problems with:
Copying files from windows clients to OS X Server 10.4.7 uses up the RAM needed for the files to be copied.
If I copy a 3GB file, it uses 3GB of RAM
If I copy a 5GB file, it uses its 4GB of RAM, plus VM.
If I copy 11GB of files (that is several little files, plus some big by dropping a folder to the share), it consumes all the RAM the machine has, and because of VM paging, whatever other clients are reading from the disk (XRaid) start to have hiccups.
The RAM of the machine NEVER gets flushed after the copying has finished. So Samba is unusable as it is. I have four Xserves with 4GB of RAM, with 4 XRaids connected each one to each Xserve with its Apple Fiber Channel card and cables.
I already did the ack=0 thing, got the size of inet.tcp.sendspace and rcvspace to 8388608 and the buffer to 16777216.
The transfers rates are up to 70MB/s with 2 channel 1gb trunking, and at very sustained rates..
We are using these to edit video content (DV 25) in Sony Vegas with 2 or 3 clients for each server.
Any suggestions?
Thanks very much.
XServe G5 cluster node (4) / XRaid 7TB (4)   Mac OS X (10.4.7)  

Michael, I occasionally notice anomolous behaviour when files get dragged between volumes. Mostly the copying window shows an accurate and immediate indication of what's going on, but other times it just looks like nothing's happening, the display never changes, yet, it is in fact copying the files over. Now, if you're copying 2gb files from DVD to HD, it's gonna take some time, more than 5 minutes, so I'm wondering how long you've left it before forcing it to quit?

Similar Messages

  • Clients Time-Out When Retrieving Large Files  From Our PureFTPd Server

    Hi, not sure if this is the right place to get help, but didn't know where else to look. And let me begin by saying I'm not a server admin by trade, but that is the role I've fell into at a design firm. So please bear with my lack of knowledge on some of the more technical details.
    We have OS X Server 10.4.11 running here with PureFTPd installed and managed through PureFTPd Manager application. It has been fairly reliable for us for the last 2-3 years once the initial setup craziness was complete.
    But lately we've had 2 clients say that they've had difficulty downloading larger files from us. They get a time-out or error message on their end. They are most likely using Windows Explorer on a PC to do the transfer, which has always been the easiest method for our clients.
    One client had no problem getting files up to 14MB or so. But when trying to download a certain file that was about 80MB, it would not work. I tried different things here, and she tried multiple times, but no luck. I tried zipping the file to see if that would help, but no luck.
    Then another client had a similar problem today with a file that was only 25MB.
    We don't send large files very often, so I'm not sure if this is a recent thing or not. It seems like we've received some large files recently though.
    In PureFTPd manager, I usually leave all of the fields in the Transfers tab empty for all users. I didn't see anywhere else that would seem to impart a file-size limitation.
    • Any ideas at all?
    • If not, any other forums that I could search for help on? It looks like the developers site for PureFTPd Manager hasn't been updated in a year or two.
    Thanks in advance!

    Some years back I had trouble at a customer that had a ADSL using PPPoE connection to their ISP.
    Their router/modem (Speedtouch) couldn't cope with the LAN MTU when they sent files out so I had to lower it on their computers (running Panther?) ethernet interface from 1500 to 1492 (PPPoE overhead was 8 byte). The communication used to stall at about 25MB but the MTU change helped resolving that.
    My guess is that the router had to fragment (split in two) all outgoing packets it recived from the LAN computers and it just couldn't cope after a while.
    In your case it can be other network related things too like maybe needing traffic prioritizing, if receiving a lot of traffic from Internet and trying to send at the same time.

  • Drive Redirection virtual channel hangs when copying a file from server to client over RDP 8.1

    Problem Summary:
    A UTF-8 without BOM Web RoE XML file output from a line of business application will not drag and drop copy nor copy/paste from a Server 2012 R2 RD Session Host running RD Gateway to a Windows 7 Remote Desktop client over an RDP 8.1 connection and the Drive
    Redirection virtual channel hangs.  The same issue affects a test client/server with only Remote Desktop enabled on the server.
    Other files copy with no issue.  See below for more info.
    Environment:
    Server 2012 R2 Standard v6.3.9600 Build 9600
    the production server runs RDS Session Host and RD Gateway roles (on the same server).  BUT,
    the issue can be reproduced on a test machine running this OS with simply Remote Desktop enabled for Remote Administration
    Windows 7 Pro w SP1v6.1.7601 SP1 Build 7601 running updates to support RDP 8.1
    More Information:
    -the file is a UTF-8 w/o BOM (Byte Order Marker) file containing XML data and has a .BLK extension.  It is a Web Record of Employment (RoE) data file exported from the Maestro accounting application.
    -the XML file that does not copy does successfully validate against CRA's validation XML Schema for Web RoE files
    -Video redirection is NOT AFFECTED and continues to work
    -the Drive Redirection virtual channel can be re-established by disconnecting/reconnecting
    -when the copy fails, a file is created on the client and is a similar size to the original.  However, the contents are incomplete.  The file appears blank but CTRL-A shows whitespace
    -we can copy the contents into a file created with Notepad and then that file, which used to copy, will then NOT copy
    -the issue affects another Server 2012 R2 test installation, not just the production server
    -it also affects other client Win7 Pro systems against affected server
    -the issue is uni-directional i.e. copy fails server to client but succeeds client to server
    -I don't notice any event log entries at the time I attempt to copy the file.
    What DOES WORK
    -downgrading to RDP 7.1 on the client WORKS
    -modifying the file > 2 characters -- either changing existing characters or adding characters (CRLFs) WORKS
    -compressing the file WORKS e.g. to a ZIP file
    -copying OTHER files of smaller, same, and larger sizes WORKS
    What DOES NOT WORK?
    -changing the name and/or extension does not work
    -copying and pasting affected content into a text file that used to have different content and did copy before, then does not work
    -Disabling SMB3 and SMB2 does not work
    -modifying TCP auto-tuning does not work
    -disabling WinFW on both client and server does not work
    As noted above, if I modify the affected file to sanitize it's contents, it will work, so it's not much help.  I'm going to try to get a sample file exported that I can upload since I can't give you the original.
    Your help is greatly appreciated!
    Thanks.
    Kevin

    Hi Dharmesh,
    Thanks for your reply!
    The issue does seem to affect multiple users.  I'm not fully clear on whether it's multiple users and the same employee's file, but I suspect so.
    The issue happens with a specific XML file and I've since determined that it seems to affect the exported RoE XML file for one employee (record?) in the software.  Other employees appear to work.
    The biggest issue is that there's limited support from the vendor in this scenario.  Their app is supported on 2012 R2 RDS.
    What I can't quite wrap my head around are
    why does it work in RDP 7.1 but not 8.1?  What differences between the two for drive redirection would have it work in 7.1 and not 8.1?
    when I examine the affected file, it really doesn't appear any different than one that works.  I used Notepad++ and it shows the encoding as the same and there doesn't appear to be any invalid characters in the affected file.  I wondered
    if there was some string of characters that was being misinterpreted by RDP or some other operation and blocked somehow but besides having disabled AV and firewall software on both ends, I'm not sure what else I could change to test that further
    Since it seems to affect only the one employee's XML file AND since modifying that file to change details in order to post it online would then make that file able to be copied, it seems I won't be able to post a sample.  Too bad.
    Kevin

  • When uploading large file from network, all other requests are not being sent to server

    In our application we are facing a weird scenario in which when we try to upload a huge file(600+ MB) from network, all other requests(AJAX) are getting blocked. But when the same file is being uploaded from local location(E drive) then everything works fine.

    How are you uploading the file via network?
    If you are troubleshooting the network bandwidth? or the threads where one process takes precedent over the other you will have to troubleshoot the QoS of the network you see this on.
    To give a better visual please use Firebug or the Web Developer tool called Network to analyze the requests. The "XMLHttpRequest" will give better clues for Ajax. Reference [http://ajaxian.com/archives/ajax-debugging-with-firebug]
    There may be a about:config option that allows mutithreading or max persistent connections per server you can check.

  • Error while copying a file from windows oracle server to a solaris server

    Hi all,
    DECLARE
      l_conn  UTL_TCP.connection;
    BEGIN
      l_conn := ftp.login('Destination Ip address ', '22', 'Username', 'Password');
      ftp.ascii(p_conn => l_conn);
      ftp.put(p_conn      => l_conn,
              p_from_dir  => 'MID5010_DOC1TEMP', -- Oracle Directory name from where we need to copy a file
              p_from_file => 'Hipaa.33KM.5093.06152011130146885.834.O.irl',
              p_to_file   => '/qatest1/mihipaa5010/mj5010/DevelopmentStage/working_directory/Outbound/Data/75061252/Hipaa.00AN.07262011173844778.820.O.copied.irl'); -- Directory of the destination machine where we need to paste
      ftp.logout(l_conn);    
       exception
        when others then
          dbms_output.put_line(sqlcode || sqlerrm);
          --dbms_output.put_line(l_conn);    
    END;We are getting the below error:
    SSH-1.99-OpenSSH_5.1
    -29260ORA-29260: network error: TNS:connection closed
    Could any one please let us know why this error is raising...

    prakash wrote:
    Hi all,
    DECLARE
    l_conn  UTL_TCP.connection;
    BEGIN
    l_conn := ftp.login('Destination Ip address ', '22', 'Username', 'Password');
    ftp.ascii(p_conn => l_conn);
    ftp.put(p_conn      => l_conn,
    p_from_dir  => 'MID5010_DOC1TEMP', -- Oracle Directory name from where we need to copy a file
    p_from_file => 'Hipaa.33KM.5093.06152011130146885.834.O.irl',
    p_to_file   => '/qatest1/mihipaa5010/mj5010/DevelopmentStage/working_directory/Outbound/Data/75061252/Hipaa.00AN.07262011173844778.820.O.copied.irl'); -- Directory of the destination machine where we need to paste
    ftp.logout(l_conn);    
    exception
    when others then
    dbms_output.put_line(sqlcode || sqlerrm);
    --dbms_output.put_line(l_conn);    
    END;We are getting the below error:
    SSH-1.99-OpenSSH_5.1
    -29260ORA-29260: network error: TNS:connection closed
    Could any one please let us know why this error is raising...As sybrand correctly points out, this issue doesn't belong here.
    You are using a 3rd party package "ftp" and the error it is indicating suggests the issue is a network issue of some sort.
    We don't have the code of that package or know what it is doing, so please consult whoever supplied or wrote the package and/or your network administrators.

  • Need to copy .txt file from FTP server and downloaded on local server directory.

    I need to figure out a way to copy .txt file from ftp server in local server directory using sql jobs.

    Below links will help achieving it:
    https://www.virtualobjectives.com.au/sqlserver/ftp_scripts.htm
    http://www.mssqltips.com/sqlservertip/2884/sql-server-integration-services-ssis-ftp-task-for-data-exchange/

  • Source path too long :-Unable to delete mutiple number of folder and files from windows 2008 R2 file server

    Hi Team,
    we have a file server on windows server 2008 R2, I have copied some data from one server to another server using robocopy . I have checked access permission it seems okay no issues with access permission. but when i am trying to delete these folder i am
    getting below error message
    Error message:- 
    The source file name are larger than is supported by the file system.try moving to a location which has a shorter path name or try renaming to shortcut names before attempting this operations
    Regards,
    Triyambak 
    Regards, Triyambak

    I have tried everything , but nothing help , getting same error 
    could any one help me regarding this.
    Regards, Triyambak
    I have not looked at the other thread mentioned, but usually when this ends up happening, There are several ways to go about it.    One is to map a drive to the UNC path deeper into the folder structure.   
    So instead of C:\long\path\that\we\dont\want\files\in
    You map a drive.. lets say M:\   to     \\computer\c$\long\path\that\we\dont\want
    Now, when you open Explorer to M:\ you've elimintated the length of the path down to M:\files\in which is completely usable.
    The other way, is to shorten the names of everything.    For example...
    Folder structure like this:
    Root
    -----Folder1
    -----Folder2
    --------------Folder2A
    -----Folder3
    --------------Folder3A
    Rename all the folders to shorten up the path.     Rename Folder1 to '1' Rename Folder2 to '2', Rename folder3 to '3.    Then try to delete.  If it's still too long,  go one folder deeper.   Rename Folder2A to '1'  and
    Rename Folder3A to '1' and so on.     Basically keep renaming everything to a single digit character and eventually you'll shrink the path down to where you can shift-delete everything remaining.
    Hope that helps.    
    Brian / ChevyNovaLN

  • Copy a file from server to the client - URLConnection to a Portal page

    Hello:
    I have an application running on the client side. When the app startup it must open a file which is at the server side, to be more specific, the file is at KM content of the portal.
    I try to read it with URLConnection to copy the file from the server to the client, the app will do it, but "Server returned HTTP response code: 401 for URL:"
    If you copy&paste the url's file directly on the browser (http://host:port/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/ImagenesIM/file.txt) a login popup (look and feel windows) is display. After entering the user and psw the file is open without problem.
    Any idea what can I use or how do it ?.
    I think that probably I have to move the app to a was directory instead of portal directory.
    The app is execute via *.jnlp with a link at a portal page.
    Thanks a lot for your time.

    Javier,
    401 means authentication error, i.e. your application is not authenticated to KM.
    What you can do? Actually, it depends. Check current cookies in your application, probably there are SSO coockie or J2EE authentication cookie. You may try to set this cookies in URLConnection (via addHeader). Otherwise you have to supply authentication creadentials to URLConnection (also via addHeader, most probably, via Basic HTTP authentication scheme).
    Valery Silaev
    EPAM Systems
    http://www.NetWeaverTeam.com

  • How to copy a file from application server to local system

    Guys,
    Need to copy a file from application server to local system.Is there an FM for the same.
    Tried searching for it but couldn't find anything useful.
    Code snippets will be highly appreciated.
    Warm Regards,
    P.
    Moderator message: very frequently asked and answered question, obviously you did not search thoroughly, all points removed.
    Edited by: Thomas Zloch on Dec 3, 2010 4:48 PM

    hi,
    You can use the transactions CG3Y or through program u can do like this..
    DATA: BEGIN OF IT_FILE OCCURS 0,
                    LINE TYPE STRING,
               END OF IT_FILE.
    OPEN DATASET <file_name>  FOR INPUT IN TEXT MODE ENCODING DEFAULT.
            IF SY-SUBRC IS INITIAL.
              DO.
                READ DATASET<file_name> INTO IT_FILE-LINE.
                IF SY-SUBRC = 0.
                  APPEND IT_FILE.
                  CLEAR IT_FILE.
                ELSE.
                  EXIT.
                ENDIF.
              ENDDO.
            ENDIF.
    CLOSE DATASET <file_name>.
    Download it to local system using  FM - GUI_DOWNLOAD

  • Sender file adapter is not picking the file from windows server

    Hi Experts,
    We have a sender file adapter running on Unix server. Now we have changed the source directory path from Unix to Windows in file access parameters.  It is not picking the files from windows directory and not showing any error.
    In this scenario, input file for sender adapter is *.xml and no content conversion.
    Could any one please let me know is there anything needs to changed in file adapter.
    Thanks in advance,
    Sridhar. M

    Sridhar,
    What do you have in the directory path?
    If it is a shared drive in unix then the directory in windows should also be a shared drive from XI system. Else if it is FTP check the address.
    Regards,
    ---Satish

  • Hello, How do I tell sql+ to spool output file from windows to Unix server?

    Hello, How do I tell sql+ to spool output file from windows to Unix server?
    I am new to SQL+ and just learned how to spool the file. But file is saved in my local windows enviroment and since it's 2GB in size...I want to spool it directly to another remote unix server.
    Pls answer in detail... I have been to most of the thread and didn't see relevant answer to above question.
    Am I suppose to develope some script which FTP the spool file directly to the server I want to
    or
    i Have to use UTL_FILE Package ?
    Thanks for reply

    You may not be able to...
    SQL*Plus can only spool to the local machine. If you have mapped a directory on the Unix server from your Windows machine, you can specify that directory in your SPOOL command.
    You could telnet to the Unix server, run SQL*Plus there, and spool the file to a local (Unix) directory.
    If the Unix server is also the Oracle database server, you could use the UTL_FILE package rather than using SQL*Plus to spool a file.
    If the Unix server is also an FTP server, you could also FTP the file from your local machine to the server.
    Of course, I would tend to re-examine a requirement to regularly generate a 2 GB text file. It seems likely that there is a better way...
    Justin

  • TS1402 I can not copy any files from the server & from the Finder. System MAC OS 10.7.5

    I can not copy any files from the server & from the Finder. System MAC OS 10.7.5
    <Email Edited by Host>

    Hi, what is the no boot directory found about???
    Can you give details step by step of what you're trying?

  • Can't shown chinese text when copy & paste data from server to Outlook, Word & notepad, etc.( Office 2013)

    Can't shown chinese text when copy & paste data from server to Outlook, Word & notepad, etc.( Office 2013)

    Hi
    As per the information and details provided by you, when you copy & paste a data from server to Outlook, word, notepad, then you do not receive the Chinese text.
    For Outlook, please follow these steps: -
    Close and reopen Outlook in your western locale (or switch the windows system to your Western locale if you changed that),
    Manually change the message from Western to Chinese encoding, which you can do in all versions up to Outlook 2007.
    If you want to stay in your Chinese locale in Outlook 2007, then:
    After you hit reply, go to the Option tab > More Options.
    In the Encoding drop-down menu, select the Chinese encoding you are working in (Not the encoding used by the person who will receive the message)
    Note:
    To set the Chinese locale in all versions up to 2007 the controls are under.
    Tools > Options. In Outlook 2010 File tab > Options > Advanced > International options.
    Unicode (UTF-8)
    is a good setting for multilingual users.
    Check the
    Auto select 2007)/ Automatically select (2010) encoding box.
    I hope this information will be helpful for you.
    Thanks and regards
    Shweta@G 

  • Samba 4: users unable to move files from compressed folder to Samba share

    I have recently upgraded Samba 3.6.x from Centos 6.6 to Samba 4.1.12 on Centos 7.The shares were migrated in place. I reset permissions and Windows ACLs according to the Samba 4 Wiki.
    When a user opens a compressed folder (a.k.a. Zip file) on Windows 7, then tries to copy the files into a shared folder on the Samba 4 server using drag & drop, only one to four files is actually copied, and the copy process silently fails. If the user waits about 2 minutes, then they can move all of the files without issues. Also, if the user is able to copy all files, when they try to delete the newly created folder they get an error: Thumbs.db cannot be deleted because it is open in Windows Explorer.
    So, the root of the cause seems to be Windows Explorer locking files for too long. But I don't understand this enough to fix it.
    No errors appear in the...
    This topic first appeared in the Spiceworks Community

    "admiz" should be the account name anyway.
    When you do a Get Info on that in the Finder... what is locked, & Rights say?

  • How to delete file from Window server

    Hi
    Can anybody tell me that Is there any function module for deleting file from presentation server like C directory.
    Quick suggestion will highly be appreciated!!!!!!!

    Try this:
    CALL METHOD cl_gui_frontend_services=>file_delete
      EXPORTING
        filename             =
      changing
        rc                   =
    EXCEPTIONS
       FILE_DELETE_FAILED   = 1
       CNTL_ERROR           = 2
       ERROR_NO_GUI         = 3
       FILE_NOT_FOUND       = 4
       ACCESS_DENIED        = 5
       UNKNOWN_ERROR        = 6
       NOT_SUPPORTED_BY_GUI = 7
       WRONG_PARAMETER      = 8
       others               = 9
    this is pretty gud approach .
    Message was edited by:
            Nishant Rustagi

Maybe you are looking for