Slow ZFS-share performance (both CIFS and NFS)

Hello,
After upgrading my OpenSolaris file server (newest version) to Solaris 11 Express, the read (and write)-performance on my CIFS and NFS-shares dropped from 40-60MB/s to a few kB/s. I upgraded the ZFS filesystems to the most recent version as well.
dmsg and /var/log/syslog doesn't list anything abnormal as far as I can see.. I'm not running any scrubs on the zpools, and they are listed as online. top doesn't reveal any process utilizing the CPU more than 0.07%.
The problem is probably not at the client side, as the clients are 100% untouched when it comes to configuration.
Where should I start looking for errors (logs etc.)? Any recommended diagnostic tools?
Best regards,
KL

Hi!
Check Link speed.
dladm show-dev
Check for collisions and wrong network packets:
netstat -ia
netstat -ia 2 10 ( when file transfered)
Check for lost packets :
ping -s <IP client> ( whait more 1 min )
Check for retransmit, latency for respond:
snoop -P -td <IP client> ( when file transfered)
Try replace network cable.
Regards.

Similar Messages

  • 7110 OMG, CIF and NFS permission woes. I'm tired and I want to go home.

    OK, here's the dealio...
    I have share exported via CIFS and NFS from our 7110 array running 2010.02.09.2.1,1-1.18
    I have AD configured for CIFS Authentication.
    I have a UNIX desktop so I am using SMB authenticate via AD and talk to the CIF share on the array.
    I have the NFS share mounted using vers 3 on Solaris 10.
    Now, the problem..........
    PERMISSIONS!!!
    Here’s what I want to do,
    Create a file or folder on the CIF and preserve the username on NFS.
    Example, I login as myself via AD, bam I’m on the array.
    Create a file.
    Check the ownership of the file on the NFS mount and it’s suddenly become a series of numbers. Of which I assume are taken from my Windows SID. As Solaris can’t relate my SID to a UNIX username I’m left out in the dark.
    So, I then tried to set up some rule based identity mapping so my Windows login would be converted to my UNIX username, no luck still a series of numbers for me listed against my files.
    I could work around this if I could chown but I can’t even do that as it says chown: filename: Not owner
    What gives? How do I keep my username from CIFS to NFS? HELP!!!!

    Did you have any joy with this?
    I have never been able to determine a consistent configuration for NFS/CIFS sharing on a 7310. Ended up opening access to all on the NFS side (v4) and the CIFS just worked out of the box.
    I am using ID Mapping, with IDMU first, then rule based mapping next. The box picks up the correct UID/GID from AD but doesn't always inherit the user & group for the NFS side.
    Chris

  • Need to perform both Queue and stack operations in Visual C# code

    Need to perform both Queue and stack operations, is any Data Structure available for this. or how can i custom create the structure for this?

    Hi,
    In this structure contains base logics of Queue and Stack. Well stack plays major role here with operations of PUSH, POP with additional operation of Queue i.e., ENQUEUE and DEQUEUE.  Here the stack has enqueue and dequeue 
    https://code.msdn.microsoft.com/The-Stacked-Queues-An-11f3703a
    Regards,
    Selva Ganapathy K

  • Software to configure CIFS and NFS on AWS?

    Does anybody have experience with software that will configure CIFS and NFS on Amazon Web Services (AWS)?

    I suggest that you post this question in an AWS community forum available there : https://forums.aws.amazon.com/index.jspa

  • Choppy/Slow streamed videos on both Firefox and Chrome

    I have a 2010 Macbook Pro that was recently turned off for two weeks while I was on vacation. When I turned it back on and tried to watch videos online (youtube, Netflix, streamed videos) the videos are choppy and slow to load. This was never a problem before turning of the computer for the two weeks. I have tried both Google Chrome and Firefox and the problem happens on both. When viewing the Activity Monitor while attempting to watch the videos the CPU usage is fine for the first 20 seconds or so and then Chrome or Firefox take on 80-90-over 100% of the CPU usage, a majority of the usage is from the system (in red) and the videos become untwatchable. I have uninstalled and reinstalled both browsers and have disbaled all the extensions. I have uninstalled and reinstalled Silverlight for Netflix and have uninstalled all unused versions of Adobe Flash player. There are no problems with video when I watch a DVD. Help! I want to watch videos again

    having same problem since mac os x 10.6 upgrade, but was never issue prior... have tried everything i can think of, new flash players, reinstalling players, reboots of computer and router... to no avail. since this was never an issue for me prior to upgrading to Mac OS X (10.6.8), i believe its the os software.

  • Weird issues with file share using both SMB and AFP?

    I use my Xserve with 10.4 server primarily as a file server (with a huge RAID array attached via Ultra320 SCSI). I've served files from this server over SMB ("Windows" sharing) to both PCs and Macs for a few years now with no big issues. The files are being shared in a collaborative environment with extensive user accounts and ACLs set up.
    I would like to turn on AFP for these same file shares, so those accessing with a Mac can have the added benefits of AFP over SMB. However, I've heard some rumors of some complicated issues developing from the use of both AFP and SMB together on the same folders, in a mixed environment.
    The rumors I've heard are things that would happen rarely but enough for it to be significant. For example, a file created over SMB and then edited over AFP would have some problems being re-edited over SMB again, due to some complicated feature that the rumor is unable to explain (something with a resource fork or file locking?). Maybe something weird that just involves the Adobe Creative Suite?
    Anyway, I figured I'd throw this out there. Anyone who serves files over both protocols to a varied set of computers and applications having weird issues? Or is everything working for you? Thanks in advance.
    Message was edited by: dtemp

    Thanks for the responses!
    re:crop
    It's coming in as cropped with no way to fix it that I can see.
    Pressing space or opening in preview shows the full image but if it gets anywhere near Photoshop it comes in auto-cropped.
    I'm starting to this it's a bug and will be reporting it to Adobe.

  • Is there a fix for terrible performance of file transfers using finder via CIFS and SMB?

    I am connecting to an EMC VNXe running Celera file server and am getting abysmal file transfer performance using both CIFS and SMB-  what gives? This seems to be a long-standing issue- any good work-arounds or solutions?

    I rarely see cover art issues unless the cover art embedded in the file is poor to begin with.
    1000x1000 is probably overkill anyway (and if you had several 1000 large cover art images, could eat at AppleTV's memory) though I must admit I always try to get good hi-res images and don't like anything much below 500x500 or 600x600.  There's no hard and fast rule but even a few 300x300 images I have look reasonable at normal viewing distance.
    I wonder as you say if it might be an issue with iTunes for Windows as I'm on OS X.  Actually that reminds me of another issue I have.
    AC

  • My iTunes downloads are really slow on both Windows and iPhone 5

    I've been experiencing slow download speed on both Windows and my iPhone 5.
    I've done a few things like reset my phone network settings, enabled iTunes through my Windows firewall, changed the DNS but none has actually worked out! I really need your help because I'm starting to get really ****** off with how Apple renders its services. On a side note, I've unlimited quota so the speed won't be throttled down. Thank you.

    Unlimited quota does not mean unlimited speed.
    What is the actual download speed from your ISP?  Test it using a site like http://www.speedtest.net

  • Creation of a Single button for both Update and Insert

    Hi,
    I want to create a button which performs both Insert and Update function. As of now i have 2 seperate buttons. Can I combine them in to one by writing a procedure which checks for the data in the database...If the record exists, then it should update the record, if not it should insert...Please guide me
    Regards,
    Pa

    Hi,
    If I am inserting in to the table a new record, how do I check for that column in the table...
    It should work this way..
    I have a list of users in a page, if I click on any user name, it will redirect me to another screen which will allow me to create a record for the selected user name. I want to check the selected user name in the table. If it is already existing then need to update, else insert.
    Regards,
    Pa

  • Deadlocking issue with sshfs and nfs

    Okay, I've used both sshfs and nfs for remotely accessing the home partition on my fileserver, but I have been having a problem where the networking on the server suddenly cuts out.  Any processes that are accessing the folder I mounted nfs/sshfs with become deadlocked.  Any processes that try access my home directory, where the remote folder sits, are also deadlocked.  I cannot get into the machine with ssh.  I have to manually reboot it in order to get any networking at all.
    I have to also force-kill any known processes that are accessing the remote folder, and if I don't know what they are, I have to forcibly unmount it.  This issue has been occuring with this specific fileserver since I got it.  It is running Arch Linux i686, but has had the same problem with the server editions of both Fedora and Ubuntu.
    I don't know where to begin with fixing this problem, nor do I know how to diagnose it.

    Consider "soft" mount option for NFS.

  • Nautilus NFS shares listed under both Devices and Network

    I have several NFS shares from my home server that I mount using fstab.  I am running a fully up to date installation of Gnome 3.12.  However, as my subject indicates, my NFS shares appear under both Devices and Network in Nautilus.  I've done some searching and not found much about this.  It is redundant and most importantly space wasting to have two lists of the same entries.  Is there a way I can eliminate this duplication?  Thanks.
    Here is what I'm using in fstab to mount the shares:
    nfs noauto,x-systemd.automount,x-systemd.device-timeout=10,rw,rsize=32768,wsize=32768,timeo=14,hard,intr,user 0 0

    I indicated that I was trying to mount several NFS shares off my home server.  I should have mentioned that these are NOT NFSv4 shares.  Originally, I had the mount points inside my home folder.  I've since moved them in the /mnt directory and don't have duplicate entries.  Well, I don't have any entries under either Network or Devices.  I've made links to the directories where the NFS shares are mounted.  I was more curious if this was a bug with Nautilus or my own error as having the mount points in my home directory with other file browsers such as Dolphin in KDE did not yield duplicate entries with the same fstab mount options.
    I guess the long and short of it is that if you are using Nautilus, have your NFS mount points outside your home folder.
    Thanks.

  • Cache Flushes Solaris10 StorageTek D280 and NFS and ZFS

    I encounter complains from users, who are connected via nfs, to Sun Solaris10 server.
    The server is connected via Fibre to a Storage Tek d280.
    The performance on the server is okay.
    However, on the , via nfs connected , clients, the performance is poor.
    I found this document, and want to try to disable the cache flushes on the server.
    http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Cache_Flushes
    However, I rather want to have the Storage Tek D280 acting as a nice zfs storage device, rather than tweaking the operating system.
    But I can not find any document on how to configure the behavior of the cache flushes on this device.
    Is there someone who know how to setup this storage tek D280 box correctly to ingnore the Cache Flush commands generated by the NFS ?
    Kind regards,

    806760 wrote:
    Thanks for the response.
    I don't know how the D280 internally has been setup. It should use raid 5. That's about the only thing I know about it.
    It is under control of an ICT department.
    However, the effect, or if the D280 is poor configured, does it only affect the NFS clients connected to the Solaris Server ?
    I have ruled out the network configuration. This is a 1Gb connection. And for diagnose I tryed with a different switch, and direct connection.
    But it did not influence the poor performance of the client, using NFS.
    As a test, I just extract a tar file with a big amount of empty files.
    This goes over 25 times slower on the clients, than on the server.
    I have installed about 8 of those systems, but none is performing so bad.
    Since everything on all systems is about the same configuration, the only things which are out of my control, is the network, and the san.
    I tryed to test the network, but I don't see any problems with that.
    So in my mind, the only thing left, would be the san device.
    Searching on this topic, I found some explanations, about the zfs with nfs, which works poorly, due to the nfs is committing a regular synchronous write (NFS commit) However I don't like to do this.
    I also can not find any description on how to configure a D280.
    It would be nice, if you could provide some settings which has to be set in a D280.
    The configuration is two cluster nodes, and two clients.
    The cluster node mainly task is to provide the nfs shares.
    The clients and servers are in one 19" rack.
    The San, I don't know where it is.
    It has a 2Gb fibre coupling. ( On the server side there are 4Gb Emulex HBA's installed )
    Kind regards,If a tar file extracts 25 times faster on the server then it does over the network, yet both times the data is being written to the SAN LUNs on the D280, the problem is the network.
    That tar file extracts slower across the network for two reasons: bandwidth and latency.
    There's only so much data you can stuff through a gigE network. Your single 1 gigE link can handle about 100 MB/sec read and 100 MB/sec write combined - total. For all users. That may be part of your performance problem, because the configuration LUN layout of that D280 would have to be really, REALLY bad for it to be unable handle that relatively small amount of IO. You CAN test the performance of the LUNs being presented to your server - just use your favorite benchmarking tool to do various reads from the "/dev/rdsk/...." device files that make up your filesystem(s). Just make doggone sure you ONLY do reads - if you write to those LUNs your filesystem(s) will be corrupted. Something like "dd if=/dev/rdsk/... of=/dev/null bs=1024k count=10000" will tell you how fast that one LUN can stream data - but it won't tell you how many IO ops/sec the LUN can support as you'd need to do random small reads to do that. Any halfway-decently configured D280 LUN should be able to stream data at a constant 200 MB/sec while you're reading from it.
    And even if the bandwidth were much higher, you still have to deal with the additional latency of having to do all communications across your network. No matter how fat the pipe is, it still takes more time to send data across the network and have to wait for a reply. What do your ping times look like between client and server? And even with that added latency, there are some things you can do on your hosts. Increase your TCP buffer sizes, mount your filesystems on your Linux clients with the "rsize=32768,wsize=32768,intr,noatime" options, and maybe use NFSv3 instead of NFSv4 - make sure you change both the server and client settings to be sure. And work with your network admins to get jumbo frames enabled. Moving more data per packet is a good way to address latency because you wind up having to wait for a response much fewer times.

  • ISCSI, AFP, SMB, and NFS performance with Mac OS X 10.5.5 clients

    Been doing some performance testing with various protocols related to shared storage...
    Client: iMac 24 (Intel), Mac OS X 10.5.5 w/globalSAN iSCSI Initiator version 3.3.0.43
    NAS/Target: Thecus N5200 Pro w/firmware 2.00.14 (Linux-based, 5 x 500 GB SATA II, RAID 6, all volumes XFS except iSCSI which was Mac OS Extended (Journaled))
    Because my NAS/target supports iSCSI, AFP, SMB, and NFS, I was able to run tests that show some interesting performance differences. Because the Thecus N5200 Pro is a closed appliance, no performance tuning could be done on the server side.
    Here are the results of running the following command from the Terminal (where test is the name of the appropriately mounted volume on the NAS) on a gigabit LAN with one subnet (jumbo frames not turned on):
    time dd if=/dev/zero of=/Volumes/test/testfile bs=1048576k count=4
    In seconds:
    iSCSI 134.267530
    AFP 140.285572
    SMB 159.061026
    NFSv3 (w/o tuning) 477.432503
    NFSv3 (w/tuning) 293.994605
    Here's what I put in /etc/nfs.conf to tune the NFS performance:
    nfs.client.allow_async = 1
    nfs.client.mount.options = rsize=32768,wsize=32768,vers=3
    Note: I tried forcing TCP as well as used an rsize and wsize that doubled what I had above. It didn't help.
    I was surprised to see how close AFP performance came to iSCSI. NFS was a huge disappointment but it could have been limitations of the server settings that could not have been changed because it was an appliance. I'll be getting a Sun Ultra 64 Workstation in soon and retrying the tests (and adding NFSv4).
    If you have any suggestions for performance tuning Mac OS X 10.5.5 clients with any of these protocols (beyond using jumbo frames), please share your results here. I'd be especially interested to know whether anyone has found a situation where Mac clients using NFS has an advantage.

    With fully functional ZFS expected in Snow Leopard Server, I thought I'd do some performance testing using a few different zpool configurations and post the results.
    Client:
    - iMac 24 (Intel), 2 GB of RAM, 2.3 GHz dual core
    - Mac OS X 10.5.6
    - globalSAN iSCSI Initiator 3.3.0.43
    NAS/Target:
    - Sun Ultra 24 Workstation, 8 GB of RAM, 2.2 GHz quad core
    - OpenSolaris 2008.11
    - 4 x 1.5 TB Seagate Barracuda SATA II in ZFS zpools (see below)
    - For iSCSI test, created a 200 GB zvol shared as iSCSI target (formatted as Mac OS Extended Journaled)
    Network:
    - Gigabit with MTU of 1500 (performance should be better with jumbo frames).
    Average of 3 tests of:
    # time dd if=/dev/zero of=/Volumes/test/testfile bs=1048576k count=4
    # zpool create vault raidz2 c4t1d0 c4t2d0 c4t3d0 c4t4d0
    # zfs create -o shareiscsi=on -V 200g vault/iscsi
    iSCSI with RAIDZ2: 148.98 seconds
    # zpool create vault raidz c4t1d0 c4t2d0 c4t3d0 c4t4d0
    # zfs create -o shareiscsi=on -V 200g vault/iscsi
    iSCSI with RAIDZ: 123.68 seconds
    # zpool create vault mirror c4t1d0 c4t2d0 mirror c4t3d0 c4t4d0
    # zfs create -o shareiscsi=on -V 200g vault/iscsi
    iSCSI with two mirrors: 117.57 seconds
    # zpool create vault mirror c4t1d0 c4t2d0 mirror c4t3d0 c4t4d0
    # zfs create -o shareiscsi=on -V 200g vault/iscsi
    # zfs set compression=lzjb vault
    iSCSI with two mirrors and compression: 112.99 seconds
    Compared with my earlier testing against the Thecus N5200 Pro as an iSCSI target, I got roughly 16% better performance using the Sun Ultra 24 (with one less SATA II drive in the array).

  • Have a MacMini that is dropping NFS Share connections, Using cifs://servername/path however the NFS Share is dropped everyday without fail.

    Have a MacMini that is dropping NFS Share connections, Using cifs://servername/path however the NFS Share is dropped everyday without fail.  Is there a better way to setup this share?  I've got 5 other Macs that use the same NFS Share and none of them are dropping the shared connection.  This is on OSX 10.9.x Maverick.

    cifs:// is not NFS cifs:// is effectively SMB i.e. Windows filesharing, NFS is Unix filesharing, furthermore cifs:// is a way of forcing Mavericks to use SMB version 1 protocol. Normally you would use smb:// which will default to trying to use SMB version 2 protocol.
    Saying all that, SMB version 1, SMB version 2, and NFS should all normally work fine. It is possible that the server may be configured to disconnect idle users although one would expect this to happen with other users as well. It is perhaps more likely that your problem Mavericks Mac maybe going to sleep periodically, while asleep the connection to the server maybe being lost. Apple's own server software has specific cleverness to allow clients to sleep and resume their connection when they wake.
    Therefore it might be worth checking your Energy Saver settings on this Mac and disabling computer sleep.

  • Both mail and address book very slow to launch on 10.6 and 10.6.1

    Like unimaginably slow. After clicking on the applications, I was able to perform a google search, find this forum, and and start this thread before either application became active.
    I am running 10.6.1 and have had this problem since 10.6. not before.
    I upgraded my system, I did not install Snow Leopard fresh, and I really hope I dont have to to solve this problem. So much for the speed portion of the Snow Leopard improvements!
    Has anybody else seen this issue? I certainly hope so because it's terrible to have to track down a problem like this alone.
    Message was edited by: almostinverted

    Thank you for this link. Here is the process I used to fix it.
    1 - I had one smart group in address book, with a NOT variable. (if contact is NOT in any group)
    2 - click on the smart folder, wait a long time for it to be selected.
    3 - delete the smart folder
    4 - close address book
    5 - reboot.
    6 - both Mail and Address book now open very quickly. Problem solved
    Thanks again!
    EDIT:
    re-creating the same smart group brings back the same problem!!! So we have broken address book functionality in 10.6? just awesome....
    Message was edited by: almostinverted
    Message was edited by: almostinverted

Maybe you are looking for

  • Month end closing _ production parts local purchase

    Hi Experts, My client wants to closing the month and He wanted to know the possible  Errors may occur FI,,MM,PP side related to local procurement Please reply Thanks in advance Jerry Moderator: If everything is in order, then no errors are anticipate

  • I need validation code for cycle count open interface

    Hi friends i require the validation code for the cycle count open interface . can anybody help me ....... Message was edited by: user506929

  • ISight crashes

    i'm using the built-in iSight on the new MacBook (OS 10.4.7), and for some reason when i use photo booth to take a picture, it crashes. it appears that the OS is still running but the screen goes black and i have to force a restart by holding down th

  • Can't open After Effects on new mac pro

    When I try to open After Effects on my new mac pro it tells me that I cannot use this version of After Effects with this computer. I have the CS6 master collection and all the other apps in the same collection work fine.

  • Reversing changes from production !

    Dear Friends, I have done a successful transport of java change to production system using CMS. Can I revert it back? Can I revert it back to previous of previous? If possible, how can I do it? Documents and links prefered. Thanks in advance, Regards