Very very slow file access iSCSI NSS on SLES11/XEN/OES11

Hi,
Like many Novell customers while carrying out a hardware refresh we are moving off traditional Netware 6.5 to OES11 and at the same time virtualising our environment.
We have new Dell Poweredge 620 serves attached by 10gig iSCSI to Equalogic SAN
Installed SLES will all patches and updates and XEN and then created OES11 SP2 virtual machines, these connect to NSS volume by iSCSI
Migrated files from traditional netware server to new hardware and stated testing and ran into very very slow files access times
A 3.5mb pdf file takes close to 10 minutes to open from local PC with Novell Client installed, same if no client and open via cifs. Opening same file off traditional NW6.5 server takes 3-4 seconds.
We have had a case open with Novell for almost 2 months but they are unable to resolve.
To test other options we installed VMWare ESXi on the internal usb flash drive and booted off that, created same OES11 VM and connected to NSS on SAN and same pdf open in seconds.
The current stack of SLES11/XEN/OES11 is not able to be put into production
Any ideas where the bottleneck might be? We think is in XEN.
Thanks

Originally Posted by idgandrewg
Waiting for support to tell me what the implications are of this finding and best way to fix
Hi,
As also mentioned in the SUSE forums, there is the option of using the Equallogic Hit Kit. One of the tools, next to the great autoconfigure options it has, is the eqltune tool.
Some of the stuff that I've found important:
-gro is known read performance killer. Switch if off on the iSCSI interfaces.
- if possible (meaning you have decent hardware), disable flowcontrol as this generally offers stability but at the cost of performance. If your hardware is decent, this form of traffic control should not be needed.
-To have multipath work correctly over iSCSI and starting SLES 11 SP1. Make sure kernel routing and arp handling are set correctly (not directly relevant if you only have 1 10 GB link):
net.ipv4.conf.[iSCSI interfaceX name].arp_ignore = 1
net.ipv4.conf.[iSCSI interfaceX name].arp_announce = 2
net.ipv4.conf.[iSCSI interfaceX name].rp_filter = 2
Test if traffic is actively routed over both iSCSI interfaces:
ping -I [iSCSI interfaceX name] [iSCSI Group IP EQL]
-Make sure network buffers etc are adequately set as recommended by Dell (set in /etc/sysctl.conf):
#NetEyes Increase network buffer sizes for iSCSI
net.core.rmem_max = 16777216
net.core.wmem_max = 16777216
net.ipv4.tcp_rmem = 8192 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
net.core.wmem_default = 262144
net.core.rmem_default = 262144
-Settings for the /etc/iscsi/iscsid.conf I'm using:
node.startup = automatic # <--- review and set according to environment
node.session.timeo.replacement_timeout = 60
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 20 #Default is 30
node.session.err_timeo.tgt_reset_timeout=20 #Default is 30
node.session.initial_login_retry_max = 12 # Default is 4
node.session.cmds_max = 1024 #< --- Default is 128
node.session.queue_depth = 128 #< --- Default is 32
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072 #A lower value improves latency at the cost of higher IO throughput
discovery.sendtargets.iscsi.MaxRecvDataSegmentLeng th = 32768
node.session.iscsi.FastAbort = No # < --- default is Yes
-Have Jumbo frames configured on the iSCSI interfaces & iSCSI switch.
If you are using multipathd instead of the dm-switch provided with the Equallogic Hit kit, make sure the /etc/multipath.conf holds the optimal settings for the Equallogic arrays.
Ever since Xen with SLES 11 SP1 we have been seeing strong performing virtual servers. We still use 1GB connections (two 1GB connections for each server, serving upto 180~190Mb/s).
There could be a difference with the 10GB setup, where multipath is not really needed or used (depending on the scale of your setup). One important thing is that the iSCSI switches are doing their thing correctly. But seeing you've already found better results tuning network parameters on the Xen host, seems to indicate that's ok.
Cheers,
Willem

Similar Messages

Slow file access - moving toCIFs

We are using OES11 + latest Novell client
Some file access is EXTREEMLY slow
The same Server & Workstations with NO Novell Client installed and CIFs setup is MUCH, MUCH faster
Does login Scripts work in CIFs mode ?

Hi,
What are your NSS settings on your server?
I found that I needed to set the following:
Log in as the root user, then open the /etc/opt/novell/ncpserv.conf configuration file in a text editor. Add the following at the bottom of the file:
OPLOCK_SUPPORT_LEVEL 0
Ive also added: CROSS_PROTOCOL_LOCKS 1
The above is not effective immediately - I can't remember what services I had to restart!
Please let us know how it goes.
Cheers,

Very slow file-access - Opinions?

I have configured a VPN using Cisco 857 routers. There are three sites with two of them being ?spoke? sites and one being the ?hub?. The Hub site also accepts VPN client dial-in.
It all seems to work fine, however I have a question regarding performance more around the available bandwidth than anything. The Hub site is an ADSL router and the upstream connection (which is effectively the other sites downstream connection) is rated at minimum of128kb/s (but I get around 170kb/s of actual file transfer so it?s a fair bit more than that).
The problem is opening files on a Microsoft server across the link is painfully slow. I did a packet capture and to open a 35KB file the traffic back and forward across the MS ?direct hosting? or AD port 445 ends up being around 215KB for the transaction. Talk about overhead!
All other stuff seems to be acceptable across the VPN links e.g. domain authentication, email etc, but then that is either relatively small or not real-time unlike opening your MS Word document. Realistically I guess the available bandwidth is insufficient for this purpose being at best about 60 times slower than a 10MB Ethernet.
What is everybody elses thoughts/experience with this? We can upgrade the plan to a maximum of 512kb/s uplink but I guess the best solution would be a MS terminal server or Citrix server?
Thanks

Thanks, I might look at this technology next time. In the end we put a MS terminal server in for users at the satellite sites to connect to and they are very happy with that performance as its just screen, mouse and keyboard traffic going across the WAN.
BTW if anybodys interested, if you are running SBS2003 you can put in a Windows 2000 server as a terminal server, and you only have to pay for a Windows 2000 server license; user CALS and TS CALS are legally provided by the SBS2003 server (if you use a Windows 2003 server as the TS you have to pay for TS CALS which are really expensive). We did this to keep costs down for our TS solution.
http://go.microsoft.com/fwlink/?LinkId=49921

Time Capsule (A1409): slow file access problem and how do we create a back up of the files on timecapsule?

Time Capsule: We have a model no A1049 our network (installed by someone no longer working with us, so I don't know how it was set up or how to access any settings other than via Airport Utility)
We use it for our central file storage, and as a disk for timemachine backups from the several macs we use here.
The time capsule is running but we have slow access to files, it takes ages to bring up the list of files available, can I fix this?
I have just updated the firmware.
I would also like to know how I can back up these files to another disk.
I have searched the manuals and also the support community but I can't find the answers or any instructions other than the manuals and would appreciate help.
Thank you

The Time Capsule was designed to handle Time Machine backups from one or more Mac computers, and it will work reasonably well for that purpose.
But.....and this is a big BUT......it will not work very well at all if you try to make it act as a file server, since the disk spin up time is quite slow among other things like slow read times from the disk.
Suggest that you get with an IT specialist who can recommend the right file server solution for your network based on your needs.
As far as backing up the data on the Time Capsule, the simplest way to do this is connect a USB drive to the USB port on the Time Capsule and use the built in Archive function in AirPort Utility to make a complete copy of all of the data on the Time Capsule.
Unfortunately, the simplest way is also the slowest and the Time Capsule will not be available for Time Machine backups or file serving during the Archive procedure, which will likely take 4-6 hours or so depending on how much data might be on the Time Capsule. A good time to do this might be late at night, so the Archive copying will run overnight.
Another better option would be to use a commercially available application, like Carbon Copy Cloner to automatically back up the Time Capsule disk each day at a time that you choose. The advantage to doing it this way is that CCC will only back up the changes that have occurred since the last back up, so once the first "master" backup is done, the subsequent "incremental" backups will only take a few minutes each day.
Your IT specialist / consultant will likely have other suggestions for you as well. The advice that we have offered here is meant to be general in nature and not specific to your particular needs.

Slow file access-Elements 12: I store all my photo files (".nef" RAW files) in a RAID 1 external hard drive, which the Elements Organizer links to the reference thumbnails. Over some time - say, the past year, and especially recently, the time to bring

One further bit of information: I did recently run a "disc scan", in case there were file system errors, then ran defragmentation -- on the external drive. This did not solve the problem.

I think I'll deal with your different questions in several posts, it'll be easier for me.
josephunit2n a écrit:
A few comments: recently, for the first time, I did a full "backup catalog" routine (with external RAID storage connected) to a second external usb drive, which ran successfully (done, at the time, over longstanding concern that even the RAID 1 storage was not enough data security - as you have mentioned).
Good thing, and it's not really a surprise for me, I would have expected no slow down in a process which only reads your RAID drive data.
One big concern: in all transactions (backup catalog; move to external storage) I always ignore the "reconnect missing files" dialogue. This is due to past experience. Long ago, when I ran it routinely, it was a disaster. At first, I thought I might reconnect a few randomly missing files. While this was so long ago I cannot recall all details, everything went to hell. Even after manually locating a "missing" file, the "reconnect" never worked. The number of "missing" files skyrocketed, far out of any realistic number. Even with Adobe phone support (which is critical for such an application - and must be made available again, I have no problem paying for it), the catalog was hopelessly corrupt, and I manually built a new catalog, file-by-file. Adobe advice then: NEVER USE "RECONNECT MISSING FILES", which I have followed religiously (while also trying to be meticulous in my transactions, not to ever create any "missing" files).
I have never read Adobe advising to never reconnect missing files. Maybe it's not the best course in all circumstances, but I don't see a possible problem there. What is recommended by Adobe is to always reconnect files before doing a backup... Now, my own experience is that if you don't reconnect before a backup you get a restoration where the catalog still points to missing files and where those missing files have not been backed up, totally logical. I would not consider this question as a BIG concern.
. Finally, "just for fun", moments ago I connected the RAID storage drive, opened the organizer, and randomly opened a few images in "full screen" view - then opened a scattered group of 4 or 5 images -- and, they all came up promptly!!!!! So, this "slow access" problem isn't consistent, all the time. Also, I must comment, your advice to avoid the RAID 1 external usb drive, for future catalog storage, seems "tech superstition", which I will not harshly criticize, as I also have my own technology irrational superstitions. I believe the computer "sees" this drive no differently than any other external, usb, drive.
There's a difference between 'technology irrational superstition' and 'reasonable doubt due to ignorance' ... Understanding the problems which may arise when using a RAID drive array supposes understanding of:
- how the organizer catalog recognizes any drive in its database. That's ok for me, but I have no personal experience of such systems. What I can tell you is that most of the problems I have seen with RAID systems were of that kind.
- How efficiently the organizer deals with the OS when using a catalog stored on the main drive, with adequate RAM and scratch disk space while the files themselves are on the external RAID drive. Some organizing tasks imply writing to the files themselves. The xmp sidecar files (very small) are stored together with their raw parent. The thumbnails are stored in a database in the catalog folder...
- How the organizer works with the OS (the APIs) and the particular disk driver. (I am totally ignorant, but I have seen similar problems for other Adobe applications in the feedback forum).
... As I said, I have to leave for a moment...
To be continued!

Slow file access

I have a class that just does some trace logging and it is extremely slow
          when used with a servlet, but is very fast when used otherwise. The class
          is basically just the following:
          Date date = new Date();
          SimpleDateFormat formatter = new SimpleDateFormat ("MM/dd/yyyy HH:mm:ss");
          DataOutputStream dos = new DataOutputStream( new
          ileOutputStream( logFileName, true ) );
          dos.writeBytes( formatter.format(date)+" "+logIdStr+" "+msg+"\r\n" );
          dos.close();
          I added a flag that would skip around all the logic in the write method of
          this class so I could time the servlet without it and found it takes 10
          seconds longer to run the servlet with this logic being run to create a
          couple thousand traces. Any idea why it would be so slow?


May be this is because the DataOutputStream class is intended to write
          java primitive types in a binary portable format, so it could make CPU
          intensive checking and conversion ?
          For textual output, it should be better to use PrintWriter.
          Can you check CPU usage ? You can download OptimizeIt! and profile your
          code.
          Note also you open and close a file. How is your disk's fragmentation ?
          Finally it is more efficient to use a StringBuffer to produce the output
          string before passing to a method.
          David Thompson wrote:
          >
          > I have a class that just does some trace logging and it is extremely slow
          > when used with a servlet, but is very fast when used otherwise. The class
          > is basically just the following:
          > Date date = new Date();
          > SimpleDateFormat formatter = new SimpleDateFormat ("MM/dd/yyyy HH:mm:ss");
          > DataOutputStream dos = new DataOutputStream( new
          > ileOutputStream( logFileName, true ) );
          > dos.writeBytes( formatter.format(date)+" "+logIdStr+" "+msg+"\r\n" );
          > dos.close();
          > I added a flag that would skip around all the logic in the write method of
          > this class so I could time the servlet without it and found it takes 10
          > seconds longer to run the servlet with this logic being run to create a
          > couple thousand traces. Any idea why it would be so slow?

It's very slow to access file server after installed SP1 of Win7.

I found it's become very slow to access shared files on file server after installed win7 SP1, (windows6.1-KB976932-X86.exe), access same file, the win7 without sp1 is fast in 5 secs, but the pc with sp1 need more than 30 secs. And
I tried to removed the sp1, everything goes fine, access fast as others.
I don't understand what's the reason and which feature affected it, I believe the sp1 can help Win7 be more safety, but why the performance on it get worse.
And I didn't find the same question or tips on forum or website, do you really haven't the issue?
Arnold From Shanghai, China
Arnold Yu

Hi Arnold,
Windows 7 Service pack and any other Windows Updates are released to improve the performance, reliability and security of the system.
Firstly please run the performance troubleshooter:
Open the Performance troubleshooter
http://windows.microsoft.com/en-US/windows7/Open-the-Performance-troubleshooter
If it doesn't resolve the issue, Put the computer in
Clean Boot and then check to see if the issue persists.
If it still persists, please use performance monitor to trace your computer's performance:
Performance Monitoring Getting Started Guide
http://technet.microsoft.com/en-us/library/dd744567(v=ws.10).aspx
Karen Hu
TechNet Community Support

Aloha, I have a CD-Rom from 2001 that i very much want to access but cannot because i no longer have "classic." There are a variety of video and text files. What is the best way to convert? Any help is greatly appreciated. mahalo.

Aloha, I have a CD-Rom from 2001 that i very much want to access but cannot because i no longer have "classic." There are a variety of video and text files. What is the best way to convert? Any help is greatly appreciated. mahalo.

Buy a cheap older Mac like an iMac.
 Cheers, Tom

My iphone 3g is very slow when accessing the internet is there anyway i can improve this

my iphone 3g is very slow when accessing the internet is there anyway i can improve this

What have you done thus far to try and remedy your situation? Have you taken the recommended basic troubleshooting steps outlined in the User Guide?

Since updating my iPad 2 to ios8, it safari has been slow and crashing and some of the apps acting wierd. The password app doesn't work at all so had to find another way of retrieving all my passwords. Very very dissapointing

Since updating my iPad 2 to ios8, it safari has been slow and crashing and some of the apps acting wierd. The password app doesn't work at all so had to find another way of retrieving all my passwords. Very very dissapointing. It appears from these forums that a lot of people are having the same problems wit this latest update.

Hi erastyle,
Actually the Licensing information for the package is missing hence it is not launching any applications. You need to Reserialize the products using APTEE which you can find it on the Machine where you have created the package. If you dont have the access to that Machine then please download and install Creative Cloud Packager and it will download APTEE in the below mentioned location.
Windows:
C:\Program Files (x86)\Common Files\Adobe\OOBE\PDApp\CCP\utilities
Once downloaded please follow this KB article to use the Tool.
http://helpx.adobe.com/creative-cloud/packager/provisioning-toolkit-enterprise.html
Please let us know if it helps.
Regards,
Abhijit

Windows Users file access SLOW

XServe 10.4.11
Connecting to my Home Directory with a XP machine. I can see all my files, but it takes forever to open them.
Launching AppleWorks 6 on the PC is fine, but opening a document off the server takes over 120 seconds to display. During the time it is 'trying' to open, it seems the PC is locked up.
This is happening on all our PCs as well. Our Macs have no problems opening the same files.
The same slow network access is happening when the PCs try to open Word documents stored on the Server as well.
What settings can I tweak (from the defaults) to allow my PC users to access their documents off the server?
We were hoping to eliminate the Netware Servers at our High School, but this test we are doing at our Adm Bldg is NOT going very well at all.

That wasn't it. Documents on PCs still take a LONG time (opening an AppleWorks 6 document for example on a PC took over 1 minute).

Slow android file access time

Hello,
My app is working very well on ios and I am trying to get it to work right in Android. The problem I am having now is that file access is very slow. Little 30 kilobyte audio files hang the program for a couple of seconds. Is this the current state of android? Looks like the kindle is going back to office depot.

I am not certain but it looks like my problem is audio file speciffic. I've read that the latency of android audio is poor but in the latest beta there is a low latency sound api. Is there anything I can do to improve the sound latency in android? If so how do I do it?

Tutorial project runs very very slow.

Hello,
I have just started to work with OAFramework and I am trying to execute the tutorial project. After configurating all my enviroment I am able to run properly this project with "Run > Run test_fwktutorial.jsp" but the problem is that it runs very very slow. It takes at least 5 minutes to load the "Hello World!" and the same time to load the other pages.
We work with Patch Jdeveloper 5455514 and our system is Oracle Applications 11.5.10 RUP4.
We are connected to our system via a VPN client. Could it be the reason for this poor performance or are there other things I shoud have to modify?
Thanks in advanced,
Xavier

Hi Xavier,
There can be multiple reasons why the Jdeveloper is very slow. VPN might be one of them. Try accessing the Oracle Applications using the VPN connectivity and observe the speed. Try to do some transaction and notice whether database is slow or not. You can also double click the jpx file and check for the db connectivity by clicking on 'Test Connection' and see how much time it takes. The other reasons why the Jdeveloper is slow might be because you have multiple projects opened. You can also try to close the Jdeveloper session and restart again by deleting the myclasses and systems folder.
See whether one of these approaches help.
Thanks

HT204406 I am having a very difficult time with accessing my music from the cloud. I need to have itunes open on my laptop in order for it to work. And as soon as I close out itunes on my laptop, it gives me a warning that all users will be logged out.

I am having a very difficult time with accessing my music from the cloud. I need to have itunes open on my laptop in order for it to work. And as soon as I close out itunes on my laptop, it gives me a warning that all users will be logged out. Help!!!

Where are iTunes files located?
No, I do not mean just the music. Copying just the media/music files or the media folder creates problems.

Today, I randomly happened to have less than 1GB of hard drive space left. I found very large "frame" files, what are they?

I found very large "frame" files, what are they & can I delete them? (See screenshot). I'm a (17 today)-year-old film-maker and can't edit in FCP X anymore because I "don't have enough space". Every time I try to delete one, another identical file creates itself...
If that can help: I just upgraded to FCP 10.0.4 and every time I launch it it asks to convert my current projects (I know it would do it at least once) and I accept, but everytime I have to get it done AGAIN. My computer is slower than ever and I have a deadline this friday
I also just upgraded to Mac OS X 10.7.4, and the problem hasn't been here for long, so it may be linked...
Please help me!
Alex

The first thing you should do is to back up your personal data. It is possible that your hard drive is failing. If you are using Time Machine, that part is already done.
Then, I think it would be easiest to reformat the drive and restore. If you ARE using Time Machine, you can start up from your Leopard installation disc. At the first Installer screen, go up to the menu bar, and from the Utilities menu, first select to run Disk Utility. Completely erase the internal drive using the Erase tab; make sure you have the internal DRIVE (not the volume) selected in the sidebar, and make sure you are NOT erasing your Time Machine drive by mistake. After erasing, quit Disk Utility, and select the command to restore from backup from the same Utilities menu. Using that Time Machine volume restore utility, you can restore it to a time and date immediately before you went on vacation, when things were working.
If you are not using Time Machine, you can erase and reinstall the OS (after you have backed up your personal data). After restarting from the new installation and installing all the updates using Software Update, you can restore your personal data from the backup you just made.

Very very slow file access iSCSI NSS on SLES11/XEN/OES11

Similar Messages

Maybe you are looking for