Windows 2012 Nodes - Slow CSV Performance - Need help to resolve my iSCSI issue configuration
I spent weeks going over the forums and the net for any publications and advice on how to optimize iSCSI connections and i'm about to give up. I really need some help in determining if its something i'm not configuring right or maybe its an equipment
issue.
Hardware:
2x Windows 2012 Hosts with 10 Nics (same NIC configuration) in a Failover Cluster sharing a CSV LUN.
3x NICs Teamed for Host/Live Migration (192.168.0.x)
2x NICS teamed for Hyper-V Switch 1 (192.168.0.x)
1x NIC teamed for Hyper-V Switch 2 (192.168.10.x)
4x NICs for iSCSI traffic (192.168.0.x, 192.168.10.x, 192.168.20.x 192.168.30.x)
Jumbo frames and flow control turned on all the NICs on the host. IpV6 disabled. Client for Microsoft Network, File/Printing Sharing Disabled on iSCSI NICs.
MPIO Least Queue selected. Round Robin gives me an error message saying "The parameter is incorrect. The round robin policy attempts to evenly distribute incoming requests to all processing paths. "
Netgear ReadyNas 3200
4x NICs for iSCSI traffic ((192.168.0.x, 192.168.10.x, 192.168.20.x 192.168.30.x)
Network Hardware:
Cisco 2960S managed switch - Flow control on, Spanning Tree on, Jumbo Frames at 9k - this is for the .0 subnet
Netgear unmanaged switch - Flow control on, Jumbo Frames at 9k - this is for .10 subnet
Netgear unmanaged switch - Flow control on, Jumbo Frames at 9k - this is for .20 subnet
Netgear unmanaged switch - Flow control on, Jumbo Frames at 9k - this is for .30 subnet
Host Configuration (things I tried turning on and off):
Autotuning
RSS
Chimney Offload
I have 8 VMs stored in the CSV. When try to load all 8 up at the same time, they bog down. Each VM loads very slowly and when they eventually come up, most of the important services did not start. I have to load
them up 1 or 2 at a time. Even then the performance is nothing like if they were loading up on the Host itself (VHD stored on the host's hdd). This is what prompted me to add in more iSCSI connections to see if I can improve the VM's
performance. Even with 4 iSCSI connections, I feel nothing has changed. The VMs still start up slowly and services do not load right. If I distribute the load with 4 VMs on Host 1 and 4 VMs on Host 2, the load up
times do not change.
As a manual test for file copy speed, I moved the cluster resources to Host 1 and copied a VM from the CSV and onto the Host. The speed would start out around 250megs/sec and then eventually drop down to about 50/60 megs/sec. If I turn
off all iSCSI connections except one, it get the same speed. I can verify from the Windows Performance Tab under Task Manager that all the NICS are distributing traffic evenly, but something is just limiting the flow. Like what I stated on top,
I played around with autotuning, RSS and chimney offload and none of it makes a difference.
The VMs have been converted to VHDx and to fixed size. That did not help.
Is there something I'm not doing right? I am working with Netgear support and they are puzzled as well. The ReadyNas device should easily be able to handle it.
Please help! I pulled my hair out over this for the past two months and I'm about to give up and just ditch clustering all together and just run the VMs off the hosts themselves.
George
A few things...
For starters, I recommend opening a case with Microsoft support. They will be able to dig in and help you...
Turn on the CSV Cache, it will boost your performance
http://blogs.msdn.com/b/clustering/archive/2012/03/22/10286676.aspx
A file copy has no resemblance of the unbuffered I/O a VM does... so don't use that as a comparison, as you are comparing apples to oranges.
Do you see any I/O performance difference between the coordinator node and the non-coordinator nodes? Basically, see which node owns the cluster Physical Disk resource... measure the performance. Then move the Physical Disk resource for the
CSV volume to another node, and repeat the same measure of performance... then compare them.
Your IP addressing seems odd... you show multiple networks on 192.168.0.x and also on 192.168.10.x. Remember that clustering only recognizes and uses 1 logical interface per IP subnet. I would triple check all your IP schemes...
to ensure they are all different logical networks.
Check you binding order
Make sure you NIC drivers and NIC firmware are updated
Make sure you don't have IPsec enabled, that will significantly impact your network performance
For the iSCSI Software Initiator, when you did your connection... make sure you didn't do a 'Quick Connect'... that will do a wildcard and connect over any network. You want to specify your dedicated iSCSI network
No idea what the performance capabilities of the ReadyNas is... this could all likely be associated with the shared storage.
What speed NIC's are you using? I hope at least 10 GB...
Hope that helps...
Elden
Hi Elden,
2. CSV is turned on, I have 4GB dedicated from each host to it. With IOmeter running within the VMs, I do see the read speed jumped up 4-5x fold but the write speed stays the same (which according to the doc it should). But even with the read
speed that high, the VMs are not starting up quickly.
4. I do not see any difference with IO with coordinator and non coordinator nodes.
5. I'm not 100% sure what your saying about my IPs. Maybe if I list it out, you can help explain further.
Host 1 - 192.168.0.241 (Host/LM IP), Undefined IP on the 192.168.0.x network (Hyper-V Port 1), Undefined IP on the 192.168.10.x network (Hyper- V port 2), 192.168.0.220 (iSCSI 1), 192.168.10.10 (iSCSI2), 192.168.20.10(iSCSI 3), 192.168.30.10 (iSCSI 4)
The Hyper-V ports are undefined because the VMs themselves have static ips.
0.220 host NIC connects with the .231 NIC of the NAS
10.10 host NIC connects with the 10.100 NIC of the NAS
20.10 host NIC connects with the 20.100 NIC of the NAS
30.10 host NIC connects with the 30.100 NIC of the NAS
Host 2 - 192.168.0.245 (Host/LM IP), Undefined IP on the 192.168.0.x network (Hyper-V Port 1), Undefined IP on the 192.168.10.x network (Hyper- V port 2), 192.168.0.221 (iSCSI 1), 192.168.10.20 (iSCSI2), 192.168.20.20(iSCSI 3), 192.168.30.20 (iSCSI 4)
The Hyper-V ports are undefined because the VMs themselves have static ips.
0.221 host NIC connects with the .231 NIC of the NAS
10.20 host NIC connects with the 10.100 NIC of the NAS
20.20 host NIC connects with the 20.100 NIC of the NAS
30.20 host NIC connects with the 30.100 NIC of the NAS
6. Binding orders are all correct.
7. Nic drivers are all updated. Didn't check the firmware.
8. I do not know about IPSec...let me look into it.
9. I did not do quick connect, each iscsi connection is defined using a specific source ip and specific target ip.
These are all 1gigabit nics, which is the reason why I have so many NICs...otherwise there would be no reason for me to have 4 iscsi connections.
Similar Messages
-
Yosemite made my MacBook Pro so slow !! Need help ? what is the solution?
Yosemite made my MacBook Pro so slow !! Need help ? what is the solution?
I've ran a benchmark on my Mac (iMac early 2009). Performance of Yosemite in general was about the same as Mavericks. But that can be different on other Mac's of course. Safari is mostly a bit slower. It's recommended you clean your old internet-caches and then restart Safari. (you can use a little app called CCleaner to do that). That might make a difference. Speed-issues are usually solved in the first and second update of OS X.
-
Just pick up the new HP Envy D411a printer, i set up with my wi-fi and all was going well until i put the disk in my PC . Just to find out that my NEW printer will not work with the Windows 8 Consumer Preview . I need help with this or until UP update the new printer to work with Windows 8, which will be on the market soon. Can some one please HELP ME
Available now is print and scan capability that HP worked with Microsoft to include into Windows 8.
The Printer Install Wizard can provide you additional information:
http://h30434.www3.hp.com/t5/Windows-8-Consumer-Preview/How-to-Get-Your-Inkjet-Printer-Working-with-...
If I have helped you solve your issue please mark it as solved .....
(I am an HP employee) -
I need help in resolving a problem that prevents me from accessing the iTunes store. Message reads " iTunes cannot contact the iTunes store" and also says that my laptop is no longer authorized to access my account. Help!
Go up to the top of your screen on iTunes and click on 'Store'. Then go down to 'Authorize This Computer'. That should cover part of it unless you've already authorized a bunch of other computers to use your account. If that's the case, you'll have to go to one of those computers and click the button just below it to 'deauthorize your account' from that computer. If you're not able to access the store, check your internet connection to make sure you are connected. Hope this helps.. good luck!
-
Hyper-V Windows 2012 r2 Poor network performance
Hi,
Since that I installed Windows 2012 R2 and Hyper-v, I notice that is very slow performing copy operations from the VMs to the physical machine (appears to be lock to 10MB). Firs I though that this issue was only between the VMs and the parent OS, now I realized
that when copying between this Hyper-v physical host and another physical host in the same subnet I also get only 10MB of speed.
How do I unlock this 10MB limit??
The switch and all NICs are GIGABIT capable and before using Windows 2012 r2, using the same hardware boxes I was doing 400MB of transfers between physical hosts and VMs??!!
Thank you.I had the exact same issue with the same AR8151 NIC on my Alienware, only I'm running Windows 8.1.
I have a VM with both an external (to the AR8151) and an internal NIC which serves as both a domain controller and router (RRAS) for my other VMs (which only have Internal interfaces). There is no VMQ setting on the adapter, and I messed around with
the offload/RSS settings, but performance would drop whenever this VM would be running. (Internet speed test would go from 95Mbps downstream to about 24Mbps.). When I paused or shut down the VM, performance would return to normal.
I found the issue to be an errant entry in my route table which I have no idea how it happened. A second default route was created which used the internal IP of the VM with a lower metric. Simply deleting the route corrected the performance issue.
Network Destination Netmask Gateway Interface Metric
0.0.0.0 0.0.0.0 10.10.1.200 10.10.2.1
5
0.0.0.0 0.0.0.0 192.168.1.1 192.168.1.131 10
10.10.0.0 255.255.0.0 On-link 10.10.2.1 261
10.10.0.0 255.255.0.0 192.168.1.200 192.168.1.131 11 -
Windows phone error code 80188301,. please need help
i am getting an error while updating my windows phone. windows phone error code 80188301,.
please need helpHi,
If issue persists after using the solutions provided by Aman Raizada, then I would suggest you ask the question in Windows Phone support forum:
http://www.windowsphone.com/en-US/how-to/wp-support
Regards
Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact [email protected] -
Re: HP 255 microphone troubles.
Sorry! I typed "Windows XP" in the original heading, My bad!
NEED HELP IMMEDIATELY!!!
When I click on the Sound Icon in the lower right corner of the screen and select "Mixer" THERE IS NO MICROPHONE CONTROL!
I've gone into the Control Panel searching for it, typed "microphone" in the "Search" box at the upper right of the screen and...NOITHING!
THE MICROPHONE IS CAUSING A NASTY UNGROUNDED-LIKE SOUND WHICH IS QUITE LOUD.
I CANNOT RECORD VOICE OVERS (MY BREAD & BUTTER) WITH THIS INTERFERENCE! The internal microphone MUST BE MUTED/DISABLED OR DELETED!!
How do I go about doing this? I have deadlines to meet. This is a matter of utmost importance!
Your reply via Email would be appreciated greatly.
Thank You!,
VOArtist
This question was solved.
View Solution.Try this:
Follow these steps to disable the built-in microphone.
a. On the extreme right side of the Task Bar, right-click on the Speakers symbol and select Sounds.
b. In the Recording Tab, right-click on the microphone and select Disable.
c. Click on OK.
d. If there is more than one, disable all.
Check if the issue is resolved.
If you want to enable the microphone, follow these steps:
a. On the extreme right side of the Task Bar, right-click on the Speakers symbol and select Sounds.
b. In the Recording Tab, right-click on empty space and select Show Disabled Devices.
c. Right-click on the microphone and select Enable.
d. Click on OK. -
My computer will not open Windows Vista.. I get a disc boot error. I have run a few diagnostics but need help to preceed. Have important files on the computer I need access to. Can anyone help walk me through the process? Thanks Also when I look at the check s that have been done it says something about a registry problem. HP Pavilion a 6863w
{Edited for privacy}Have you run a Hard Drive test in BIOS?
Jennifer P
I work for HP.
Please select the "Accept as Solution" button on the post that best answers your question. Also, you may select the "Kudos" button on any helpful post to give that person a quick thanks -
My Mac Won't Read Windows XP Pro Disk T_T I Need Help...
My Mac will not read my XP Pro disc. It is not an original but it is an exact copy that runs perfectly on a PC. I have been told by a number of people that there is no reason that it won't work. I simply tell Boot Camp Assistant to start the installer and it says it can't find the installation disk. Is there something wrong with my computer???
On the offensive, eh? For the record, I wasn't trying to bash you, I simply read your posts and they all gave off the same "hate" for Boot Camp, so I thought I would inquire a little further into the matter.
If you can't load Windows and you want to eject the disc, press the alt/option key at start up, select your Mac partition and eject the disc from there. Sure, an eject button could come in handy at times, but aesthetics are also a big part of any Mac computer. A big honking eject button on an otherwise smooth surface would be rather obtrusive. Even if you did have an Apple Keyboard, and Windows wouldn't load, you still wouldn't get anywhere because you wouldn't have any Apple Keyboard driver to acknowledge the eject button is even there, unless you quickly pressed it at the white boot screen, and I'm not even sure if that would work.
"You've loaded "tons" of windows on your mac, and did not have a problem...I gather that I've seen your "helpful and insightful" Mac directions, somewhere here on these forums, guiding Windows users to the answer, correct?"
Is this an insult? I'm not sure... Yeah, I've helped people with their problems on here... man, I must be a real ****.
"I may appear to be a fanboy of PC's too you, but at least we PC users can get help somewhere on the internet, that other users can relate with and point us in the right direction..."
http://discussions.apple.com
"Apple-ites seem to want to bash people who LIKE the ease of Windows (and common-sense buttons on our hardware, called Eject!)"
When did I bash any Windows/PC hardware or software? If I wanted to bash Windows, why would I have it installed on my Mac? I'm sure there are a few buttholes on this forum that are, "omg y wud u install Windoz on Mac, u'll ruin ittuhh!1!!!one!", however, the majority of the people on the forum are rather kind and will attempt to help with whatever problem you/someone may have. Again, a big part of Macs are aesthetics.
"if we happen to spend our dollars on a mac, the least you guys can do is APPRECIATE that we are trying to gravitate to the mac, but are having problems UNDERSTANDING decades of your culture...instead of finding fault in every little question on the mac's difficult usage and expecting us to humble ourselves for a little insight to our problem!"
How are you supposed to find a solution if you can't find the fault? The user controls the computer, more often than not, it's the user that makes the mistakes, the computer doesn't just mess itself up. (not accusing you or anything, just saying.)
Again, this wasn't an attempt to bash, but going around claiming Boot Camp is trash isn't the best way to introduce yourself. Boot Camp on the Mac side doesn't even really do anything, simply partitions the hard drive. On the Windows side, it simply installs drivers. There's nothing to really hate.
If you'd like help with your Windows problems, I'd be glad to help, only if you choose to open your mind, accept help and not think of it as "ridiculing" or "finding faults". -
Need help on diagnosis of Graphics Issue
Hello,
I need help to determine if I am experiencing a graphics card issue and what my options are if there are any experts out there I would appreciate some feedback.
*My system info:*
Model Name: Mac Pro
Model Identifier: MacPro2,1
Processor Name: Quad-Core Intel Xeon
Processor Speed: 3 GHz
Number Of Processors: 2
Total Number Of Cores: 8
L2 Cache (per processor): 8 MB
Memory: 4 GB
Bus Speed: 1.33 GHz
Chipset Model: NVIDIA GeForce 8800 GT
Type: Display
Bus: PCIe
Slot: Slot-1
PCIe Lane Width: x16
VRAM (Total): 512 MB
Vendor: NVIDIA (0x10de)
Device ID: 0x0602
Revision ID: 0x00a2
ROM Revision: 3233
*Description of Issue:* When playing 3D video games (i.e. Mass Effect 2 or Dragon Age) everything visually is fine for about 20 seconds and then I start to see pixelization (snow), texture anomalies and system freezes where mouse stops moving. It gives time slices occasionally so sometimes I can Alt + tab out of game and close it. Or the entire system just crashes. I think what is going on is some loop that is pegging either the CPU(s) or GPU.
Everything was working fine up until last night. I had been playing the games without issue. I am playing these games on Windows XP and Vista using Boot Camp.
This initially occurred on Windows XP playing Mass Effect 2.
These are the steps I took which essentially tell me it is not a software issue:
- Tested on another game Dragon Age (same result)
- Updated to latest Nvidia drivers (same result)
- Tested on separate Boot Camp Windows Vista with Dragon Age game (same result)
These results lead me to believe I may have a broken graphics card? But I want to be certain before I go out and purchase a new one.
*My Questions:*
- Is there some software to verify if my graphics card is shotty?
- Is re-seating the graphics card or memory worth trying?
- Cleaning the dust out of my machine?
- If I need a new graphics card, what are my options? Do I have to purchase it via Apple store? I would like to stick with an Nvidia card so am I stuck buying the same card I currently have or can I upgrade?
If anyone can help me I would greatly appreciate it.
Thank you,
LeapstepmanIs there some software to verify if my graphics card is shotty?
Techtool Pro has some testing, the AHT tests VRAM, but game benchmarks and stressing will tell you the most.
Is re-seating the graphics card or memory worth trying?
Absolutely. Just don't reinstall the graphics card until you clean it thoroughly.
Cleaning the dust out of my machine?
YES. A dust filled graphics card heatsink will cause the GPU to cook, and cause problems thet you describe.
If I need a new graphics card, what are my options? Do I have to purchase it via Apple store? I would like to stick with an Nvidia card so am I stuck buying the same card I currently have or can I upgrade?
You don't have to buy from Apple, but using with OS X limits your choices to Mac compatible or flashable PC versions.
There is an awful lot of user input into this topic here:
http://blog.macsales.com/602-testing-those-new-graphics-cards
Card reviews can also help:
http://www.anandtech.com/video/showdoc.aspx?i=3140&p=9
http://www.tomshardware.com/reviews/radeon-hd-4870,1964.html -
Hi i need help sap r/3 service order configuration in detail plz
hi
my client has agency business for i need configuration step by step. i need information on service orders how to configure itIf you haven't already done so then try the troubleshooting for that error code on this page : Apple software on Windows: May see performance issues and blank iTunes Store
Or there is this which appears to have worked for a number of people : error iTunes Store : 0x80090318 (the solution). -
Need help scripting the Essentials Server Backup configuration in PowerShell
I'm trying to write a PowerShell script that automates the setup and configuration of the Server Backup feature within WS2012 R2 Essentials. There are a number of cmdlets for defining the backup source files and target location such as add-wssbackuptarget,
add-wssbackupvolume, new-wssbackuptarget, etc.
These cmdlets all have a required -Disk parameter and I can't for the life of me figure out the syntax for it. I've tried the disk ID, drive letter, LUN, volume label, and disk number. All of the examples in the help files are using variables instead of
explicitly entering a value; I've tried using the example scripts and those fail too.
So here's a quick example:
Get-WssBackupPolicy | Add-WssBackupVolume -Disk ??
I obviously need more parameters than that but the point is, no matter what other parameters I type and no matter what I enter for the value of -Disk, I always get "Cannot bind parameter 'Disk'. Cannot convert the "D:\" (or whatever I've entered)
value of "System.String" to type "Microsoft.WindowsServerSolutions.DataProtection.ServerBackup.ObjectModel.BackupDisk".
And like I said in the opening paragraph, I get that same error for any and all cmdlets that use the -Disk parameter. Does anyone know how to properly structure format the -Disk value?
ThanksDon't worry I wasn't sure as well, I had to raise a SR to understand it too!
I have a similar set up to yours and have webutil working successfully.
What you need to do is to install and configure your application server on unix for webutil as well as windows.
From your post I see you are already reading the docs. Within chapters 2 and 3 both of which are titled "configuring web util", you will see points that refer to the application server, these are the ones that you need to follow.
Good luck -
Need help in resolving J2EE Deployment SPI error BEA-260101
I have a portal application (ear) currently working on weblogic 10.2. I upgraded my project to 10.3 using workshop, then made an ear and deployed it on 10.3
The following error is being displayed on 10.3.
+<Error> <J2EE Deployment SPI> <BEA-260101> <Parameter 'DDBeanRoot' may not be null.>+
Any help in resolving this will be highly appreciated.Hi,
The following is the description of the error :-
BEA-260101 Error: Parameter 'paramName' may not be null.
Description Misuse of an API
Cause A null parameter was passed to the method.
Action Resolve client programming error
Link:[wls/docs100/messages/SPIDeployer.html]
Hope this helps :) -
Needs to be resolved ipod 5 issue
I am posting this from my computer bcuz my iPod touch 5g just wont turn on or charge. If i press the home button, th siri noise will work but the display is black, i ant put it into dfu mode, sync it with itunes, charge it with my ihome or adapter/charger for that matter. I us my ipod a lot just like a phone. i need help. i havent dropped my ipod without a good, protective case on b4. i got it in nov. 2013 and its feb. 5 2014 now it was workiing fine and is on ios 7. it jus wont work. pleae help!!
If you restored to factory settings/new iPod via iTunes (Not via Settings>General>Reset>Erase all Content and Setting) and still have the problem that indicates a hardware problem.
Make an appointment at the Genius Bar of an Apple store..
Apple Retail Store - Genius Bar -
Windows 7 Extremely Slow in Bootcamp. Help!?
Hi all
So i recently installed a 64 bit windows 7 partition on to my late 2011 13" macbook pro. The problems. WELL! i reinstalled the OS multiple times as each time, booting and opening applciations was SUPER sluggish and took minutes to open anything. it was fine when i first installed windows, however after playing a game on steam, it has seemed to slow down. a lot. is this a hardwar problem that can be solved? Bootcamp is just really slow to boot!
Specs:
-i7 2.8ghz processor
-4gb ram
-some decent graphics card (i dunno?)
Thanks guys!
best,
Haydonny.In order to diagnose your problem you will need to download and install the below
Install the WPT (Windows Performance Toolkit)
http://www.microsoft.com/en-us/download/details.aspx?id=30652
Help with installation (if needed) is here
When you have, open an elevated command prompt and type the following
WPRUI.exe (which is the windows performance recorder) and check off the boxes for the following:
First level triage (if available), CPU usage, Disk IO.
If your problem is not CPU or HD then check off the relevant box/s as well (for example networking or registry) Please configure yours as per the below snip
Click Start
Let it run for 60 secs or more and save the file (it will show you where it is being saved and what the file is called)
Zip the file and upload to us on Onedrive (or any file sharing service) and give us a link to it in your next post.
Wanikiya and Dyami--Team Zigzag
Maybe you are looking for
-
The order of fields in imported pdf file
when i import a form i designed in indesign, the order of teh fields are not as i would like, i cant see any issue why the order would differ from the form. how can i deal with this? is there a way to force and order. Can i move the columns even in
-
Error nv4_mini.sy_ while installing display driver on Satellite
When running set up program I get error message concerning file nv4_mini.sy_ . Message says Unable to copy the file. I get the driver from Toshiba website; I downloaded the program driver and ran it; I did twice even in safe mode after removing old d
-
My laptop is running Microsft Vista Home Premium 32 bit and I have downloaded iCloud but whilst the files are in the directory it has not loaded so its not available in the start menu. grateful for any ideas or suggestions?
-
My computer tells me I don't have iPhoto 6 when I try to install the upgrade. Does anyone have any ideas on how to get the upgrade to recognize the application. I had the same problem with iDVD and iMovie. Jo Hauser
-
Cross-reading files in a dual boot machine
Hi -- I just finished installing and setting up Windows 8.1 Enterprise on a Windows 7 Ultimate laptop. Windows 8.1 was installed on an unused disk partition, making this laptop a dual-boot machine. The machine is not attached to a domain (at least no