Server 2012 R2 Hyper-V Cluster - Losing connectivity to vLANs

Hi Everybody,
I am experiencing a strange issue with a Server 2012 R2 Hypervisor. There are two physical NICs teamed (one from on-board and one from expansion board), this team is assigned to a hyper-v virtual switch, there are four virtual network adapters
assigned to the switch (Backend, Heartbeat, Management & CSV/Live Migration).
The server has been running without issue for months but, all of a sudden has started to lose connectivity to the Backend and Heartbeat. The loss of connection only occurs once VMs are hosted on the server and it doesn't happen immediately, it can take
anywhere from 12 hours to several days.
There are no errors on the NICs or vNICs themselves and the configuration is intact. Once connectivity is lost to the Backend and Heartbeat, it remains that way and it seems the only solution so far is to reboot the server. Hardware diagnostics have been
run and revealed no issues. There are no useful events in event viewer, the alerts relate to the loss of connection to the cluster as a result of connectivity being lost on the Backend and Heartbeat.
I have 6 other hypervisors with the same network configuration that are performing without issue so, I don't believe the problem is the configuration. The only difference is the hypervisor that has the problems is a Dell Poweredge R620 and the other 6 are
Dell PowerEdge R610s.
Can anyone advise what might be the cause of these issues or, any event logging to enable that might help isolate where the issue lies.

Sorry Tim, is that all 50 blue screen if live migrated?
Are they all on the latest integration services? Does a cluster validation complete successfully? Are the hosts patched to the same level?
The fact that if you power them off then migrate them and they boot fine, does point to a processor incompatibility and the memory BIN file is not accepted on the new host.
Bit of a long shot but the only other thing I can think of off the top of my head if the compatibility option is checked, is checking the location of the BIN file when the VM is running to make sure its in the same place as the VHD\VHDX in the
CSV storage where the VM is located and not on the local host somewhere like C:\program data\.... that is stopping it being migrated to the new host when the VM is live migrated.
Kind Regards
Michael Coutanche
Blog:
Twitter: LinkedIn:
Note: Posts are provided “AS IS” without warranty of any kind, either expressed or implied, including but not limited to the implied warranties of merchantability and/or fitness for a particular purpose.

Similar Messages

Server 2012 R2 Hyper-V Cluster, VM blue screens after migration between nodes.

I currently have a two node Server 2012 R2 Hyper-v Cluster (fully patched) with a Windows Server 2012 R2 Iscsi target.
The VMs run fine all day long, but when I try to do a live/quick migration the VM blue screens after about 20 minutes. The blue reports back about a “Critical_Structure_Corruption”.
I’m being to think it might be down to CPU, as one system has an E-2640v2 and the other one has an E5-2670v3. Should I be able to migrate between these two systems with these type of CPU?
Tim

Sorry Tim, is that all 50 blue screen if live migrated?
Are they all on the latest integration services? Does a cluster validation complete successfully? Are the hosts patched to the same level?
The fact that if you power them off then migrate them and they boot fine, does point to a processor incompatibility and the memory BIN file is not accepted on the new host.
Bit of a long shot but the only other thing I can think of off the top of my head if the compatibility option is checked, is checking the location of the BIN file when the VM is running to make sure its in the same place as the VHD\VHDX in the
CSV storage where the VM is located and not on the local host somewhere like C:\program data\.... that is stopping it being migrated to the new host when the VM is live migrated.
Kind Regards
Michael Coutanche
Blog:
Twitter: LinkedIn:
Note: Posts are provided “AS IS” without warranty of any kind, either expressed or implied, including but not limited to the implied warranties of merchantability and/or fitness for a particular purpose.

Windows server 2012 Datacenter Hyper-V Cluster -- Failed to validate Operating System Installation Option?

Hi I have a 4 node Windows server 2012 Hyper-V cluster. When I try to run a cluster validation report, everything else is fine but it fails at validate the Operating System Installation Option step. I did some research but couldn't really find any solution.
Anyone knows how to pass this test? Thanks.
Here's the error I get when run the test:
An error occurred while executing the test.
The operation has failed. An error occurred while getting the operating system installation option for node "server1"

Hi JasonLiu2002,
Please post the original error information, the current information is so wide that difficult to determine where may have issue and please offer more information about your
server configuration, you can refer the following article to prepare your cluster environment first.
Windows Server 2012 Hyper-V Best Practices (In Easy Checklist Form)
http://blogs.technet.com/b/askpfeplat/archive/2013/03/10/windows-server-2012-hyper-v-best-practices-in-easy-checklist-form.aspx
When you preparing the new cluster on Server 2012 please install the Recommended hotfixes and updates for Windows Server 2012-based failover clusters updates.
http://support.microsoft.com/kb/2784261
I’m glad to be of help to you!
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place.

Network Questions on 2012 R2 Hyper-V Cluster

I am going through the setup and configuration of a clustered Windows Server 2012 R2 Hyper-V host.
I’ve followed as much documentation as I can find, and the Cluster Validation is passing with flying colors, but I have three questions about the networking setup.
Here’s an overview as well as a diagram of our configuration:
We are running two Server 2012 R2 nodes on a Dell VRTX Blade Chassis.
We have 4-dual port 10 GBe Intel NICS installed in the VRTX Chassis.
We have two Netgear 12-Port 10 GBe switches, both uplinked to our network backbone switch.
Here’s what I’ve done on each 2012 R2 node:
-Created a NIC team using two 10GBe ports from separate physical cards in the blade chassis.
-Created a Virtual Switch using this team called “Cluster Switch” with “ManagementOS” specified.
-Created 3 virtual Nics that connect to this “Cluster Switch”:
Mangement (10.1.10.x), Cluster (172.16.1.x), Live Migration (172.16.2.x)
-Set up VLAN ID 200 on the Cluster NIC using Powershell.
-Set Bandwidth Weight on each of the 3 NICS. Mangement has 5, Cluster has 40, Live Migration has 20.
-Set a Default Minimum Bandwidth for the switch at 35 (for the VM traffic.)
-Created two virtual switches for iSCSI both with
“-AllowManagementOS $false” specified.
-Each of these switches is using a 10GBe port from separate physical cards in the blade chassis.
-Created a virtual NIC for each of the virtual switches:
ISCSI1 (172.16.3.x) and ISCSI2 (172.16.4.x)
Here’s what I’ve done on the Netgear 10GB switches:
-Created a LAG using two ports on each switch to connect them together.
-Currently, I have no traffic going across the LAG as I’m not sure how I should configure it.
-Spread out the network connections over each Netgear switch so traffic from the virtual switch “Cluster Switch” on each node is connected to both Netgear 10 GB switches.
-Connected each virtual iSCSI switch from each node to its own port on each Netgear switch.
First Question: As I mentioned, the cluster validation wizard thinks everything is great.
But what about the traffic the Host and Guest VMs use to communicate with the rest of the corporate network?
That traffic is on the same subnet as the Management NIC.
Should the Management traffic be on that same corporate subnet, or should it be on its own subnet?
If Management is on its own subnet, then how do I manage the cluster from the corporate network?
I feel like I’m missing something simple here.
Second Question: Do I even need to implement VLANS in this configuration?
Since everything is on its own subnet, I don’t see the need.
Third Question: I’m confused how the LAG will work between the two 10 Gbe switches when both have separate uplinks to the backbone switch.
I see diagrams that show this setup, but I’m not sure how to achieve it without causing a loop.
Thanks!

"First Question: As I mentioned, the cluster validation wizard thinks everything is great.
But what about the traffic the Host and Guest VMs use to communicate with the rest of the corporate network?
That traffic is on the same subnet as the Management NIC.
Should the Management traffic be on that same corporate subnet, or should it be on its own subnet?
If Management is on its own subnet, then how do I manage the cluster from the corporate network?
I feel like I’m missing something simple here."
This is an operational question, not a technical question. You can have all VM and management traffic on the same network if you want. If you want to isolate the two, you can do that, too. Generally, recommended
practice is to create separate networks for host management and VM access, but it is not a strict requirement.
"Second Question: Do I even need to implement VLANS in this configuration?
Since everything is on its own subnet, I don’t see the need."
No, you don't need VLANs if separation by IP subnet is sufficient. VLANs provide a level of security against snooping that simple subnet isolation provides. Again, up to you as to how you want to configure things.
I've done it both ways, and it works both ways.
"Third Question: I’m confused how the LAG will work between the two 10 Gbe switches when both have separate uplinks to the backbone switch.
I see diagrams that show this setup, but I’m not sure how to achieve it without causing a loop."
This is pretty much outside the bounds of a clustering question. You might want to take network configuration questions to a networking forum. Or, you may want to talk with Netgear specialist. Different networking
vendors can accomplish this in different ways.
.:|:.:|:. tim

2012 R2 Hyper-V Cluster two node design with abundance 1Gbps NICs and FC storage

Hello All,
First post so please be gentle!
We are currently in the process of building/testing the upgrade of two node 2012 R2 Hyper-V cluster.
Two hosts built with Datacentre 2012 R2 which will host approx. 30 VM's.
Shared storage will be fault tolerant FC- connection.
10, (yes 10!) 1Gbps NICs are available, Intel i350.
trying to decide on teaming interfaces using native LBFO and the 2008 'style' of using un-converged networking, or teaming up most interfaces and using QoS. Can find many/numerous examples of using 10Gbps NICs and converged, however 10Gbps networking
isn't an option right now.
recommendations appreciated.
thanks

Hi Sir,
>>trying to decide on teaming interfaces using native LBFO and the 2008 'style' of using un-converged networking, or teaming up most interfaces and using QoS.
The following link detailed the teaming configuration and it's applicable scenario (server 2012):
http://www.aidanfinn.com/?p=14039
Also please refer to the document for 2012R2 LBFO :
http://www.microsoft.com/en-us/download/details.aspx?id=40319
In server 2012R2 , there is a new setting "Dynamic" for "load banacing mode " and it is recommended to use Dynamic for "Load banacing mode" :
If you can accept 1GB max bandwidth for each VM I would suggest you to use LBFO mode : Independent/dynamic/None(All adapter active) .
Best Regards,
Elton Ji
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact [email protected] .

2012 R2 Hyper V Cluster

Hi
we have windows Server 2012 r2 Hyper V failover Cluster.. we face slow network performance issue in widows 2012 R2
terminal Services .. VMQ is disable on Physical NIC of Hyper V Network.
Remaining Servers are working perfectly only issue face on terminal user login on terminal server node..
Any idea

Thats what we are asking you for?
you last post is a different question to your first response.
Hi all
Terminal node login slowly when applying group policy on it ..
Regards
My questions are still very relevant as posted in a previous reply.:
If you are waiting for Profile Service and folder redirection policies can you confirm the following?
How big is the users' NTUSER.DAT?
Which redirection policies have you applied and how much data are you shifting for the user? the first time a redirection policy runs for a user it can take an age (if you are moving their documents \ desktop etc...
How big is the link to your fileserver hosting the redirected data? How busy is the fileserver? How many files are in the users roaming profile? What is the total profile size for the user?

Server 2012 R2 Hyper-v Servers not being discovered by the mp

Sorry if this is a dup question. I did see the one for 2008 but that didn't fix my issue.
I have 4 hyper-v servers running server 2012 r2 in a cluster. I have scom 2012 r2 and it detects the cluster and 3 out of the 4 hyper-v servers. the 4th server it can see under windows but does not discover the hyper-v components.
Any assistance would be appreciated.

Hi,
You can install the Agent on the server manually to check the result.
http://technet.microsoft.com/en-us/library/hh212853.aspx
Niki Han
TechNet Community Support

(Request for:) Best practices for setting up a new Windows Server 2012 r2 Hyper-V Virtualized AD DC

Could you please share your best practices for setting up a new Windows Server 2012 r2 Hyper-V Virtualized AD DC, that will be running on a new WinSrv 2012 r2 host server. (This
will be for a brand new network setup, new forest, domain, etc.)
Specifically, your best practices regarding:
the sizing of non virtual and virtual volumes/partitions/drives,
the use of sysvol, logs, & data volumes/drives on hosts & guests,
RAID levels for the host and the guest(s),
IDE vs SCSI and drivers both non virtual and virtual and the booting there of,
disk caching settings on both host and guests.
Thanks so much for any information you can share.

A bit of non essential additional info:
We are small to midrange school district who, after close to 20 years on Novell networks, have decided to design and create a new Microsoft network and migrate all of our data and services
over to the new infrastructure . We are planning on rolling out 2012 r2 servers with as much Hyper-v virtualization as possible.
During the last few weeks we have been able to find most of the information we need to undergo this project, and most of the information was pretty solid with little ambiguity, except for
information regarding virtualizing the DCs, which as been a bit inconsistent.
Yes, we have read all the documents that most of these posts tend point to, but found some, if not most are still are referring to performing this under Srvr 2008 r2, and haven’t really
seen all that much on Srvr2012 r2.
We have read these and others:
Introduction to Active Directory Domain Services (AD DS) Virtualization (Level 100),
Virtualized Domain Controller Technical Reference (Level 300),
Virtualized Domain Controller Cloning Test Guidance for Application Vendors,
Support for using Hyper-V Replica for virtualized domain controllers.
Again, thanks for any information, best practices, cookie cutter or otherwise that you can share.
Chas.

Server 2012 r2 Hyper-v guest network speed with 10 GB NIC's

Hi
Setting up a Server 2012 r2 Hyper-v host with an onboard 4 port 1 GB nic and a offboard dual port 10 GB nic. We are using the 1gb quad port for management. The 10 Gb we intend using for hyper-v guest use however we don't seem to be able to achieve very high
speeds though the 10 GB adapter when assigned to a virtual switch. Testing the 10 Gb nic from the host confirms that we can transfer/get 10 GB speeds. When assigned to a virtual switch however the speed drops to about 1-2 Gbps. Has anybody seen anything like
this ?. We've tried a variety of settings and i can confirm that the network traffic is using the 10 GB nic.

Hi,
I am almost certain what you see is by design. I don't want to go into to much detail because I'm in a bit of a hurry. But allow me to explain.
Suppose you have a 10Gb NIC interface and an multi-core CPU. When you have RSS (Receive-Side Scaling) disabled a single core can normally handing
around 2.5-4.3Gbps. When you enable RSS the data streams/traffic is spread across multiple cores.
But RSS is a network optimization feature for the Management OS, not for a vSwitch. Instead you should use VMQ (Virtual Machine Queuing). VMQ is
the equilavant of RSS, but then intended for VMs. But... there is a difference. VMQ does not spread single data streams/traffic across multiple cores. Instead is (dynamically) assigns each vmNIC its own core. So... you don't use multiple-cores at a time for
a single vmNIC. You can't use RSS and VMQ at the same time. Keep that in mind.
But... you can accomplish this by enabling vRSS as well. That's another story.
If you watch the following video, at the end you know all about VMQ.
Hyper-V dVMQ
http://www.hypervrockstar.com/tag/dvmq/
Boudewijn Plomp | BPMi Infrastructure & Security
This posting is provided "AS IS" with no warranties, and confers no rights. Please remember, if you see a post that helped you please click "Vote as Helpful", and if it answered your question, please click "Mark as Answer".

2012 R2 Hyper-V Cluster Replication to Single Non-Cluster Host?

I can't seem to find a straight answer and in my testing, this doesn't seem to work. Is it supported to replicate from a 2012 R2 Hyper-V cluster to a remote, single 2012 R2 Hyper-V non-cluster host?

Yes, it's supported, and yes it works. The cluster uses the Hyper-V Replica Broker and the destination system does not.
Eric Siron Altaro Hyper-V Blog
I am an independent blog contributor, not an Altaro employee. I am solely responsible for the content of my posts.
"Every relationship you have is in worse shape than you think."
To replicate back to the primary site I'll need a replica broker at the DR site however, correct?

Adding nodes to Windows Server 2008 R2 Hyper-V Cluster..

Currently we have a 3 node Windows Server 2008 R2 Hyper-V Cluster in production. There are about 3 terrabytes worth of VMs running across these nodes.
It is over-committed, so i've setup two new nodes to add to the cluster.
I've done this before in a SQL cluster but never a Hyper-V cluster.
If I don't run validation when adding the nodes, will there be downtime?
The quorum is setup for disk majority, everything is identical on all nodes that needs to be. Shared storage is recognized and ready on the new nodes. I've gone through every checklist that Microsoft has. I'm just curious if the virtual machines will go
offline on the current nodes when i add the two new nodes.
Everything is identical down to the wsus updates installed. From networking to storage everything is perfect.
I don't want to run validation as I know that'll take everything offline.

Hi,
It is recommend to run a validation test. You can select custom test. (skip storage).
When add the new node to existing cluster . it will not bring down existing VM.
Lai (My blog:- http://www.ms4u.info)

High Network Utilization on HeartBeat and LiveMigration networks - Windows 2012 R2 Hyper-V cluster

Hi all,
I have just setup a fresh Windows 2012 R2 Hyper-V cluster with 4 nodes.
Config:
Network:
2 x Networks for iSCSI
1 x VM network 1
1 x VM network 2
1 x Heartbeat
1 x LiveMigration
Disks:
5 GB = Quorum
2 x 2.99 TB (Deduplication enabled)
The problem I am getting is that HeartBeat and LiveMigration (both configured with Cluster Only traffic) have alot of traffic on them even though no LiveMigration (the only card configured for LiveMigration) is going on.
All network configuration is the same as it was in Windows 2008 R2 SP1 cluster which these machines where running before (not upgrade, fresh install and migration) and did not have this "problem".
Has anyone experienced this or have a solution to this?
Regards,
Thorir
thorir

Hi Thorir,
According to your discription , you can try to monitor and analyse the traffic of LM via network monitor for troubleshooting .
Here is the links for downloading and using network monitor :
http://www.microsoft.com/en-us/download/details.aspx?id=4865
http://technet.microsoft.com/en-us/library/cc723623.aspx
Any further information please feel free to let us know.
Hope this helps
Best Regards
Elton Ji
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place.

Server 2012 R2 Hyper-v two node cluster network connections help please

I am trying to do a hyper-v failover clustering project and we have following hardwares:
2x HP DL 380 G8 with 8 LAN ports
1x HP MSA 2000 with dual controller (each controller has 2 iSCSI LAN ports)
2x 24 port gig switch (HP Procurve)
I don’t know whether this is a best practice but I would like to setup separate network for live migration, iSCSI, heartbeat & data/management. So far I have installed Server 2012 R2 datacenter on both servers.
MSA Controller A port 1 is connected to Switch 1 – Vlan 1
MSA Controller A port 2 is connected to Switch 2 – Vlan 2
MSA Controller B port 1 is connected to Switch 1 – Vlan 1
MSA Controller B port 2 is connected to Switch 2 – Vlan 2
For each server is this how network connection should be? Ports will be teamed.
2 ports for iSCSI – vlan 3
2 ports for Live Migration – vlan 4
2 ports for Heartbeat – vlan 5
2 ports for Management/VM – vlan 6
Please advise if there is other better options.
Any help would be much appreciated, thank you.

Watch this webcast from TechEd, it will answer your questions:
http://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/MDC-B337#fbid=?hashlink=fbid
Thanks!
Elden

Server 2012 R2 Hyper-V Host Loses Network Connectivity

Here's the scenario...
We have two 2012 R2 Hyper-V hosts (VM1 and VM2) in a cluster that have 8 virtual machines that live on them. The servers are each utilizing three network connections that are teamed (Switch Independent, Address Hash). They all go to the same switch.
Three nights ago at approximately 11:30 PM VM2 lost network connectivity. The server was up it was just inaccessible from the network. I could not ping in or out from it, no internet connection, yet the network connection icon did not show that it was
disconnected.
Two nights ago we had no issues.
Last night, same thing happened at 11:30 PM. VM2 loses it network connection.
The only thing that seems to fix the issue is a reboot. Once the server comes back up everything is back to normal.
Anyone have any idea what is happening here? I do not see anything that sticks out in the logs that could point me in the right direction....

Hi Sir,
Based on my experience , first you may need to keep the physical NIC driver up-to-date .
Also please check if there is "VMQ"/"virtual machine queue" property in advanced properties of physical NICs:
If yes please disable it for each team member then check the result .
Best Regards,
Elton Ji
Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Subscriber Support, contact [email protected] .

Windows Domain Controller on Windows Server 2012 R2: Hyper-V roaming profiles not loading due to slow connection

I have racked my brain and done everything that I know to do for about two weeks now. I am setting up a new system at our fire department and I am having the worst luck with getting the workstations to login to the domain controller with roaming
profiles. It keeps telling me that the roaming profile could not be loaded because of a slow connection. These are workstations that are connected directly to the switch that the DC is connected to. I have tried multiple connections regarding
the layout (DC into the router, router into the switch). The router is a Cisco RV220W. I have two VLANS, one for public and one for private domain. The Private VLAN has DHCP turned off since I am providing it through the DC. I currently
have a connection from the Private VLAN going to the unmanaged switch that the workstations and server are plugged into.
The server is a Dell PowerEdge R420 that has 6 NIC ports (1 dual port and 1 quad port). I have a virtual switch setup on Hyper-V for an external port (let's say Card 2 Port 3) that is assigned to the WS 2012R2 Domain Controller. The DC can see
the internet fine and the workstations can connect to the shared folders on the server. I can retrieve files by just using the computer name or FQDN. The DC is also running DNS and DHCP. The DNS has the _msdcs setup from when I installed
the active directory role. I have attempted to assign static IP addresses to the workstations:
IP:                     10.0.0.80
Subnet:             255.255.255.0
IPV4 Gateway: 10.0.0.1
IPV4 DNS:        10.0.0.12
I've attempted "append the specific DNS suffix", I've "registered the connection in DNS", I've used "use this connections suffix in DNS registration".
The server is assigned:
IP:                     10.0.0.12
Subnet:             255.255.255.0
IPV4 Gateway: 10.0.0.1
IPV4 DNS:         10.0.0.12
The DNS entries have forwarders that forward to my ISP DNS servers for lookup
I've enabled and disabled DHCP, I've installed a new VM just to create another DC to make sure that I didn't goof up when I created it.
I've lost my patience with this project and am sinking fast. Can someone please offer some advice as to what I've done wrong? I've created this exact scenario at work many times but, I've never done it with Windows Server 2012. Is this
possibly something to do with the Dell PowerEdge server (Generation 12) with the SR-IOV? I am going to attempt to work on it some more tomorrow when I get over there. I think there may be an issue with the SR-IOV not being enabled on the machine
through the Dell Bios. Would the SR-IOV really cause the workstations to report a slow connection? When I login at the domain controller the roaming profiles and folder redirection work fine so, I know the GPO settings are correct. I don't
have "ignore slow connections" or any of those GPO's set. I need to get it working the correct way so, I didn't want to fool the server when there is another underlying problem. Any help that someone can offer, I am more than willing
to listen. If you need more information, please ask.
Thanks,
Jay

So, I've managed to research this some more since Thursday and I've come to the conclusion that Hyper-V does a horrible job of supporting Qualcomm NIC cards. That's the only thing I can conclude as far as where the issue is originating. I've read many
post and walkthroughs but nothing that has helped. The issue wasn't with any settings in the domain controller. The issue was that there really is a slow connection originating at the domain controller that is a VM and has network connectivity through the
virtual switch from Hyper-V. So, next question is, how do I get the DC to have better connectivity through the NIC that Hyper-V won't give it? If hyper-v would allow passthrough, this would be so much simpler. VM-ware is looking really good at this point.
Im disappointed in MS right now.

Server 2012 R2 Hyper-V Cluster - Losing connectivity to vLANs

Similar Messages

Maybe you are looking for