Nexus 1000v UCS Manager and Cisco UCS M81KR

Hello everyone
I am confused about how works the integration between N1K and UCS Manager:
First question:
If two VMs on different ESXi and different VEM but in the same VLAN,would like to talk each other, the data flow between them is managed from the upstream switch( in this case UCS Fabric Inteconnect), isn'it?
I created a Ethernet uplink port-profile on N1K in switch port mode access(100), I created a vEthernet port-profile for the VM in switchport mode access(100) as well. In the Fabric Interconnect I created a vNIC profile for the physical NICs of ESXi(where there are the VMs). Also I created the vlan 100(the same in N1K)
Second question: With the configuration above, if I include in the vNIC profile the vlan 100 (not as native vlan) only, the two VMs can not ping each other. Instead if I include in the vNIC profile only the defaul vlan(I think it is the vlan 1) as native vlan evereything works fine. WHY????
Third question: How it works the tagging vlan on Fabric interconnectr and also in N1K.
I tried to read differnt documents, but I did not understand.
Thanks

This document may help...
Best Practices in Deploying Cisco Nexus 1000V Series Switches on Cisco UCS B and C Series Cisco UCS Manager Servers
http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9902/white_paper_c11-558242.html
If two VMs on different ESXi and different VEM but in the same VLAN,would like to talk each other, the data flow between them is managed from the upstream switch( in this case UCS Fabric Inteconnect), isn'it?
-Yes. Each ESX host with the VEM will have one or more dedicated NICs for the VEMs to communicate with the upstream network. These would be your 'type ethernet' port-profiles. The ustream network would need to bridge the vlan between the two physicall nics.
Second question: With the configuration above, if I include in the vNIC profile the vlan 100 (not as native vlan) only, the two VMs can not ping each other. Instead if I include in the vNIC profile only the defaul vlan(I think it is the vlan 1) as native vlan evereything works fine. WHY????
- The N1K port profiles are switchport access making them untagged. This would be the native vlan in ucs. If there is no native vlan in the UCS configuration, we do not have the upstream networking bridging the vlan.
Third question: How it works the tagging vlan on Fabric interconnectr and also in N1K.
- All ports on the UCS are effectively trunks and you can define what vlans are allowed on the trunk as well as what vlan is passed natively or untagged. In N1K, you will want to leave your vEthernet port profiles as 'switchport mode access'. For your Ethernet profiles, you will want them to be 'switchport mode trunk'. Use an used used vlan as the native vlan. All production vlans will be passed from N1K to UCS as tagged vlans.
Thank You,
Dan Laden
PDI Helpdesk
http://www.cisco.com/go/pdihelpdesk

Similar Messages

Nexus 1000v, VMWare ESX and Microsoft SC VMM

Hi,
Im curious if anybody has worked up any solutions managing network infrastructure for VMWare ESX hosts/vms with the Nexus 1000v and Microsoft's System Center Virtual Machine Manager.
There currently exists support for the 1000v and ESX and SCVMM using the Cisco 1000v software for MS Hyper-V and SCVMM. There is no suck support for VMWare ESX.
Im curious as to what others with VMWare, Nexus 1000v or equivalent and SCVMM have done to work around this issue.
Trying to get some ideas.
Thanks

Aaron,
The steps you have above are correct, you will need steps 1 - 4 to get it working correctly. Normally people will create a separate VLAN for their NLB interfaces/subnet, to prevent uncessisary flooding of mcast frames within the network.
To answer your questions
1) I've seen multiple customer run this configuration
2) The steps you have are correct
3) You can't enable/disable IGMP snooping on UCS. It's enabled by default and not a configurable option. There's no need to change anything within UCS in regards to MS NLB with the procedure above. FYI - the ability to disable/enable IGMP snooping on UCS is slated for an upcoming release 2.1.
This is the correct method untill the time we have the option of configuring static multicast mac entries on
the Nexus 1000v. If this is a feature you'd like, please open a TAC case and request for bug CSCtb93725 to be linked to your SR.
This will give more "push" to our develpment team to prioritize this request.
Hopefully some other customers can share their experience.
Regards,
Robert

UCS Manager and C Series questions

My reading of the documentation is that in order to use the UCS Manager with a standalone C series server (C200, C210 or C250, anyway) is that in addition to UCSM 1.4 and a pair of 6108 fabric interconnects you also need a pair of 2248 fabric extenders.
First, is Cisco planning to add support for additional fabric extenders? I have a customer with a pair of 2232's who is looking at adding some standalone C series servers to be managed along with an existing B series chassis.
Second, I'd read on this forum that the Palo card may not be supported on M1 servers. Is it safe to assume that the Palo card is supported on M2 servers?
Thanks!

Michael,
Correct, for the current revision of UCSM (1.4) you require two 2248's for Management traffic (CIMC) while your two 10G connection for the dataplane will connect direclty to each Fabric Interconnect. Future planning is going to have a single I/O path and remove the need for the additional 2248's. Future support for 2232 (10G FEX) will also be added to increase port density on the Interconnects.
Palo may "work" with M1 servers, but is only "supported" on M2.
Regards,
Robert

Cisco Unity Connection 8.X and Cisco UCS

Hi
We are in a planning phase for Unity Connection 8.X on Cisco UCS C-Series. The Cisco Unified Communications SRND 8.0 states that requires reserving one physical core per physical server.
what does it really mean?

See sample depiction below of applications and physical core usage on a server with 2 CPUs and 8 total physical cores. In white is the reservation of one physical core.
Regards.

UCS Manager and using Microsoft Certificate Authority

Has anybody gone through the process of setting up UCS Manager with a certificate issued from a Microsoft Certificate Authority? If so I would appreciate some assistance. I was able to successfully create a request and have generated the certificate, but I see no way of being able to put the request and the certificate chain back into UCS Manager.

First you have to create a trusted point (under the Admin Tab -> Key Management). In the new trusted point, paste the public cert in base64 format of your root certificate authority. If you have a subordinate CA that's issuing then add that CA's cert too. If you have a whole tree of CAs, then you need to create a trusted point with all the CAs in the chain from the issueing CA up to the root. Paste one cert after the other, in order, up the chain, all in the same trusted point. If they're not in the right order or if you're missing the root, then the TP won't accept the cert.
Once you have a trusted point you can accept the certificate you generated. In the KeyRing you used to generate the request, choose the new Trusted Point, and paste the new certificate in Base64 format into the Certificate field.
Once that's done, you can go to Communication Management -> Communication Services, and for the HTTPS protocol, choose the new Key Ring. It might not take effect immediately, but after a few minutes your UCSM web site should start responding with the new certificate.
I hope that helps.
Note: There's a bug in UCS currently issue number CSCth62582. If your fabric interconnects fail over, the SSL cert will revert to the default self signed cert. You have to go back into Communication services and set it to default, save, then set it back to the new Key Ring.

Mixing BE6000 UCS Server and "normal" UCS server in the same deployment

Hello,
I have been handed a project which has one high density BE6000 UCS server and a separate UCS C220 M3 server. The latter server was included to host a MediaSense call recording system but this will only use 2 of the available 8 vCPUs on the UCS C220 M3 server.
The total number of users is 200.
I want to implement a resilient system and so would like deploy two servers in a cluster for each of the following applications:
CUCM 10.5
Unity Connection 10.5
IM & Presence 10.5
As well as these applications there will be UCCX 10.6 and Cisco Unified Attendant Console Advanced (10.5) but these will be deployed as single servers.
Looking at the UCS servers they have capacity for me to split the CUCM/CUC/IMP clusters between them.
I cannot see any technical reason why this will not work but do not want to be caught by any Cisco support policies.
If I were to implement the system in this way would there be any issues with the deployment or getting support from TAC.
The separate UCS C220 M3 server has 8 x 8GB RAM (64 total) and 8 x 300GB HDD plus a quad Ethernet card.

James first of all I am not sure I understand your query in detail. Do you mean you have two UCS220 M3 servers? and one of them is currently running BE6000?
Having said that, the key here is to carefully plan your deployment against the capacity of the servers you have,.
Eg..Deploying 200 Users, using the ff OVA
UCS 220 M3 server 1: (using default TRC ie 8vCPU with 8GB per vCPU)
Publisher (2500 cucm OVA): 1vCPU (6GB RAM), 80GB HD
IMP-Publisher (1,000 OVA) :1vCPU(2GB RAM), 80GB HD
CUC-publisher (1,000 users OVA) :2vCPU(6GB)--NB 1vCPU is reserved for ESXI, 160GB HD
UCCX-Master: (300 agent OVA): 2 vCPU (8GB) and 292GB HDD
With this placement you have a total of 22GB RAM and 612HDD used up
A break down is shown below..
Server
Server Name
C220 M3S TRC#1 (Medium)
C220 M3S TRC#1 (Medium)
Application Short Name
Application Long Name
Release
VM Name
vCPU
vRAM
vDisk
CUCM
Unified Communications Manager Release
10.x
CallCtrl: 2,500 users
1
4
80
IM&P
IM & Presence Release
10.x
1,000 users
1
2
80
CUC
Unity Connection Release
10.0
1,000 users
1
4
160
ESXi
Unity Connection
ESXi
1*
CUCCX
Cisco Unified Contact Center Express / Unified IP IVR Release
10.x
Main: 300 agents
2
8
292
ESXi
VMware vSphere ESXi
5.5
4**
* Note: This is a 1 physical CPU core per host regardless of the number of Cisco Unity Connection (CUC) VMs.
** Note: This is 4GB physical RAM per host.

Call manager and Cisco IP phones

I would like to know if it's possible to use Cisco IP phones in small environments, without having Call manager, or it's mandatory to have always CallManager if one wants to use the IP phones.
Thank you

You can use Call Manager Express, which runs on cisco 1751/60, 2600 and above routers. it can support up to 120 users. Cisco Unity Express will provide voice mail. this is a network module in 2600 and above routers. for more info, see www.cisco.com/go/ccme

Border Manager and Cisco ACS connection

The NIC in the Border Manager server failed.
I installed a new NIC and gave it the same IP address and mask as the old
one. The lights on the NIC's in both boxes are green but I cannot ping one
from the other. They are connected with a cross-over cable
I was told I would have to set up a 'route' - help please.
The person who would normally set this up is sun bathing on an island
somewhere in the Indian Ocean.

> > In article <LShvd.6367$[email protected]>, wrote:
> > > The NIC in the Border Manager server failed.
> >
> > Which NIC? The public side, or the private side?
> >
> > > I installed a new NIC and gave it the same IP address and mask as
the
> old
> > > one.
> >
> > If this was on the public side, did you also rename the interface the
> same as
> > the old one? (If not, your filters may fail to filter).
> >
> > > The lights on the NIC's in both boxes are green but I cannot ping
one
> > > from the other. They are connected with a cross-over cable
> >
> > UNLOAD IPFLT (drops filters) for a test. If you did everything right,
> the
> > default filters may be blocking ICMP, and so you would normally not be
> able
> > to ping.
> >
> > > I was told I would have to set up a 'route' - help please.
> >
> > Seems unlikely. Changing a nic will not normally change any
configured
> > static routes, as they are stored in a separate file.
> >
> > > The person who would normally set this up is sun bathing on an
island
> > > somewhere in the Indian Ocean.
> >
> > Must be nice!
> >
> >
> > Craig Johnson
> > Novell Support Connection SysOp
> > *** For a current patch list, tips, handy files and books on
> > BorderManager, go to http://www.craigjconsulting.com ***
> >
>
> The card that I replaced in the Border Manager server had a 192.168.x.x
> address, connected to the card in the ACS box with a cross-over cable.
The
> card in the ACS box is also a 192.168.x.x address. I have a route set up
> to the 192.168.101.0 network specifying the ACS box address as the next
> hop.
> Mike
>
Problem solved, the card has blown in the ACS box.

Cisco UCS Blades and vSphere DPM

I followed this guide:
https://supportforums.cisco.com/docs/DOC-8582
And it worked, but I have 2 problems.
1) The blade being put into Standby starts back up immediately - almost like a reboot -
and doesn't stay in Standby mode
2) The Blade being put into Standby mode has Faults on all vFabric's etc because it is
"off"
Any suggestions?
Jim

Hi Rob and Jim,
How did you guys progress with this one? I am having the same issue and be interested to know the solution.
My environment is vSphere 5.0 with B230 M2 and DPM is not yet enabled. UCS Manager and CIMC are running 2.0(1s).
On testing for Standby from the vSphere client, the blade reboots automatically (no power down). A shutdown command gives the same result (which is a reboot) with a host connection failure alert.
Any help is appreciated.
Thanks,
Noli

Cisco UCS components and Heartbleed bug

I was reading about Cisco products affected by heartbleed vulnerability at following Cisco security advisory
http://tools.cisco.com/security/center/content/CiscoSecurityAdvisory/cisco-sa-20140409-heartbleed#@ID
I couldn't find whether below products/components are affected by this vulnerability.. can someone confirm if these products/components are vulnerable to heartbleed?
Cisco UCS Manager
Cisco Integrated Management Controller (CIMC)
Cisco UCS Blade Chassis
tia

I agree that phrasing is a bit off, note that the notice is talking about _products_ affected (or not), not particular _components_ of a product.
UCS seems to be off the hook. Not affected are:
Cisco UCS B-Series (Blade) Servers
Cisco UCS C-Series (Stand alone Rack) Servers
Cisco UCS Central
Cisco UCS Fabric Interconnects
Cisco UCS Invicta Series Solid State Systems
CIMC and UCSM would be part of FI or B-or-C-series, etc.

Cisco UCS Manager not discovering C240 server

Hello, Cisco community!
Currenlty UCS manager shows two Fabric Interconnects, and two Fabric Extenders, but for some reason my server isn't showing up
Here is the birds eye view:
I have my C240 connected with two 10GbE twinax cables, each going to one fabric extender. (2 FEX total)
I have two 10GbE twinax cables connected from the fiber module of each FEX to each Fabric interconnects. (2 FI total)
The fabric interconnect ports L1 and L2 ports are connected to their corresponding ports. So their connected to each other.
I run 'show cluster extended-state' on the primary FI and this is what i get:
FI-A# show cluster extended-state
Cluster Id: 0xebaad0e28ded11e3-0x86d4002a6a153d84
Start time: Wed Feb 5 16:07:44 2014
Last election time: Wed Feb 5 16:23:26 2014
A: UP, PRIMARY
B: UP, SUBORDINATE
A: memb state UP, lead state PRIMARY, mgmt services state: UP
B: memb state UP, lead state SUBORDINATE, mgmt services state: UP
heartbeat state PRIMARY_OK
INTERNAL NETWORK INTERFACES:
eth1, UP
eth2, UP
HA NOT READY
No device connected to this Fabric Interconnect
After configuring the server-side ports on each FI, the server still doesn't show up
Any idea are highly appreciated!!
-Alex

It's good to know that the Fabric Interconnects don't need upstream connectivity, so we can scratch that from our list of possible issues.
For clarity, here are the important firware versions:
CMIC - 1.5(3), cisco recommends a minimum of 1.4(6)
BIOS - 1.5.1c, cisco recommends a minumum of 1.4.7a
vNIC - 2.1(1c), cisco recommends a minumum of 2.1(0.367e)
So, we can cross out firware mis-matches from the list.
wdey,
I tried going trough UCS Manager and looking where i could configure the out-of-band IP management pool, but I can't find the right place to do that. Here is a screen shot of the VLAN tab of my UCS Manager.
Could you eleborate more on the process of how to do this? This might fix the issue.
Also, I noticed that in the BIOs setting screen, under Advanced -> LOM and PCIe Slots configuration -> PCIe Slot ID: 2(VIC 1225) it says Option ROM Status Not Loaded. Do you think this might have something to do with server discovery?
Thanks alot for the help guys It's really much apprecaited.
-Alex

Ask the Expert: Cisco UCS B-Series Latest Version New Features

Welcome to this Cisco Support Community Ask the Expert conversation. This is an opportunity to learn and ask questions about the Cisco UCS Manager 2.2(1) release, which delivers several important features and major enhancements in the fabric, compute, and operational areas. Some of these features include fabric scaling, VLANs, VIFs, IGMP groups, network endpoints, unidirectional link detection (UDLD) support, support for virtual machine queue (VMQ), direct connect C-Series to FI without FEX, direct KVM access, and several other features.
Teclus Dsouza is a customer support engineer from the Server Virtualization team at the Cisco Technical Assistance Center in Bangalore, India. He has over 15 years of total IT experience. He has worked across different technologies and a wide range of data center products. He is an expert in Cisco Nexus 1000V and Cisco UCS products. He has more than 6 years of experience on VMware virtualization products.
Chetan Parik is a customer support engineer from the Server Virtualization team at the Cisco Technical Assistance Center in Bangalore, India. He has seven years of total experience. He has worked on a wide range of Cisco data center products such as Cisco UCS and Cisco Nexus 1000V. He also has five years of experience on VMware virtualization products.
Remember to use the rating system to let Teclus and Chetan know if you have received an adequate response.
Because of the volume expected during this event, our experts might not be able to answer every question. Remember that you can continue the conversation in the Data Center community, under subcommunity Unified Computing, shortly after the event. This event lasts through May 9, 2014. Visit this forum often to view responses to your questions and the questions of other Cisco Support Community members.

Hi Jackson,
Yes its is possible. Connect the storage array to the fabric interconnects using two 10GB links per storage processor. Connect each SP to both fabric interconnects and configure the ports on the fabric interconnect as “Appliance” ports from UCSM
For more information on how to connect Netapp storage using other protocols like iSCSI or FCOE please check the url below.
http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6100-series-fabric-interconnects/whitepaper_c11-702584.html
Regards
Teclus Dsouza

Windows 2008 R2 on Cisco UCS B200M networking problems

This is driving me completely nuts. Let me start by saying I am new to blade servers and Cisco UCS. I did take an introduction class, and it seemed straight-forward enough. I have a chassis with two B200M blades, on which I am trying to configure two Windows 2008 R2 servers, which I will eventually make Hyper-V servers. This is all in a test environment, so I can do anything I want to on them.
Right now I have installed W2008 directly on hard disks on the B200M hardware.
The problem is this: even though I think I've configured the network hardware correctly, using the Cisco VIC driver software, I cannot get networking to work in any reliable way. I cannot even get ping to work consistantly. I can ping my local server address, but I cannot ping my gateway (HSRP address). When I try, I get a "Reply from 10.100.1.x: Destination host unreachable (x being each particular server's last octet). I CAN, however, ping the individual IP addresses of the core switches. I can also ping some, but not all, the other devices that share the servers' subnet. There are no errors being generated, the arp tables (for those devices I can ping) look good, netstat looks OK. But I cannot get outside the local subnet...
Except when I can.
There are times when I can get all the way out to the Internet, and I can download patches from Microsoft. When it works, it works as expected. But if I reboot the server, oftentimes networking stops working. Yet another reboot can get things going again. This happens even though I've made no changes to either the UCS configs or the OS.
I cannot figure out any reason when it works at some times and not at others. I've made sure I have a native VLAN set, I've tried pinning to specific ports on the Fabric Interconnects. There is just no rhyme or reason to it.
Anyone know of where I can look? I'm very familiar with Windows on stand-alone boxes (although it's no longer my area of expertise), and I manage a global WAN (BGP, OSPF, Nexus 7k, etc.) so I'm no dummy when it comes to networking, but I am utterly stumped on this one.

The problem was this: while the NICs on the blade server are called vNIC0 and vNIC1, Windows was calling vNIC1 "Local Area Connection" and vNIC0 "Local Area Connection 2". So what I configured on UCS did not match what I was configuring in Windows. Completely, utterly ridiculous.
Anyway, networking is working now without any issues. Thanks for you suggestion; it did get me looking in the right direction.

Cisco UCS with FEX system Component requirements

Hi ,
I am looking for quick suggestion for required components to have a VMware vSAN implemented using FEX system with maximum Fabric trough put. Ideally a configuration for without multipath using single Fabric switch and later on to be able to upgrade to Multipath fabric.
We are in great rush to provide POC concept and was looking if you folks can suggest me on this. If need be you want to talk to me more in detail I can available.
Appreciate your help here.
Who can I reach to able to pull up build and quote the configurations for implementing complete UCS solution.
Are these below components absolutely required ?
2 x Nexus 2232PP 10GE Fabric Extenders
The Cisco Nexus 2232PP 10GE provides 32 x 10Gb loss-less low latency Ethernet and Fiber Channel Over Ethernet (FCoE) Small Form-Factor Pluggable Plus (SFP+) server ports and eight 10 Gb Ethernet and FCoE SFP+ uplink ports in a compact 1 rack unit (1RU) form factor. They enable Seamless inclusion of UCS rack servers into UCS Manager domain with UCS blade servers when connected to the UCS 6200 Fabric Interconnects, providing converged LAN, SAN, and management connectivity.
We currently have these below servers :
2 x UCSC-BASE-M2-C460
        524 GB RAM
        No SSDs
        No VIC Card
        4 x SAS 1 TB Drives
        1 x L1 Intel 1 Gbps Ethernet Adapter
        1 x L2 10Gbps Ethernet Adapter
        1 x LSI Mega RAID SAS 9240-8i (no RAID 5 support, Need a card that supports RAID5)
1 x UCSC-C240-M3L
        132 GB RAM
        30 TB SAS HDD
        1 x VIC Card
        1 x Intel I350 Gigabit Ethernet Card with 4 ports
        1 x LSI Mega RAID SAS 9240-8i (no RAID 5 support, Need a card that supports RAID5)
1 x 5548UP Nexus Switch ( Will I be able to use this switch in place of Nexus 2232PP 10GE Fabric Extenders to achieve complete UCS solution)

Cisco UCS Manager 2.2 supports an option to connect the C-Series Rack-Mount Server directly to the Fabric Interconnects. You do not need the Fabric Extenders. This option enables Cisco UCS Manager to manage the C-Series Rack-Mount Servers using a single cable for both management traffic and data traffic.
If you need high performance low latency (storage, for VMware VSAN), direct connection to UCS Fabric Interconnect and/or N5k is recommended.

Want to hear about vCAC when used with Cisco UCS Director... How are you seeing this done?

I have a client that has both VMware vCloud Automation Center, and Cisco UCS Director.
They wish to constuct a net-new (Greenfield) data center and are hearing from both VMware and Cisco.
I have researched, and found little regarding the merger of the two.
I realize that very likely vCAC is teh "main" management platform, while Cisco UCSD will handle the more "physical hardware" tasks.
REST API's will be leveraged as well.
What have you seen written and done in this space when using BOTH?
Please send me any thoughts or links to relevant data.
I am having a hard time locating good data so that I an advise the client in a good way.

Bahi,
just to illustrate what mess this is, I tested for you on Leopard (10.5) and Snow Leopard (10.6) using the same wide gamut monitor. Here are two screenshots from that experiment. I converted the screenshots from my display profile to sRGB to show you what I see and scaled down 50% (this is a 30" behemoth). First Leopard.
You see they are all the same, but different from the sRGB export you provided. The GB sticker is too blue and the tint on the car is wrong. I doubt anybody but a photographer would notice though.
Next is Snow Leopard:
Here the 320 pixel, the 480 pixel and the 960 pixel image are different from the 720 pixel, the 720p and the 1080p ones. Neither is strictly correct as they are all different from the sRGB display. This is consistent with their being no real color management, just gamma corrections and color space transforms (video is usually not stored as RGB but as YUV, necessitating a transform for display). Annoying, but not much you can do about it.
Just doing some quick googling I came across many mentions of issues such as this. It clearly is just a big mess.

Nexus 1000v UCS Manager and Cisco UCS M81KR

Similar Messages

Maybe you are looking for