6248 FI connectivity

Hi I am trying to setup the FI 6248 .After I configured the FI IP's and the Virtual IP.
I am able to access the UCS manager .But when I do "Show Cluster State " it says HA not ready and No device conected to this FI.
I checked and made sure L1 to L1 is connected L2 to L2 is connected and chnaged the cables but still face te same issue.
UCS01-A# show cluster state
Cluster Id: 0xd425c77a752f11e1-0x9eda547fee7429e4
A: UP, PRIMARY
B: UP, SUBORDINATE
HA NOT READY
No device connected to this Fabric Interconnect
UCS01-A#
Can anyone help me wiht this please.
Thanks
Sri

UCS01-A# connect local-mgmt
UCS01-A(local-mgmt)# show cluster state
Cluster Id: 0xd425c77a752f11e1-0x9eda547fee7429e4
A: UP, PRIMARY
B: UP, SUBORDINATE
HA READY
UCS01-A(local-mgmt)# ping 10.45.40.98
PING 10.45.40.98 (10.40.40.98) from 10.45.40.99 : 56(84) bytes of data.
From 10.45.40.99 icmp_seq=1 Destination Host Unreachable
From 10.45.40.99 icmp_seq=2 Destination Host Unreachable
From 10.45.40.99 icmp_seq=3 Destination Host Unreachable
--- 10.45.40.98 ping statistics ---
5 packets transmitted, 0 received, +3 errors, 100% packet loss, time 4023ms
, pipe 3
I have changed the cables but not luck.
Also I do not have network connectivity yet to my FI's ,I connected L1 to L1 and L2 to L2 ,configure my laptop to same subnet and using one of the mangement console port to access UCS.
When I do a ping test one FI A reponds and FI B does not.Vip which is on FI A also reponds since this is on FI A.
If I move it to FI B.The VIP also would not respond.
any help on this would be appreciated
Thank You
Sri

Similar Messages

Dot1q and 6248 Interconnects Connectivity

Hello,
Is dot1q supported on the 6248 Interconnects? We have a few 3750's and we have FC connected from the 3750's to the interconnects with the following configuration:
Int gx/x/x
Switchport mode trunk
Switchport trunk encap dot1q
Switchport trunk allowed vlan 100,105,110,120,130,140,150
No cdp enable
Int gx/x/x
Switchport mode trunk
Switchport trunk encap dot1q
Switchport trunk allowed vlan 100,105,110,120,130,140,150
No cdp enable
Is this type of connection supported? If so, can someone point me to some documentation.....
Thanks

Ok so maybe an SFP issue....
Ethernet1/31
    transceiver is present
    type is Unknown Type-(unknown)
    name is CISCO-FINISAR
    part number is FTLF8528P2BCV-CS
    revision is D
    serial number is FNS154703MG
    nominal bitrate is 8500 MBit/sec
    Link length supported for 50/125um fiber is 50 m
    Link length supported for 50/125um fiber is 150 m
    Link length supported for 62.5/125um fiber is 20 m
    cisco id is --
    cisco extended id number is 4
Ethernet1/32
    transceiver is present
    type is Unknown Type-(unknown)
    name is FINISAR CORP.
    part number is FTLF8524P2BNV
    revision is A
    serial number is U9K0XD6
    nominal bitrate is 4200 MBit/sec
    Link length supported for 50/125um fiber is 150 m
    Link length supported for 62.5/125um fiber is 70 m
    cisco id is --
    cisco extended id number is 4

Fabric Interconnect 6248 & 5548 Connectivity on 4G SFP with FC

Hi,
Recently I came across a scenario when I connected a 4G SFP on Expansion Module of 6248 Fabric Interconnect at one end and at other end 4G SFP on 5548UP. I was unable to establish FC connectivity between both of the devices and the momemt I connected 4G SFP on Fixed Module of 6248 connectivity got established between both the devices
I would like to know do I have to do any changes on FI's Expansion module to get the connectivity working or this kind of behivor is expected behavior
Do let me know if you need any other information on this
Regards,
Amit Vyas

Yes, On FI-B port 15-16 should be in VSAN 101 instead of 100, I have made that correction
Q. are you migrating the fc ports from the fixed to the expansion module ?
     A: As off now I am not migrating FC port but in near future I have to migrate FC ports to Expansion module and I don't want to waste my time for troubleshooting at that time.
Is my understanding correct, that you have 2 links from each FI to a 5548, no port fc port-channel ?
     A: Yes, your understanding is correct we have 2 links from each FI to 5548 and no FC port-channel is configured
I will do the FC port-channel later on once I am able to fix the connectivity issue
I will try to put 4G SFP on expansion module and will provide you output of "show interface brife"
Following is the out of "show interface brife" from both 5548UP switches
Primary5548_SW# show interface brief
Interface Vsan   Admin Admin   Status          SFP    Oper Oper   Port
                  Mode   Trunk                          Mode Speed Channel
                         Mode                                 (Gbps)
fc1/29     100    auto   on      up               swl    F       4    --
fc1/30     100    auto   on      up               swl    F       4    --
fc1/31     100    auto   on      up               swl    F       4    --
fc1/32     100    auto   on      up               swl    F       4    --
Ethernet      VLAN    Type Mode   Status Reason                   Speed     Port
Interface                                                                    Ch #
Eth1/1        1       eth access down    Link not connected          10G(D) --
Eth1/2        1       eth access down    Link not connected          10G(D) --
Eth1/3        1       eth access down    SFP not inserted            10G(D) --
Eth1/4        1       eth access down    SFP not inserted            10G(D) --
Eth1/5        1       eth access down    SFP not inserted            10G(D) --
Eth1/6        1       eth access down    SFP not inserted            10G(D) --
Eth1/7        1       eth access down    SFP not inserted            10G(D) --
Eth1/8        1       eth access down    SFP not inserted            10G(D) --
Eth1/9        1       eth access down    SFP not inserted            10G(D) --
Eth1/10       1       eth access down    SFP not inserted            10G(D) --
Eth1/11       1       eth access down    SFP not inserted            10G(D) --
Eth1/12       1       eth access down    SFP not inserted            10G(D) --
Eth1/13       1       eth access down    SFP not inserted            10G(D) --
Eth1/14       1       eth access down    SFP not inserted            10G(D) --
Eth1/15       1       eth access down    SFP not inserted            10G(D) --
Eth1/16       1       eth access down    SFP not inserted            10G(D) --
Eth1/17       1       eth access down    SFP not inserted            10G(D) --
Eth1/18       1       eth access down    SFP not inserted            10G(D) --
Eth1/19       1       eth access down    SFP not inserted            10G(D) --
Eth1/20       1       eth access down    SFP not inserted            10G(D) --
Eth1/21       1       eth access down    SFP not inserted            10G(D) --
Eth1/22       1       eth access down    SFP not inserted            10G(D) --
Eth1/23       1       eth access down    SFP not inserted            10G(D) --
Eth1/24       1       eth access down    SFP not inserted            10G(D) --
Eth1/25       1       eth access down    SFP not inserted            10G(D) --
Eth1/26       1       eth access down    SFP not inserted            10G(D) --
Eth1/27       1       eth access down    SFP not inserted            10G(D) --
Eth1/28       1       eth access down    SFP not inserted            10G(D) --
Eth2/1        1       eth access down    SFP not inserted            10G(D) --
Eth2/2        1       eth access down    SFP not inserted            10G(D) --
Eth2/3        1       eth access down    SFP not inserted            10G(D) --
Eth2/4        1       eth access down    SFP not inserted            10G(D) --
Eth2/5        1       eth access down    SFP not inserted            10G(D) --
Eth2/6        1       eth access down    SFP not inserted            10G(D) --
Eth2/7        1       eth access down    SFP not inserted            10G(D) --
Eth2/8        1       eth access down    SFP not inserted            10G(D) --
Eth2/9        1       eth access down    SFP not inserted            10G(D) --
Eth2/10       1       eth access down    SFP not inserted            10G(D) --
Eth2/11       1       eth access down    SFP not inserted            10G(D) --
Eth2/12       1       eth access down    SFP not inserted            10G(D) --
Eth2/13       1       eth access down    SFP not inserted            10G(D) --
Eth2/14       1       eth access down    SFP not inserted            10G(D) --
Eth2/15       1       eth access down    SFP not inserted            10G(D) --
Eth2/16       1       eth access down    SFP not inserted            10G(D) --
Port   VRF          Status IP Address                              Speed    MTU
mgmt0 --           up     172.20.10.82                            1000     1500
Interface Vsan   Admin Admin   Status      Bind                 Oper    Oper
                  Mode   Trunk               Info                 Mode    Speed
                         Mode                                            (Gbps)
vfc1       100    F     on     errDisabled Ethernet1/1              --
Primary5548_SW#
Secondary5548_SW# show interface brief
Interface Vsan   Admin Admin   Status          SFP    Oper Oper   Port
                  Mode   Trunk                          Mode Speed Channel
                         Mode                                 (Gbps)
fc1/29     101    auto   on      up               swl    F       4    --
fc1/30     101    auto   on      up               swl    F       4    --
fc1/31     101    auto   on      up               swl    F       4    --
fc1/32     101    auto   on      up               swl    F       4    --
Ethernet      VLAN    Type Mode   Status Reason                   Speed     Port
Interface                                                                    Ch #
Eth1/1        1       eth access down    Link not connected          10G(D) --
Eth1/2        1       eth access down    Link not connected          10G(D) --
Eth1/3        1       eth access down    SFP not inserted            10G(D) --
Eth1/4        1       eth access down    SFP not inserted            10G(D) --
Eth1/5        1       eth access down    SFP not inserted            10G(D) --
Eth1/6        1       eth access down    SFP not inserted            10G(D) --
Eth1/7        1       eth access down    SFP not inserted            10G(D) --
Eth1/8        1       eth access down    SFP not inserted            10G(D) --
Eth1/9        1       eth access down    SFP not inserted            10G(D) --
Eth1/10       1       eth access down    SFP not inserted            10G(D) --
Eth1/11       1       eth access down    SFP not inserted            10G(D) --
Eth1/12       1       eth access down    SFP not inserted            10G(D) --
Eth1/13       1       eth access down    SFP not inserted            10G(D) --
Eth1/14       1       eth access down    SFP not inserted            10G(D) --
Eth1/15       1       eth access down    SFP not inserted            10G(D) --
Eth1/16       1       eth access down    SFP not inserted            10G(D) --
Eth1/17       1       eth access down    SFP not inserted            10G(D) --
Eth1/18       1       eth access down    SFP not inserted            10G(D) --
Eth1/19       1       eth access down    SFP not inserted            10G(D) --
Eth1/20       1       eth access down    SFP not inserted            10G(D) --
Eth1/21       1       eth access down    SFP not inserted            10G(D) --
Eth1/22       1       eth access down    SFP not inserted            10G(D) --
Eth1/23       1       eth access down    SFP not inserted            10G(D) --
Eth1/24       1       eth access down    SFP not inserted            10G(D) --
Eth1/25       1       eth access down    SFP not inserted            10G(D) --
Eth1/26       1       eth access down    SFP not inserted            10G(D) --
Eth1/27       1       eth access down    SFP not inserted            10G(D) --
Eth1/28       1       eth access down    SFP not inserted            10G(D) --
Eth2/1        1       eth access down    SFP not inserted            10G(D) --
Eth2/2        1       eth access down    SFP not inserted            10G(D) --
Eth2/3        1       eth access down    SFP not inserted            10G(D) --
Eth2/4        1       eth access down    SFP not inserted            10G(D) --
Eth2/5        1       eth access down    SFP not inserted            10G(D) --
Eth2/6        1       eth access down    SFP not inserted            10G(D) --
Eth2/7        1       eth access down    SFP not inserted            10G(D) --
Eth2/8        1       eth access down    SFP not inserted            10G(D) --
Eth2/9        1       eth access down    SFP not inserted            10G(D) --
Eth2/10       1       eth access down    SFP not inserted            10G(D) --
Eth2/11       1       eth access down    SFP not inserted            10G(D) --
Eth2/12       1       eth access down    SFP not inserted            10G(D) --
Eth2/13       1       eth access down    SFP not inserted            10G(D) --
Eth2/14       1       eth access down    SFP not inserted            10G(D) --
Eth2/15       1       eth access down    SFP not inserted            10G(D) --
Eth2/16       1       eth access down    SFP not inserted            10G(D) --
Port   VRF          Status IP Address                              Speed    MTU
mgmt0 --           up     172.20.10.84                            1000     1500
Interface Vsan   Admin Admin   Status      Bind                 Oper    Oper
                  Mode   Trunk               Info                 Mode    Speed
                         Mode                                            (Gbps)
vfc1       1      F     on     errDisabled Ethernet1/1              --
Secondary5548_SW#

6248 connected to 3750 yet ports not configured as trunkport

I've setup a 2 5108's with 6248 Fabrics and my ethernet uplinks are going to a 3750x. I'm not proficient with all that comes with switching but I manage to get my systems up and running effectively. After installing my esxi's on the systems I noticed that all of them were getting DHCP addressed from my network yet although I enabled my uplinks and configured them as 1gb I hadn't move the patch cables to the uplink ports on the 3750 configured as Trunk ports. Now in the past this was a show stopper. Am I missing something here. And lastly, I intend to aggregate some links with Port Channeling which is easy enough on the UCS but a note states the upstream switch needs to be configured as LACP.
In short:
1.) Do i need to configure my ports on the 3750 as Trunk dot1q or has something changed and it's auto-sensing
2.) To do the Port Channel does it require Trunk or Switch and is it absolute that I configure LACP on the upstream 3750.
Thanks

I understand Trunking, a little however, when it comes to the UCS fabrics I have never been able to configure the upstream switch with anything other than Trunk Mode where I connect my ethenet uplink ports. Yet using a newer 3750x it is running without trunkports where my uplinks are connected. This is not normal. My test....I moved the patch cables to the configured Trunk Ports on the upstream 3750 and it stopped working, moved them back to the switchports and it started working. Next to this system is another with an earlier model 3750, (sorry I'm missing the specifics) and this will not work with the switctport mode, yet when plugged into the trunk ports of the upstream 3750 it works fine. As for Vlan's I have one other than Vlan 1 which is always the way I've configured these. I've configured about 15 sets of fabrics and only this one is acting this way.
As for the Port Channel configuration thanks. I'm assuming that even in trunk mode I can set LACP.

Cisco 6248 Connectivity Limitations

Hello,
I am new to the UCS Fabric Interconnects and am wondering if there are limitations to connecting a Cisco 3925 Gen 2 ISR (desinated Voice Gateway) to a fabric interconnect, specifically a 6248 with the latest version of code. It appears that the FI's support 802.1Q VLAN encapsulation and trunking, which is typically configured in the cisco voice world for any downstream switchport interface to pass Voice, Data, Server VLAN's to the corresponding devices. It also appears that the FI's will support some forms of quality service, like Priority Queing. I have not seen where the FI's support LLQ or CBWFQ. So at the end of the day I would like to know if there are any limitations to connecting a Cisco 3925 Gen 2 ISR to which will be used as a Voice Gateway. I know that typically its best practice to connect to some other switch, but since the FI has the capabilitiy to running in "switched-mode" I didnt know if this would work. Thanks to all that review this as well as thanks in advance to anyone who lends any thoughts
- TA

SAN port-channels are not supported between UCS FI and Brocade SAN switches. You will need to use individual links.
Leave the UCS fibre channel in default end-host-mode. This will connect to Brocade in the Access Gateway mode (Cisco's NPIV)

Connecting 3560 with Dell 6248 for Storage Migration

I am looking at an old test and dev virtual infrastructure configuration that was set up with a 1GB Linksys Switch and a Dell 6248 Switch (attached pic is a representation).
The reason given for the Linksys in the config is it was the only 1GB switch available at the time when the SAN had to be installed and there were no more available ports on the 6248.Running Dell Dpack reports show latency issues when migrating from an EqualLogic Volume to a MD3200 volume and from the MD3200 to Md3200 volumes (on the order of 30-45 minutes for a 20GB VM). Migrating from EqualLogic volumes to EqualLogic volumes is in seconds.
I think the Linksys is the issue as does our Dell reps. We are looking at replacing the Linksys with a Cisco or another L2/L3.
I have a Cisco 3560 installed but am not familiar with configuration. I downloaded the Cisco Network Assistant (CNA) in order to configure the switch into the environment via a web browser. As noted in the infrastructure pic, the SAN traffic is isolated to VLAN 10 on the Dell Switch. In the second pic, I show the CNA and I am setting up a VLAN 10 on the Cisco switch and then want to connect the Md3200 to the Cisco which will be connected to VLAN 10 on the Dell Switch for access to an EqualLogic SAN
I am not sure I have the correct menu setting in the CNA for setting up VLAN 10 or if this is the best option?
Any help would be appreciated.
Thanks

Hi,
I have several E6420, O3010 and since a week also some E7440 and E7240 on site.
I never had issues using the current Dell PE package for MDT.
At the moment my PE contains only the drivers from the Dell PE 3.0 package (WinPE3.0-Drivers-A13-D67JC)
and all my systems mentioned abobe have no issues connecting to the deployment share.
(btw: I have also some older E6400, E6410 and O390 I do no longer support, they
are supported by the pack Dell-WinPE-Drivers-A05.CAB according
to the Dell site, but I just started a deplymenst on a E6410 and is is also workign with just the latest PE pack)
I'd
suggest you start over with your deplyoment share using at least MDT2012 Update 1.
Create a folder "PE" under "Out-of-Box Drivers" and extract latest Dell PE pack and import he drivers there
Create a selection profile e.g. "PE Drivers" and include just the "PE" folder created above
When configuring the Windows PE settings of your deployment share select "PE
Drivers" selection profile for the driver injection in the "Drivers and Patches" to keep the PE image free of not needed drives.

Connecting UCS 6248 FI to N5K-C5548UP

hi,
How do i connect UCS 6248 Fabric Interconnect to N5K-C5548UP? do i need to use FCoE or vPC as i will have multiple SAN connected (using FC) on FI.
Please suggest best possible solution where i have minimul cabling hedache & can optimise physicl ports on N5K.
Regards
Mahesh

Hi Mahesh,
vPC for FCoE uplink and / or unified uplinks is not supported at this time.
vPC only for pure ethernet uplinks still works the same way.
./Abhinav

Connect CS 6248 FI to N5K-C5548UP

How do i connect UCS 6248 Fabric Interconnect to N5K-C5548UP? do i need to use FCoE or vPC as i will have multiple SAN connected (using FC) on FI.
Please suggest best possible solution where i have minimul cabling hedache & can optimise physicl ports on N5K.

Mahesh,
Have you read through the UCS Deployment Guide? I would suggest starting there. After you're familiar with the options we can discuss/recommend further.
http://www.cisco.com/en/US/docs/solutions/Enterprise/Borderless_Networks/Smart_Business_Architecture/February2012/SBA_Mid_DC_UnifiedComputingSystemDeploymentGuide-February2012.pdf
Regards,
Robert

Connectivity between UCS 6249 - UCS 6248 Switches and 10GB iscsi on EMC Storage - VNXe 3200

Hi
I am trying to check VNXe 3200 Connectivity with SFP+ ( Cisco UCS 6249 - UCS 6248 Switches )
will the 10 GB iscsi fiber / Copper connect directly to the UCS 6248 and what is the type of Cables ?
will SFP and SFP+ connect to each other or that will cause some issues?
i tried to search the EMC side but getting difficulty to get the Document showing the Comparability but expecting soon so wanted to check from Cisco side
I know this is the Guide to refer to
http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6200-series-fabric-interconnects/data_sheet_c78-675245.pdf
but please help me finding answers
Thanks

Hi Sami
https://community.emc.com/message/841141#841141
has the answer
EMC does not support Passive Twinaxial cables in an iSCSI or FCOE environment.
EMC only supports Active Twinaxial cables in an iSCSI or FCOE environment.
We currently support EMC, Brocade and Cisco cables.
SFP-H10GB-ACU7M and SFP-H10GB-ACU10M are active twinax cables
see http://www.cisco.com/c/en/us/td/docs/interfaces_modules/transceiver_modules/compatibility/matrix/10GE_Tx_Matrix.html
https://community.emc.com/message/837419 might also be useful.
Walter.

Connect standalone server to UCS (6248)?

Can you connect a normal server (w/1gb NIC) to a fabric interconnect? As far as I understand it, the only possible way would be to configure an uplink port (which gets created as a trunk) which would require the server NIC to also be in trunk mode, which I don't want to do. Appliance ports are only for direct connect NFS storage and Server ports are 10gb only (used mainly for connecting to a UCS chassis).
I have a general Dell server in the same rack as our UCS environment and I don't want to have to run a cable to an adjacent rack if possible. The only situation I can find where you would connect a non-blade to the FIs would be a C-Series standalone server, which uses an Uplink port on the FI.
Just wondering if anyone has used their FIs in this way.
Thanks!

Hi Ross,
The only rack servers which we support to be connected to the UCS FI are the C series servers. One of the reasons being they running the CIMC which the UCSM uses to manage and configure the rack server (almost like the way we do with our blades).
./Abhinav

How to tell if VLAN added to 6248s?

We are working to solve a connectivity problem with virtual machines on a Distributed Virtual Switch.
They are connected to a distributed port group that is configured with a VLAN, and the VLAN ID is entered in the distributed port group's properties as you would expect.
When I look in UCS Manager, I see the VLAN exists and of course this maps to the VLAN on the distributed virtual port group in vSphere.
The VMs still have no connectivity, even though things look right in vCenter and in UCS Manager.
How can I check on the 6248s to see if the VLAN has been added to the trunk down from the upstream switches?
And/or is there any other way I can verify the VLAN is accessible?
Thanks,
Mike

Mike,
Glad to see issue is figured out already, just to add a detail for future reference in case you want to see VLANs allowed for a particular uplink.
You can find out allowed VLANs on a vEthernet interface with the following commands:
A# connect nxos a/b <<< a OR b depending on which FI you want to investigate
A(nxos)# sh pinning border-interfaces << Will show uplink interface(s) each vEth is pinned to to get to the outside world
---------------------------+---------+----------------------------------------
Border Interface           Status    SIFs
---------------------------+---------+----------------------------------------
Po1 < uplink                 Active       VethX VethY VethM     <<< Interfaces VethX VethY VethM will use Po1 to go up
A(nxos)# sh inter vethernet x switchport << (x= choose any of the vEths) , this will show you allowed vlans
Name: Vethernetx
Switchport: Enabled
Switchport Monitor: Not enabled
Operational Mode: trunk
Access Mode VLAN: 1 (default)
Trunking Native Mode VLAN: 1 (default)
Trunking VLANs Enabled: 1
Hope that help somehow in the future
-Kenny

Configuration Guide for 6248 and 5548 and VNX 5500

Hi,
Need help here to configure the FCoE Uplink + Ethernet Uplink in Port channel
Following is the connectivity details from 6248, 5548 and VNX5500.
I have configured Port Channel in following way on Both Fabric Interconnect
After Configuring above things I am getting following Faults on Servers
For NetApp3240 ENM source pinning failed, I have allowed VLAN ID 21 in Uplink manager then too this Link state is not showing UP and Same thing go for both FC_vHBA
Kinldy help me to configure the setup
-Amit

Below is the ouput for two commands "show run int port-channel membership" and "sh int port-channel "
===========================================================================
primary# sh run int po2 membership
!Command: show running-config interface port-channel2 membership
!Time: Wed Feb 25 07:55:31 2009
version 5.2(1)N1(1b)
interface port-channel2
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
spanning-tree port type edge
spanning-tree bpdufilter enable
interface Ethernet1/3
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
interface Ethernet1/4
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
interface Ethernet1/5
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
===========================================================================
primary# sh run int po3 membership
!Command: show running-config interface port-channel3 membership
!Time: Wed Feb 25 07:57:14 2009
version 5.2(1)N1(1b)
interface port-channel3
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
spanning-tree port type edge
spanning-tree bpdufilter enable
interface Ethernet1/8
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
interface Ethernet1/9
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
interface Ethernet1/10
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
===========================================================================
primary# sh int po2
port-channel2 is up
Hardware: Port-Channel, address: 002a.6a0a.4caa (bia 002a.6a0a.4caa)
Description: ***Link to FI-A in R17***
MTU 1500 bytes, BW 30000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/3, Eth1/4, Eth1/5
Last clearing of "show interface" counters never
30 seconds input rate 504 bits/sec, 0 packets/sec
30 seconds output rate 2256 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
    input rate 456 bps, 0 pps; output rate 656 bps, 0 pps
RX
    22208045 unicast packets 747374 multicast packets 27634234 broadcast packets
    50589653 input packets 49083144072 bytes
    21411174 jumbo packets 0 storm suppression bytes
    0 runts 0 giants 0 CRC 0 no buffer
    0 input error 0 short frame 0 overrun   0 underrun 0 ignored
    0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
    0 input with dribble 0 input discard
    0 Rx pause
TX
    2801196 unicast packets 353162904 multicast packets 549464 broadcast packets
    356513564 output packets 25978572978 bytes
    101325 jumbo packets
    0 output errors 0 collision 0 deferred 0 late collision
    0 lost carrier 0 no carrier 0 babble 0 output discard
    0 Tx pause
35 interface resets
===========================================================================
primary# sh int po3
port-channel3 is up
Hardware: Port-Channel, address: 002a.6a0a.4caf (bia 002a.6a0a.4caf)
Description: ***Link to FI-B in R18***
MTU 1500 bytes, BW 30000000 Kbit, DLY 10 usec
reliability 48052/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/8, Eth1/9, Eth1/10
Last clearing of "show interface" counters never
30 seconds input rate 104 bits/sec, 0 packets/sec
30 seconds output rate 1704 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
    input rate 448 bps, 0 pps; output rate 1.08 Kbps, 0 pps
RX
    9070 unicast packets 288523 multicast packets 143322 broadcast packets
    440915 input packets 72677230 bytes
    7 jumbo packets 0 storm suppression bytes
    0 runts 0 giants 36 CRC 0 no buffer
    2161727821137838086 input error 0 short frame 0 overrun   0 underrun 0 ignored
    0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
    0 input with dribble 0 input discard
    0 Rx pause
TX
    62914 unicast packets 74425404 multicast packets 14434365 broadcast packets
    88922683 output packets 7182753461 bytes
    14 jumbo packets
    0 output errors 0 collision 0 deferred 0 late collision
    0 lost carrier 0 no carrier 0 babble 0 output discard
    0 Tx pause
17 interface resets
===========================================================================
secondary# sh run int po2 mem
!Command: show running-config interface port-channel2 membership
!Time: Wed Feb 25 07:56:41 2009
version 5.2(1)N1(1b)
interface port-channel2
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
spanning-tree port type edge
spanning-tree bpdufilter enable
interface Ethernet1/8
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
interface Ethernet1/9
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
interface Ethernet1/10
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 2 mode active
===========================================================================
secondary# sh run int po3 mem
!Command: show running-config interface port-channel3 membership
!Time: Wed Feb 25 07:58:30 2009
version 5.2(1)N1(1b)
interface port-channel3
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
spanning-tree port type edge
spanning-tree bpdufilter enable
interface Ethernet1/3
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
interface Ethernet1/4
description ***Link to FI-A in R17***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
interface Ethernet1/5
description ***Link to FI-B in R18***
switchport mode trunk
switchport trunk allowed vlan 12-13,21,101-600
channel-group 3 mode active
===========================================================================
secondary# sh int po2
port-channel2 is up
Hardware: Port-Channel, address: 002a.6a0a.4d6f (bia 002a.6a0a.4d6f)
Description: ***Link to FI-A in R17***
MTU 1500 bytes, BW 30000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/8, Eth1/9, Eth1/10
Last clearing of "show interface" counters never
30 seconds input rate 1752 bits/sec, 0 packets/sec
30 seconds output rate 1016 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
    input rate 832 bps, 0 pps; output rate 496 bps, 0 pps
RX
    76009142 unicast packets 544440 multicast packets 228999 broadcast packets
    76782581 input packets 146179423660 bytes
    68566412 jumbo packets 0 storm suppression bytes
    0 runts 0 giants 0 CRC 0 no buffer
    0 input error 0 short frame 0 overrun   0 underrun 0 ignored
    0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
    0 input with dribble 0 input discard
    0 Rx pause
TX
    192711593 unicast packets 154928956 multicast packets 31420967 broadcast packets
    379061516 output packets 385914168860 bytes
    179761364 jumbo packets
    0 output errors 0 collision 0 deferred 0 late collision
    0 lost carrier 0 no carrier 0 babble 0 output discard
    0 Tx pause
24 interface resets
===========================================================================
secondary# sh int po3
port-channel3 is up
Hardware: Port-Channel, address: 002a.6a0a.4d6a (bia 002a.6a0a.4d6a)
Description: ***Link to FI-B in R18***
MTU 1500 bytes, BW 30000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/3, Eth1/4, Eth1/5
Last clearing of "show interface" counters never
30 seconds input rate 456 bits/sec, 0 packets/sec
30 seconds output rate 1784 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
    input rate 456 bps, 0 pps; output rate 912 bps, 0 pps
RX
    75986748 unicast packets 490267 multicast packets 124569 broadcast packets
    76601584 input packets 146159548726 bytes
    68566413 jumbo packets 0 storm suppression bytes
    0 runts 0 giants 0 CRC 0 no buffer
    0 input error 0 short frame 0 overrun   0 underrun 0 ignored
    0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
    0 input with dribble 0 input discard
    0 Rx pause
TX
    192585042 unicast packets 190939131 multicast packets 13399201 broadcast packets
    396923374 output packets 386206869311 bytes
    179761514 jumbo packets
    0 output errors 0 collision 0 deferred 0 late collision
    0 lost carrier 0 no carrier 0 babble 0 output discard
    0 Tx pause
24 interface resets
===========================================================================
We have removed vPC configuration as we are facing same problem as i said in my previous post
id     Port        Status Consistency Reason                     Active vlans
2      Po2         up     failed      vpc port channel           -
                                      mis-config due to vpc
                                      links in the 2 switches
                                      connected to different
                                      partners
Do let me know if anything else is required from my end
-amit

Port Mapping 6120 to 6248 FI Upgrade

I am planning the upgrade for our 6120XP FIs to be replaced with 6248s. I have the read the upgrade guide and need a little clarification. In our 6120s we are utilizing the N10-E0060 FC expansion slot for storage connectivity. We are not utilizing an expansion module with our 6248s as the 32 fixed universal ports provide sufficient port capacity for our environment.
The upgrade guide refers to mapping slot 2 ports on the 6120 to slot 2 on the 6248. How do I proceed with the upgrade process without slot 2? Will the 6248 automatically detect the FC SFPs in the higher order fixed ports and divide the slot 1 ports into Ethernet and FC pools automatically? Or do I need to manually specify the division between Ethernet and FC? I am also assuming that manual remapping will be necessary as I will be changing from 2/X ports to 1/X ports?
Thanks!

In line with what Chris stated about the unified port wizard. The FC port/Ethernet ports must be contiguous, what I mean by this is that you can't make ports 1/12-13 FC and then make ports 1/14-5 Ethernet. Best practice is to start at the right and work to the left for the FC ports. I usually make at least ports 1/29-32 FC, this will give you 4 FC ports, for larger environments I would do 6. You must do this on each Fabric Interconnect but only do 1 at at time. As soon as you hit finish on the unified port tool the FI will reboot.
If you had the optional expansion module and you changed some of those ports to be FC then only the expansion module would get reset instead of a switch reboot.
I did a blog post on this subject last year - http://jeremywaldrop.wordpress.com/2011/11/08/cisco-ucs-6248-unified-port-configuration/

Ucs 6248 HA cluster can not login

6248-A manager ip1.1.1.2
6248-B manager ip1.1.1.3
cluster VIP 1.1.1.1
cisco6248-A# show cluster extended-state
Cluster Id: 0xd59a70527a4111e2-0x8b74547feebbcd64
Start time: Sat Feb 23 12:44:03 2013
Last election time: Sat Feb 23 12:55:11 2013
A: UP, PRIMARY
B: UP, SUBORDINATE
A: memb state UP, lead state PRIMARY, mgmt services state: UP
B: memb state UP, lead state SUBORDINATE, mgmt services state: UP
heartbeat state PRIMARY_OK
INTERNAL NETWORK INTERFACES:
eth1, UP
eth2, UP
HA READY
Detailed state of the device selected for HA storage:
Chassis 1, serial: FOX1618GW6D, state: active
Chassis 2, serial: FOX1625GAB0, state: active
Chassis 3, serial: FOX1613G1LV, state: active
MY PC IP 1.1.1.10 can ping all 1.1.1.1/2/3.and https all
but when i reload 6248-A ,can not ping 1.1.1.1,but can ping 1.1.1.3.
also can not https://1.1.1.1 (login error:failed login info:ucsm is not available on secondary node)
when 6248A reload ok,can ping 1.1.1.1/2/3,and https all
if fi6248 cluster is not ok?

Hello,
When you reload FI-A ( active primary ) , virtual IP is owned by FI-B, and should be become primary. Once it becomes primary, you should be able to access UCSM or SSH into FI via Virtual IP address ( 1.1.1.1 ).
1) How are these FI mgmt ports connected to upstream switch / L3 gateway ?
2) Are you able to SSH into FI-B with 1.1.1.1 ( when FI-A is reloading ) ?
3) Have you configured any mgmt interface monitoring policy ?
http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/gui/config/guide/2.0/b_UCSM_GUI_Configuration_Guide_2_0_chapter_0101010.html#d75788e1551a1635
Padma

Ask the Expert : Initial Set Up and LAN Connectivity for Cisco UCS Servers

Welcome to the Cisco Support Community Ask the Expert conversation. This is an opportunity to learn and ask questions about related to the initial setup of UCS C & B Series which include LAN connectivity from the UCS perspective with Cisco subject matter expert Kenny Perez.
In particularly, Kenny will cover topics such as: ESXi/Windows installations, RAID configurations (best practices for good performance and configuration), VLAN/Jumbo Frames configuration for B series and C series servers, Pools/Policies/Upgrades/Templates/Troubleshooting Tips for blade and rack servers, Fabric Interconnects configuration, general compatibility of Hardware/Software/drivers amongst other topics
Kenny Perez is a technical leader in Cisco Technical Assistance Center, where he works in Server Virtualization support team. His main job consists of supporting customers to implement and manage Cisco UCS B series and C series. He has background in computing, networking, and Vmware ESXi and has 3+ years of experience support UCS servers and is VCP certified.
Remember to use the rating system to let Kenny know if he has given you an adequate response.
This event lasts through October 10th, 2014. Visit this forum often to view responses to your questions and the questions of other Cisco Support Community members.

Hi,
Actually we have UCS 6248 fabric interconnect - first twelve ports are enabled and same in Cisco UCS Manager.
But when more port will be active by expansion module then UCSM can manage that too or need any other licence for UCSM too?

6248 FI connectivity

Similar Messages

Maybe you are looking for