Connecting UCS 6248 FI to N5K-C5548UP
hi,
How do i connect UCS 6248 Fabric Interconnect to N5K-C5548UP? do i need to use FCoE or vPC as i will have multiple SAN connected (using FC) on FI.
Please suggest best possible solution where i have minimul cabling hedache & can optimise physicl ports on N5K.
Regards
Mahesh
Hi Mahesh,
vPC for FCoE uplink and / or unified uplinks is not supported at this time.
vPC only for pure ethernet uplinks still works the same way.
./Abhinav
Similar Messages
-
Connect CS 6248 FI to N5K-C5548UP
How do i connect UCS 6248 Fabric Interconnect to N5K-C5548UP? do i need to use FCoE or vPC as i will have multiple SAN connected (using FC) on FI.
Please suggest best possible solution where i have minimul cabling hedache & can optimise physicl ports on N5K.Mahesh,
Have you read through the UCS Deployment Guide? I would suggest starting there. After you're familiar with the options we can discuss/recommend further.
http://www.cisco.com/en/US/docs/solutions/Enterprise/Borderless_Networks/Smart_Business_Architecture/February2012/SBA_Mid_DC_UnifiedComputingSystemDeploymentGuide-February2012.pdf
Regards,
Robert -
Connectivity between UCS 6249 - UCS 6248 Switches and 10GB iscsi on EMC Storage - VNXe 3200
Hi
I am trying to check VNXe 3200 Connectivity with SFP+ ( Cisco UCS 6249 - UCS 6248 Switches )
will the 10 GB iscsi fiber / Copper connect directly to the UCS 6248 and what is the type of Cables ?
will SFP and SFP+ connect to each other or that will cause some issues?
i tried to search the EMC side but getting difficulty to get the Document showing the Comparability but expecting soon so wanted to check from Cisco side
I know this is the Guide to refer to
http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6200-series-fabric-interconnects/data_sheet_c78-675245.pdf
but please help me finding answers
ThanksHi Sami
https://community.emc.com/message/841141#841141
has the answer
EMC does not support Passive Twinaxial cables in an iSCSI or FCOE environment.
EMC only supports Active Twinaxial cables in an iSCSI or FCOE environment.
We currently support EMC, Brocade and Cisco cables.
SFP-H10GB-ACU7M and SFP-H10GB-ACU10M are active twinax cables
see http://www.cisco.com/c/en/us/td/docs/interfaces_modules/transceiver_modules/compatibility/matrix/10GE_Tx_Matrix.html
https://community.emc.com/message/837419 might also be useful.
Walter. -
hi,every .
i use GLC-T to connect ucs 6120 and cisco2960s (RJ45),.have sfp validation failed problem.
I have done speed to 1G then I am getting error " link not connected" even I have connected the nnetwork cable..UCS6120-A(nxos)# show interface e1/7
Ethernet1/7 is down (SFP validation failed)
Hardware: 1000/10000 Ethernet, address: 0005.73d2.934e (bia 0005.73d2.934e)
Description: U: Uplink
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
auto-duplex, 1000 Mb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped never
Last clearing of "show interface" counters never
30 seconds input rate 0 bits c, 0 bytes c, 0 packets c
30 seconds output rate 0 bits c, 0 bytes c, 0 packets c
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 0 bps, 0 pps
RX
0 unicast packets 0 multicast packets 0 broadcast packets
0 input packets 0 bytes
--More-- -
Please tell me how to connect with FCoE UCS-mini and Nexus N5k (N5K-C5548UP-B-S32)
I have UCS 5108 Blade Server Chassis (with two B200 M3 Blade Servers inside and two FI 6324) connected to Nexus N5k switch through 4x10GE links.
I want to configure the two aggregated channels FCoE (vFC) from chassi to switch.
All instructions I've been seen refer to the fact that UCS-mini must be in the FC end-host mode, but UCSM 3.0 version does not support this mode, what shoud I do?
I set up following the instructions www.cisco.com/c/en/us/support/docs/switches/nexus-5000-series-switches/116248-configure-fcoe-00.html
But, after setup I have a fault on fabric: FCoE or FC uplink is down on Vsan 500;
And in Nexus: Vsan 500 is down (waiting for flogi)
When I do "show interface vfc 1" from Nexus CLI I see no 'Trunk vsans (up)', but
'Trunk vsans (initializing) (500)'
Unfortunately, I can't find technical notes for UCS mini (with UCSM v. 3.0), so may be You can promt any guides or suggestion for this?
Thank You in advance!The release notes of 3.0.1e, which is for UCS-mini,
http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/release/notes/ucs_3_0_rn.html
says:
Unsupported Features
The following features are not supported in Cisco UCS Manager, Release 3.0:
Features, defect fixes, and platforms introduced in Cisco UCS Manager, Release 2.2(2c) and newer that are not explicitly called out in New Features or Resolved Caveats sections of this document.
Some features introduced in Cisco UCS Manager, Release 2.2(1b) and earlier releases:
–Ethernet Switching Mode
–FC End Host Mode
– Private VLANs
– Port Security
– KVM Virtualization is not tested (although not explicitly disabled) -
Connect standalone server to UCS (6248)?
Can you connect a normal server (w/1gb NIC) to a fabric interconnect? As far as I understand it, the only possible way would be to configure an uplink port (which gets created as a trunk) which would require the server NIC to also be in trunk mode, which I don't want to do. Appliance ports are only for direct connect NFS storage and Server ports are 10gb only (used mainly for connecting to a UCS chassis).
I have a general Dell server in the same rack as our UCS environment and I don't want to have to run a cable to an adjacent rack if possible. The only situation I can find where you would connect a non-blade to the FIs would be a C-Series standalone server, which uses an Uplink port on the FI.
Just wondering if anyone has used their FIs in this way.
Thanks!Hi Ross,
The only rack servers which we support to be connected to the UCS FI are the C series servers. One of the reasons being they running the CIMC which the UCSM uses to manage and configure the rack server (almost like the way we do with our blades).
./Abhinav -
Ucs 6248 HA cluster can not login
6248-A manager ip1.1.1.2
6248-B manager ip1.1.1.3
cluster VIP 1.1.1.1
cisco6248-A# show cluster extended-state
Cluster Id: 0xd59a70527a4111e2-0x8b74547feebbcd64
Start time: Sat Feb 23 12:44:03 2013
Last election time: Sat Feb 23 12:55:11 2013
A: UP, PRIMARY
B: UP, SUBORDINATE
A: memb state UP, lead state PRIMARY, mgmt services state: UP
B: memb state UP, lead state SUBORDINATE, mgmt services state: UP
heartbeat state PRIMARY_OK
INTERNAL NETWORK INTERFACES:
eth1, UP
eth2, UP
HA READY
Detailed state of the device selected for HA storage:
Chassis 1, serial: FOX1618GW6D, state: active
Chassis 2, serial: FOX1625GAB0, state: active
Chassis 3, serial: FOX1613G1LV, state: active
MY PC IP 1.1.1.10 can ping all 1.1.1.1/2/3.and https all
but when i reload 6248-A ,can not ping 1.1.1.1,but can ping 1.1.1.3.
also can not https://1.1.1.1 (login error:failed login info:ucsm is not available on secondary node)
when 6248A reload ok,can ping 1.1.1.1/2/3,and https all
if fi6248 cluster is not ok?Hello,
When you reload FI-A ( active primary ) , virtual IP is owned by FI-B, and should be become primary. Once it becomes primary, you should be able to access UCSM or SSH into FI via Virtual IP address ( 1.1.1.1 ).
1) How are these FI mgmt ports connected to upstream switch / L3 gateway ?
2) Are you able to SSH into FI-B with 1.1.1.1 ( when FI-A is reloading ) ?
3) Have you configured any mgmt interface monitoring policy ?
http://www.cisco.com/en/US/docs/unified_computing/ucs/sw/gui/config/guide/2.0/b_UCSM_GUI_Configuration_Guide_2_0_chapter_0101010.html#d75788e1551a1635
Padma -
Cisco UCS 6248 and Dell EQ 6510x
We have a Dell EQ 6510x we have in production and we are about to power on a Cisco UCS B series chassis and a pair of 6248UP FIs. I'm planning to connect the 4 6510x 10G ports directly to the 6248 FIs and set them as Applicance Ports.
My question is would be be better to connect the 6510x Primary controller's two 10G ports directly to FI-A and the standby controller 10G ports directly to FI-B, or stagger them? Stagger meaning Primary Controller one10G to FI-A and one 10G to FI-B then Standby controller one 10G to FI-A and one10G to FI-B. Thanks!Hello there,
In your design always keep in mind that both UCS FI are separate switches, they always will talk each other by the upstream switch. The best pratice is connect anything that have to talk with UCS domain in the upstream switch.
If there is no option to do so, you can connect through the FIs, using a appliance port. In your case I believe that connect stagger mode is the best option, but I'm not sure, depends how your vnics are configured and if your Dell EQ can do port-channel in active-standby mode. -
Cisco UCS Blade Deployment Without N5K or N7K ?
Dear all,
Is it possbile to deploy cisco UCS blade solution with only Blade Chassis, FI, FEX/IOM and using third party SAN and LAN switch ?
ThanksYes of course !
There are many installations with e.g. Brocade FC switches
The only caveat I see: are your uplink ethernet switches 1G or 10G; technically either one will work, however, with 1 G Northbound connectivity, some data flows are limited in bandwidth. see below -
UCS 6248 Fabric Interconnect loud fan RPM noise
Hello,
Our currently installed 6248 Fabric Interconnect pair are generating a loud FAN noise.
Is there any way to reduce theirs RPM? So then can be quieter? The server room have proper air conditioning.
Some logs as bellow:
FABRIC-A(nxos)# show environment fan detail
Fan:
Module Fan Airflow Speed(%) Speed(RPM)
Direction
1 1 Front-to-Back 60 15428
1 2 Front-to-Back 60 11065
1 3 Front-to-Back 60 14835
1 4 Front-to-Back 60 10997
2 1 Front-to-Back 60 15000
2 2 Front-to-Back 60 11134
2 3 Front-to-Back 60 14835
2 4 Front-to-Back 60 11065
Power Supply:
Module Airflow Configured
Direction Speed (%)
1 Front-to-Back 60
2 Front-to-Back 60
FABRIC-A(nxos)#
FABRIC-A(nxos)#
FABRIC-A(nxos)# show environment
Fan:
Fan Model Hw Status
Chassis-1 UCS-FAN-6248UP -- ok
Chassis-2 UCS-FAN-6248UP -- ok
PS-1 UCS-PSU-6248UP-AC -- ok
PS-2 UCS-PSU-6248UP-AC -- ok
Temperature
Module Sensor MajorThresh MinorThres CurTemp Status
(Celsius) (Celsius) (Celsius)
1 Outlet 67 58 35 ok
Power Supply:
Voltage: 12 Volts
PS Model Input Power Power Status
Type (Watts) (Amp)
1 UCS-PSU-6248UP-AC AC 780.00 65.00 ok
2 UCS-PSU-6248UP-AC AC 780.00 65.00 ok
Mod Model Power Power Power Power Status
Requested Requested Allocated Allocated
(Watts) (Amp) (Watts) (Amp)
1 UCS-FI-6248UP-SUP 492.00 41.00 492.00 41.00 powered-up
3 UCS-FI-DL2 24.00 2.00 24.00 2.00 powered-up
Power Usage Summary:
Power Supply redundancy mode: Redundant
Power Supply redundancy operational mode: Redundant
Total Power Capacity 1560.00 W
Power reserved for Supervisor(s) 492.00 W
Power currently used by Modules 24.00 W
Total Power Available 1044.00 W
FABRIC-A(nxos)#UPDATE
I opened a TAC, then after several reviews of the LOGs and huge sh tech files, we concluded that all was normal. This loud noise is normal and within in normal operational ranges.
However as the server room is not fully acoustics proof and located near production work desks, we managed to get a RMA for the fan modules for the version 2 modules which are MUCH quieter than V1 due new design.
I have upload both pictures for comparison of the designs.
Thank You! -
Hi,
I am adding UCS FI to our network, connect to a Nexus switch. our network has multiple isolate Vlans, and normal Vlans, that all need to be trunk to FI. On switch port, should I do normal trunk mode, or private-vlan trunk mode.
Thanks,Hi
In general, all vlan's defined in a UCS domain are trunked on all Nortbound links, see
http://www.cisco.com/c/en/us/support/docs/servers-unified-computing/ucs-manager/116095-configure-ucs-upstream-port-channel-00.html
However, there is also the concept of disjoint vlan's, see
http://www.cisco.com/c/en/us/solutions/collateral/data-center-virtualization/unified-computing/white_paper_c11-692008.html
Walter. -
Connecting UCS to IBM DS4700, FC zoning
I am trying to accomplish connecting my UCS to an older SAN that I have to migrate data off. I currently have a UCS system that is connected to an EMC VNX using 8G FC. The zoning for this is configured in my UCS. All works well with the connection to the VNX and I have dual active/active paths working. What I am trying to do is connect a second SAN to my UCS system, a IBM DS4700. This DS4700 currently has a Brocade FC Switch connected to it, which then connects to a IBM bladecenter chassis.
I configured a second VSAN for the IBM array and configured the port on my fabric interconnect with that VSAN. I went into the IBM array and I could see the UCS WWN for my HBA, so I connected it to my UCS. When I did this, I had an unexpected result. My VMWare ESXi host on the UCS could see all the datastores on the IBM DS4700 BUT lost connection to all the ones on the VNX. Also, on the IBM DS4700, all of my paths failed over to the controller that had the host connection from the UCS. I tried to fail them back over to the other controller but they wouldn't move until I disconnected the UCS from IBM DS4700. Once disconnected from the UCS, everything went back to normal on both sides.
Does any one have an idea on how I am setup wrong here? The ESX host on the UCS could see the datastores on the IBM so it is somewhat correct but it caused all sorts of problems.
Thanks in advance.yes, zones are created on UCS.
Ok, so you don't have enough host ports to connect Controller A and Controller B to each FI. Since you are experiencing some odd failovers i would do this than. Since this is a migration effort and will not be a permanent configuration you can try this route ..connect both controllers to just one FI:
UCS FI FABRIC A:
IBM DS4700 Controller A - Host Port 2
IBM DS4700 Controller B - Host Port 2
this will ensure that UCS servers have access to both controllers so if a LUN on DS4700 happens to failover to another controller, UCS servers can still connect to it.
@dynamoxxx -
Directly connect UCS C-series to External storage
Hi,
I have a customer that is looking for an entry level data centre solution.
I have speced up 2 UCS C240 servers (with 10GB or 8GB FC) and I was wondering whether we can attach directly to external storage from the servers for now and buy a switch in the future.
As replication of their database is an issue, they would like to use external storage. The customer is looking at an IBM V7000. in the following URL -
http://www.cisco.com/en/US/docs/switches/datacenter/mds9000/interoperability/matrix/Matrix8.html the V7000 is compatible with the B-series but it's not listed under the C-series. Has anyone used the V7000 with the C-Series? Is there a better option for an entry level external storage array?
Any pointers or help would be much appreciated.
Cheers,
GeorgiaHello Georgia,
What is the HBA installed on the server ?
The matrix lists supported arrays only for Cisco CNA.
Padma -
Nexus N5K-C5548UP UDLD troubles
I haven't been able bringing up links between N7k and and the new N5K (5548UP) due to errors with UDLD.
Someone else facing same problem ?
regards
Edmund
N5K:
Software
BIOS: version 3.5.0
loader: version N/A
kickstart: version 5.1(3)N2(1a)
system: version 5.1(3)N2(1a)
N7K:
Software
BIOS: version 3.22.0
kickstart: version 5.1(4)
system: version 5.1(4)
Logs at N7K:
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-SPEED: Interface Ethernet1/2, operational speed changed to 10 Gbps
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/2, operational duplex mode changed to Full
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/2, operational Receive Flow Control state cha
nged to off
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/2, operational Transmit Flow Control state ch
anged to off
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-SPEED: Interface port-channel14, operational speed changed to 10 Gbps
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_DUPLEX: Interface port-channel14, operational duplex mode changed to Full
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel14, operational Receive Flow Control state
changed to off
2012 Jun 15 14:46:58 swi-svi00A %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel14, operational Transmit Flow Control state
changed to off
2012 Jun 15 14:47:05 swi-svi00A %UDLD-4-UDLD_PORT_DISABLED: UDLD disabled interface Ethernet1/2, empty echo detected
2012 Jun 15 14:47:16 swi-svi00A %ETH_PORT_CHANNEL-5-PORT_SUSPENDED: Ethernet1/2: Ethernet1/2 is suspended
2012 Jun 15 14:47:16 swi-svi00A %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet1/2, vlan 1,60,100,358,370,380,500-501,505,700-703,710
-713,720-723,730-735,759-762,764-765,767,770,775-778,782-783,787-788,794-796 up
2012 Jun 15 14:47:16 swi-svi00A %ETHPORT-5-IF_TRUNK_UP: Interface Ethernet1/2, vlan 999-1000,1501,2029-2030 up
2012 Jun 15 14:47:16 swi-svi00A %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/2 is down (Error disabled. Reason:UDLD em
pty echo)
2012 Jun 15 14:52:16 swi-svi00A %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/2 is down (Error disabled. Reason:UDLD em
pty echo)
==
swi-svi00A# sh udld ethernet 1/2
Interface Ethernet1/2
Port enable administrative configuration setting: enabled-aggressive
Port enable operational state: enabled-aggressive
Current bidirectional state: unknown
Current operational state: disable-port - Multiple neighbor not detected
Message interval: 7
Timeout interval: 5
Last pkt send on: 719482, Jun 15 14:47:05 2012
Probe pkt send on: 401784, Jun 15 14:46:59 2012
Echo pkt send on: 461880, Jun 15 14:47:05 2012
Flush pkt send on: 719482, Jun 15 14:47:05 2012
Last pkt recv on: 719134, Jun 15 14:47:05 2012
Probe pkt recv on: 719134, Jun 15 14:47:05 2012
Echo pkt recv on: None.
Flush pkt recv on: None.
Deep pkt inspections done: None.
Mismatched if index found: None.
Deep pkt inspection drops: None.
(Member of port-channel14)You are probably running into bug-id CSCtz00790. (see below)
I had the same issue with UDLD no echo reply over SFP+ cables. The bug is Fixed-In 5.1(3)N2(1a)
http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCtz00790 -
Ask the Expert : Initial Set Up and LAN Connectivity for Cisco UCS Servers
Welcome to the Cisco Support Community Ask the Expert conversation. This is an opportunity to learn and ask questions about related to the initial setup of UCS C & B Series which include LAN connectivity from the UCS perspective with Cisco subject matter expert Kenny Perez.
In particularly, Kenny will cover topics such as: ESXi/Windows installations, RAID configurations (best practices for good performance and configuration), VLAN/Jumbo Frames configuration for B series and C series servers, Pools/Policies/Upgrades/Templates/Troubleshooting Tips for blade and rack servers, Fabric Interconnects configuration, general compatibility of Hardware/Software/drivers amongst other topics
Kenny Perez is a technical leader in Cisco Technical Assistance Center, where he works in Server Virtualization support team. His main job consists of supporting customers to implement and manage Cisco UCS B series and C series. He has background in computing, networking, and Vmware ESXi and has 3+ years of experience support UCS servers and is VCP certified.
Remember to use the rating system to let Kenny know if he has given you an adequate response.
This event lasts through October 10th, 2014. Visit this forum often to view responses to your questions and the questions of other Cisco Support Community members.Hi,
Actually we have UCS 6248 fabric interconnect - first twelve ports are enabled and same in Cisco UCS Manager.
But when more port will be active by expansion module then UCSM can manage that too or need any other licence for UCSM too?
Maybe you are looking for
-
My Macbook Pro Retina doesn't turn on but charger led works
I haven't used my mac for a month but it use to work perfectly fine. I tried to use it but it wouldn't turn on. When i plug the magsafe connecter the led goes orange. But when i press the power button it doesn't turn on. i tried smc reset using left
-
Re-syncing restored iphone with new pics on it?
hi, im going to a concert and i would like to know if i could restore my iphone before the concert, take all of my pictures/videos, and then back up my phone
-
Best strategies for reducing effective data collection rate?
Hi, I'm writing a VI to collect data from cDAQ modules that have a minimum sampling rate of 1612Hz due to the master timebase (specifically 9237 and 9215 modules). I would like to log data (1D waveform with timestamps) at 100Hz for 12 hours and save
-
Hi Experts, how to copy adobe form to a Z form? see details, thanks.
Hi Experts, how to copy adobe form to a Z form? becuase when I click copy and enter the z form name and click ok, then I got an internal error occured SAP FP API, what is wrong? can anyone tell me the correct way to copy a standard adobe form? thanks
-
Hi All, I want to make changes in the layout of Performa Invoice generated by JHA2X. while saving the order it generates the performa invoice and the invoive print comes out, i m unable to find the form and the print program for the same. I have chec