Nexus 5548UP/2232PP/FCoE
Hi,
In my enviroment I have a datacenter with 2 Nexus 5548UP with FCoE Licence. As I am new to storage networking I need some information about the configuration of FCoE.
The enviroment is :
2 x 5548UP Switch
2 x 2232PP FEX
1 x Host with Emulex OneConnect OCe10102-F interface
1 x storage with FCoE interface.
How many virtual SANs we can create with a single stoarge device.
I have to configure this 2 5548UP Vs the 2 FEX 2232PP with FCoE.
1) I have to map each vsan with a Layer 2 FCoE Vlan?
2) How I can distribute the VSans (and the FcoE Vlans) and the Ethernet Vlans from the 2 FEX 2232PP Vs the 2 5548UP? How many Links? Is better to do a Port-Channel or different Port-Channels? Best Practices?
3) In which way we need to configure the Teaming? Active Standby or Active Active?
4) I studied that, it is possibile to do an ISL Trunk between the two Nexus 5548UP switches...right? Can I Create a port-channel and allow all the vsans?
Kindly guide me with proper connection diagram and configuration steps.
Thanks in advance!
Gaurav
Assuming FEXes are already connected and operational. Nexus 5548 cannot run in NPV mode. You have to configure zoning in addition to following configuration.
@Nexus 5548 switch1
feature fcoe
vlan 100
name DATA_VLAN
vlan 101
name Fabric_A_SAN101
fcoe vsan 101
vlan 102
name Fabric_B_SAN102
fcoe vsan 102
vsan database
vsan 101
vsan 101 interface vfc 101
vsan 101 interface vfc 13
vsan 102
vsan 102 interface vfc 102
vsan 102 interface vfc 23
int eth 102/1/1
description server CNA port 1
switchport mode trunk
spanning-tree port type edge trunk
int vfc 101
bind interface eth 102/1/1
switchport mode F
int eth1/3
description Interswitchlink
switch mode trunk
switchport trunk allowed vlan exclude 101
int vfc 102
bind interface eth1/3
switchport mode E
int eth1/2
descrition Storage port 1
switchport mode trunk
spanning-tree port type edge trunk
interface vfc 13
bind interface eth1/2
switchport mode F
int eth1/6
descrition storage port2
switchport mode trunk
spanning-tree port type edge trunk
interface vfc 23
bind interface eth1/6
switchport mode F
system qos
service-policy type qos input fcoe-default-in-policy
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type network-qosfcoe-default-nq-policy
@Nexus 5548 switch2
feature fcoe
vlan 102
name Fabric_B_SAN102
fcoe vsan 102
vsan database
vsan 102
vsan 102 interface vfc 102
vsan 102 interface vfc 12
int eth1/3
description interswitch link
switch mode trunk
switchport trunk allowed vlan 102
int vfc 102
bind interface eth1/3
switchport mode E
int eth101/1/1
switchport mode trunk
spanning-tree port type edge trunk
interface vfc 12
bind interface eth101/1/1
switchport mode F
system qos
service-policy type qos input fcoe-default-in-policy
service-policy type queuing input fcoe-default-in-policy
service-policy type queuing output fcoe-default-out-policy
service-policy type network-qosfcoe-default-nq-policy
Similar Messages
-
C-200 M2 with P81E to Nexus 5548UP
Hi all,
I'm working on a project which is about to set up a Cisco UCS Lab.
Actually the topology looks simple and easy but there must be some missconfiguration on my side because i can't see any of IDs (P81E's wwpn and mac address info) from the Nexus 5548UP.
I connected my 5548UP to MDS 9124 for providing the FCoE traffic to the C-200 Farm.
Then i configured the MDS with NPIV and converted couple of ethernet ports to the FC ports on 5548UP (which i'm using to connect to the MDS)
Finally i connected my C-200M2's VIC to the 5548UP but i couldn't see any information about server. The ports actually are up. But can't see nothing.
Some help and advises will be appreciated.Padma,
Right now i connected the N5548 directly to the storage for that reason you can not see the fc uplink connections on running-configuration.
On Nexus 5548 ;
Ethernet 1/1 and Ethernet 1/2 are the server ports (P81E)
Ethernet 1/15 is the Uplink Ethernet port
Fc 1/31 1/32 is the Storage Ports
Storage has been configured for the wwpns and LUNs.
And here is the configuration :
N5548(config-if)# show running-config
!Command: show running-config
!Time: Tue Jan 24 13:32:53 2012
version 5.0(3)N2(1)
feature fcoe
feature telnet
feature lldp
username admin password 5 $1$XCMHODt3$yEItwOs0Vl.LLYyXBPjZu0 role network-admin
no password strength-check
ip domain-lookup
hostname N5548
class-map type qos class-fcoe
class-map type queuing class-fcoe
match qos-group 1
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
class-map type network-qos class-fcoe
match qos-group 1
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
slot 1
port 1-24 type ethernet
port 25-32 type fc
snmp-server user admin network-admin auth md5 0x29cde3d41c6724dcbec14cf28387824d
priv 0x29cde3d41c6724dcbec14cf28387824d localizedkey
snmp-server enable traps entity fru
vrf context management
vlan 1
fcoe vsan 1
fcdomain fcid database
vsan 1 wwn 50:06:0e:80:10:4d:03:60 fcid 0xa10000 dynamic
vsan 1 wwn 50:06:0e:80:10:4d:03:62 fcid 0xa10001 dynamic
interface vfc1
bind interface Ethernet1/1
no shutdown
interface vfc2
bind interface Ethernet1/2
no shutdown
interface fc1/25
interface fc1/26
interface fc1/27
interface fc1/28
interface fc1/29
interface fc1/30
interface fc1/31
no shutdown
interface fc1/32
no shutdown
interface Ethernet1/1
interface Ethernet1/2
interface Ethernet1/3
interface Ethernet1/4
interface Ethernet1/5
interface Ethernet1/6
interface Ethernet1/7
interface Ethernet1/8
interface Ethernet1/9
interface Ethernet1/10
interface Ethernet1/11
interface Ethernet1/12
interface Ethernet1/13
interface Ethernet1/14
interface Ethernet1/15
switchport mode trunk
speed 1000
interface Ethernet1/16
interface Ethernet1/17
interface Ethernet1/18
interface Ethernet1/19
interface Ethernet1/20
interface Ethernet1/21
interface Ethernet1/22
interface Ethernet1/23
interface Ethernet1/24
interface mgmt0
ip address 192.168.10.210/24
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.0.3.N2.1.bin
boot system bootflash:/n5000-uk9.5.0.3.N2.1.bin
interface fc1/25
interface fc1/26
interface fc1/27
interface fc1/28
interface fc1/29
interface fc1/30
interface fc1/31
interface fc1/32
N5548(config-if)# -
Fc ports on nexus 5548up.
Hi Guyz,
I have a pair of nexus 5548UP with expansion module N55-M16UP. both switches have below licensing.
Feature Ins Lic Status Expiry Date Comments
Count
FCOE_NPV_PKG No - Unused -
FM_SERVER_PKG No - Unused -
ENTERPRISE_PKG Yes - Unused Never -
FC_FEATURES_PKG Yes - In use Never -
VMFEX_FEATURE_PKG Yes - Unused Never -
ENHANCED_LAYER2_PKG No - Unused -
LAN_BASE_SERVICES_PKG Yes - In use Never -
LAN_ENTERPRISE_SERVICES_PKG Yes - Unused Never -
on first switch i made slot 2 as fc ports & after reload i can see fc ports.
slot 2
port 1-16 type fc
However with same procedure on switch 2 , i cant see any FC ports nor module 2 ports.
if i turn module 2 ports to ethernet i can see E2/1 - E2/16 , but no ports when they are configures as FC.
any idea ???
Confused as both switches have same lic installed.
Thanks in Advance.After the port type has been changed from Ethernet to FC, the FC port will not be enabled on the switch until FCOE feature is enabled:
N5K(config)#feature FCOE
C license checked out successfully
fc_plugin extracted successfully
FC plugin loaded successfully
FCoE manager enabled successfully
FC enabled on all modules successfully
Enabled FCoE QoS policies successfully
After that, we verify that the port type is changed successfully and the FC ports appear on the switch:
N5K# show interface brief -
Hi,
Just want to know, how many ports in Nexus 5548UP can be used for 10G connectivity?
Thanks,
SridharHi Sridhar,
At least 32 10G ports SFP+ up to 48:
"Cisco Nexus 5548P Switch
The Cisco Nexus 5548P Switch (Figure 1) is the first of the Cisco Nexus 5500 platform switches. It is a one-rack-unit (1RU) 10 Gigabit Ethernet and FCoE switch offering up to 960-Gbps throughput and up to 48 ports. The switch has 32 1/10-Gbps fixed SFP+ Ethernet and FCoE ports and one expansion slot."
http://www.cisco.com/c/en/us/products/collateral/switches/nexus-5000-series-switches/data_sheet_c78-618603.html
Regards,
Gus Magno -
Nexus 5548UP with 1Gb ether to 10Gb ether on same switch
I have a Nexus 5548UP switch with a couple of systems some of which have been configured with 1Gb nic's running various OS's and other that have 10Gb nic's. When I try to SSH from 1Gb box to a 1Gb box everything is fine, when I SSH from 1Gb to 10Gb box it does not work but 10Gb to 10Gb boxes will work. The switch is a fresh install and has one VLAN 51 the first 2 ports are setup with LACP and the only differences is speed of 1000 and 10000 for the boxes attached. Is there some trick or additional configuration that is needed to make 1Gb to 10Gb work for SSH and other applications? I trying to setup some test boxes now to have a repeatable environment and will update when completed.
!Command: show running-config
!Time: Fri Jan 9 18:30:44 2009
version 5.2(1)N1(4)
hostname ISC5548B
no feature telnet
feature lacp
feature lldp
...... account info removed
ssh key rsa 2048
ip domain-lookup
class-map type qos class-fcoe
class-map type queuing class-fcoe
match qos-group 1
class-map type queuing class-all-flood
match qos-group 2
class-map type queuing class-ip-multicast
match qos-group 2
class-map type network-qos class-fcoe
match qos-group 1
class-map type network-qos class-all-flood
match qos-group 2
class-map type network-qos class-ip-multicast
match qos-group 2
vrf context management
ip route 0.0.0.0/0 192.168.52.1
vlan 1
vlan 51
name InfoSec
port-profile default max-ports 512
interface port-channel1
switchport access vlan 51
speed 1000
interface Ethernet1/1
lacp port-priority 500
switchport access vlan 51
speed 1000
channel-group 1 mode active
interface Ethernet1/2
switchport access vlan 51
speed 1000
channel-group 1 mode active
interface Ethernet1/3
switchport access vlan 51
speed 1000
interface Ethernet1/4
switchport access vlan 51
speed 1000
interface Ethernet1/5
switchport access vlan 51
speed 1000
interface Ethernet1/6
switchport access vlan 51
speed 1000
interface Ethernet1/7
switchport access vlan 51
speed 1000
interface Ethernet1/8
switchport access vlan 51
speed 1000
interface Ethernet1/9
switchport access vlan 51
speed 1000
interface Ethernet1/32
switchport access vlan 51
speed 1000
interface Ethernet2/1
switchport access vlan 51
interface Ethernet2/2
switchport access vlan 51
interface Ethernet2/3
switchport access vlan 51
interface Ethernet2/4
switchport access vlan 51
interface Ethernet2/5
switchport access vlan 51
interface Ethernet2/6
switchport access vlan 51
interface Ethernet2/7
switchport access vlan 51
interface Ethernet2/8
switchport access vlan 51
interface Ethernet2/14
switchport access vlan 51
interface Ethernet2/15
switchport access vlan 51
interface Ethernet2/16
switchport access vlan 51
interface mgmt0
ip address 192.168.52.4/24
line console
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.2.1.N1.4.bin
boot system bootflash:/n5000-uk9.5.2.1.N1.4.bin
ISC5548B# show int brief
Ethernet VLAN Type Mode Status Reason Speed Port
Interface Ch #
Eth1/1 51 eth access up none 1000(D) 1
Eth1/2 51 eth access up none 1000(D) 1
Eth1/3 51 eth access up none 1000(D) --
Eth1/4 51 eth access up none 1000(D) --
Eth1/5 51 eth access up none 1000(D) --
Eth1/6 51 eth access up none 1000(D) --
Eth1/7 51 eth access up none 1000(D) --
Eth1/8 51 eth access up none 1000(D) --
Eth1/9 51 eth access up none 1000(D) --
Eth1/10 51 eth access up none 1000(D) --
Eth1/11 51 eth access up none 1000(D) --
Eth1/12 51 eth access up none 1000(D) --
Eth1/13 51 eth access down Link not connected 1000(D) --
Eth1/14 51 eth access down Link not connected 1000(D) --
Eth1/15 51 eth access up none 1000(D) --
Eth1/16 51 eth access down Link not connected 1000(D) --
Eth1/17 51 eth access down SFP not inserted 1000(D) --
Eth1/18 51 eth access down SFP not inserted 1000(D) --
Eth1/28 51 eth access down SFP not inserted 1000(D) --
Eth1/29 51 eth access down SFP not inserted 1000(D) --
Eth1/30 51 eth access down SFP not inserted 1000(D) --
Eth1/31 51 eth access down SFP not inserted 1000(D) --
Eth1/32 51 eth access down SFP not inserted 1000(D) --
Eth2/1 51 eth access up none 10G(D) --
Eth2/2 51 eth access up none 10G(D) --
Eth2/3 51 eth access up none 10G(D) --
Eth2/4 51 eth access up none 10G(D) --
Eth2/5 51 eth access up none 10G(D) --
Eth2/6 51 eth access up none 10G(D) --
Eth2/7 51 eth access down SFP not inserted 10G(D) --
Eth2/8 51 eth access down SFP not inserted 10G(D) --
Eth2/9 51 eth access down SFP not inserted 10G(D) --
Eth2/10 51 eth access down SFP not inserted 10G(D) --
Eth2/11 51 eth access down SFP not inserted 10G(D) --
Eth2/12 51 eth access down SFP not inserted 10G(D) --
Eth2/13 51 eth access down Link not connected 10G(D) --
Eth2/14 51 eth access down SFP not inserted 10G(D) --
Eth2/15 51 eth access down Link not connected 10G(D) --
Eth2/16 51 eth access down Link not connected 10G(D) --
Port-channel VLAN Type Mode Status Reason Speed Protocol
Interface
Po1 51 eth access up none a-1000(D) lacp
Port VRF Status IP Address Speed MTU
mgmt0 -- up 192.168.52.4 100 1500
ISC5548B# show interface ethernet 1/3
Ethernet1/3 is up
Dedicated Interface
Hardware: 1000/10000 Ethernet, address: 8c60.4f49.818a (bia 8c60.4f49.818a)
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is access
full-duplex, 1000 Mb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped 1d02h
Last clearing of "show interface" counters 1d20h
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 304 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 200 bps, 0 pps
RX
0 unicast packets 0 multicast packets 0 broadcast packets
0 input packets 0 bytes
0 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
202 unicast packets 87027 multicast packets 1077 broadcast packets
88306 output packets 7601016 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
4 interface resets
ISC5548B# show interface ethernet 2/1
Ethernet2/1 is up
Dedicated Interface
Hardware: 1000/10000 Ethernet, address: 8c60.4f23.5de0 (bia 8c60.4f23.5de0)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is access
full-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
EtherType is 0x8100
Last link flapped 1d20h
Last clearing of "show interface" counters never
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 312 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 200 bps, 0 pps
RX
285 unicast packets 0 multicast packets 218 broadcast packets
503 input packets 32724 bytes
0 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
406 unicast packets 89109 multicast packets 1077 broadcast packets
90592 output packets 7827146 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
1 interface resetsI have a laptop connected to a port on the switch and I am currently adding a SUSE 11 SP2 to another port that has a 10G card for a NIC. Once I finished the install I will post more specific tests using ping and SSH to illustrate.
Here is the output you requested.
ISC5548B# show port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
S - Switched R - Routed
U - Up (port-channel)
M - Not in use. Min-links not met
Group Port- Type Protocol Member Ports
Channel
1 Po1(SU) Eth LACP Eth1/1(P) Eth1/2(P)
ISC5548B# sh int po1
port-channel1 is up
Hardware: Port-Channel, address: 8c60.4f49.8188 (bia 8c60.4f49.8188)
MTU 1500 bytes, BW 2000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is access
full-duplex, 1000 Mb/s
Input flow-control is off, output flow-control is off
Switchport monitor is off
EtherType is 0x8100
Members in this channel: Eth1/1, Eth1/2
Last clearing of "show interface" counters never
30 seconds input rate 560 bits/sec, 0 packets/sec
30 seconds output rate 3064 bits/sec, 2 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 128 bps, 0 pps; output rate 2.74 Kbps, 2 pps
RX
578695 unicast packets 11167 multicast packets 1056 broadcast packets
590918 input packets 760063851 bytes
0 jumbo packets 0 storm suppression bytes
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
392417 unicast packets 434693 multicast packets 2984 broadcast packets
830094 output packets 320257324 bytes
0 jumbo packets
0 output errors 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
1 interface resets -
Cisco Nexus 5548UP connecting to HP P4330 StoreVirtual over iScsi
Hi,
I need some advice when it comes to how to setup a port-channel between Nexus 5548UP and a HP StoreVirtual 4330 device. The idea is to use 2 10 GB ports in a port-channel group and this far I've this on the port-channel group;
interface port-channel1002
priority-flow-control mode off
switchport access vlan 400
load-interval counter 2 30
load-interval counter 3 300
What about priority-flow-control, any needs to change anything here? Any other things that needs to be considered when using iScsi?
Much appreciated!
Tony LewisHi Tony,
You do not have to worry about PFC. Priority-Flow-Control is something which is related to FCOE or DCBX protocol. With iSCSI as this is a TCP traffic, you have to make sure that you have a proper QOS for the IP Subnet or VLAN that has your iSCSI hosts transmitting the data. As iSCSI rides over TCP this is the major issue that I have seen related to the valid QOS config for the traffic. There is not best practice for it but you have make sure that you added it to a class other than BE or Scavanger class.
Hope this helps.
Cheers,
-amit singh -
Cisco Nexus 5548UP to Brocade SAN Connectivity
Hi,
I have a Server-SAN-Storage setup as shown in the attachment/below. There are new Cisco UCS rack mount servers with VIC 1225 and Virtual servers on VMware Esxi hypevisor connected to a new Cisco Nexus 5548UP switch in IP+FCoE mode. The new 5548 switch then connects to an existing production SAN of Brocade 48000 Director SAN switch which connects to storage in production environment.
I need to know the best way to connect the 5548 switch to the Brocade SAN switch without disrupting the existing Production SAN environment i.e. Brocade SAN switch configurations & setup e.g. Fabric Principal switch. priority etc.
Would configuring the 5548 switch in NPV mode be best practice?See Figure 6-2 Converged Multi-hop FCoE Network Design Using FCoE NPV
http://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/operations/fcoe/513_n1_1/ops_fcoe/ops_fcoe_npv.html
You have to use NPV on N5k, there is no FC interop support on N5k, to connect to Brocade. -
Hi
I need a switch that supports FC, FCoE and iSCSI traffic. The switch that has been suggested to us is Cisco Nexus 5548UP.
I have the following queries regarding this switch:
1) At our end, I have AMS 2100 Hitachi Storage which has iSCSI & FC Ports. I also have Qlogic CNA card at the server end which supports both ISCSI & FCOE. For FCoE protocol based traffic, the storage to switch connection will have to be FC and the switch to server connection will be FCoE. Can you please confirm whether, if this will be possible through the proposed Cisco Nexus 5548UP switch?
2) The specification for the Nexus 5548UP switch claims that it supports 10 Gigabit Ethernet. Can you please confirm if this relates to iSCSI support that the switch provides?
3) We are going to use -SFP-FC4G-SW & SFP-10G-SR SFP for fiber connectivity. Can you please let us know the what these SFP are used for and whether they assist in FC and FCoE traffic forwarding?
4) We are also going to use Nexus 5500 Storage License, 8 Ports. Does this indicate that only 8 ports of the switch can be connected to the storage? Among these ports, can we configure 4 ports for FC and 4 ports for iSCSI (keeping in mind that our storage has both FC and iSCSI ports)?
5) Is there any License required for enable FC, FCoE and iSCSI protocols?
An early resolution of these queries will enable us to make a decision regarding the switch.
Thanks
Bhanudas MaliThe specification for the Nexus 5548UP switch claims that it supports 10 Gigabit Ethernet. Can you please confirm if this relates to iSCSI support that the switch provides?
The "UP" in the Nexus 5548 stands for Universal Port. This means that each port can support FC, FCoE and Ethernet. So, a 5548 has 32 ports of SFP/SFP+. Each port can support and push 10 Gbps at a 1:1 oversubscription rate.
There is an optional 16-port SFP/SFP+ module, N55-M16UP, which will add an additional 16 Universal Ports.
Because they are "universal" they can support 1/10 Gbps FCoE and Ethernet as well as 1, 2, 4 and 8 Gbps FC. -
NEXUS 5548UP LAYOUT - Shared flogi between nexus
Hello,
I have 4 Nexus 5548UP, and I need to do they share information of FLOGI among the switches N5K1 and N5K3.
Today i can do this, the way shown above.
But I would like to have another link redundancy between switches N5K1 and N5K3.
I already tried adding this link redundancy on a port-channel, but when I do that I can not share the FLOGI informations between switches.
I would like your help to know what I can do in this case?.In your picture I see, that you plan to use classical Fibrechannel for storage and FCoE for servers.
Fibrechannel and multihop FCoE has strict design rules of separate fabrics, which is very different to Ethernet (and IP) networking.
Specially vPC violates this separation; see eg. Fibre Channel over Ethernet Operations
http://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/operations/n5k_fcoe_ops.html#wp1079705
and
http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/mkt_ops_guides/513_n1_1/n5k_enhanced_vpc.html#wp1162674
SAN A and SAN B Traffic Isolation
You can deploy FCoE in an Enhanced vPC topology. Traditionally, the SAN network maintains two fabrics, the SAN A and SAN B. The traffic from side A is isolated from side B. Hosts and storage arrays are attached to host SAN networks for high availability. The FCoE traffic in an Enhanced vPC topology maintain the traffic isolation for two SAN networks. The FCoE command ensures the FCoE traffic from the FEX is only sent to one Cisco Nexus 5000 Series device is as follows: -
Partial collection Failure for nexus 5548UP in PI 2.1
Hi there,
I get "Partial Collection Failure" in the inventory collection status in Prime Infrastructure for all my Nexus 5548UP (8 devices).
i have seen in the PI 2.1 release notes that a bug CSCum16230 which look like my problem has been resolved in PI 2.1 but i continue getting the "partail collection failure"
Would like to know if the bug is still exist or get any other help to solve this problem.
Regards,
Alon.hello
I have this problem as well...
we've got four N5K-C5548UP. Two with a layer 3 daughter card and two without.
interestingly we see the issue just on those boxes with the l3 daughter cards N55-D160L3-V2 installed...
Any help or ideas are highly appreciated
regards
roman
Sh inventory:
OK:
device-a# sh module
Mod Ports Module-Type Model Status
1 32 O2 32X10GE/Modular Universal Pla N5K-C5548UP-SUP active *
3 0 O2 Non L3 Daughter Card N55-DL2 ok
Mod Sw Hw World-Wide-Name(s) (WWN)
1 5.1(3)N2(1c) 1.0 --
3 5.1(3)N2(1c) 1.0 --
NOT OK:
device-b# sh modu
Mod Ports Module-Type Model Status
1 32 O2 32X10GE/Modular Universal Pla N5K-C5548UP-SUP active *
3 0 O2 Daughter Card with L3 ASIC N55-D160L3-V2 ok
Mod Sw Hw World-Wide-Name(s) (WWN)
1 5.1(3)N2(1c) 1.0 --
3 5.1(3)N2(1c) 1.0 -- -
LMS User Tracking for NEXUS 5548UP
Dear,
A while ago I received a ticket from one of our customers because User Tracking was not working for NEXUS 5548UP on LMS 3.2. I opened a TAC case for this but this was normal since it is a Datacenter switch. Now the customer came back on this because they really want to see which server is connected to which switch port. I understood from the TAC engineer this is not on the roadmap to integrate in LMS 4.x. They want to know if there exists another product (they thought about DCNM) and wanted to know how this integrates or works together with LMS...
Kind regards,
Sven LaureyssensMy latest understanding of User Tracking and Nexus 5K series is that it is not supported due to a limitation of the MIB support in the NX-OS.
The current DCNM (release 5.2) is distinct from the LMS and Cisco Prime umbrella but that wil be changing a bit moving forwad as DCNM is enhanced and rolled into the Cisco Prime family. Last I heard there should be some information coming out of Cisco Live this week and a new release will have some additional functionality and better integration. Still, I doubt we'll see UT for the 5K due to the NX-OS limitation.
One way to do what you're asking apart from use of any of the Cisco products is to enable LLDP on your Nexus and servers. That will at least give you the ability to pull the information from the NX-OS command line ("show lldp neighbor") -
I have purchased Nexus 5548UP switch, i want to know if we have a built-in option for web based tool to manage and configur it just as ASA have ASDM. If there is no such options then what are the options available that can be freely available and can be used to get performance monitoring done.
Message was edited by: Praveen VarunDCNM (Data Center Network Manager) runs on a server (Windows, RHEL or Solaris) and can be used to manage Nexus devices. It's free for Nexus 1K through 5K devices (paid license required for Nexus 7K management).
http://www.cisco.com/en/US/products/ps9369/index.html
There is not a "built-in" management product like ASDM for ASA. -
Nexus 5548UP L3 card swap out for L2 cards
Hi everyone,
I have two Nexus 5548UPs and I am going to swap out the L3 cards and put in L2 cards.
I can't seem to get a straight answer out of TAC so I thought I'd try here.
How will this affect the current configuration (apart of course from removing the L3 capability)?
Will swapping the cards clear the config?
Will swapping the cards clear the licenses?
It's a very simple config so that doesn't worry me that much .. but if it will clear the licenses installed than I need to take action on that.
Thanks,
BRno, no secret aukhadiev
I made a mistake without realising and the interface e1/3 was showing "Interface Ethernet1/3 is down (Inactive)". After spending sometime trying to figure out what was wrong with that interface or switch, it turned out to be that i forgot to add the vlan 40. Now the config looks like this:
N5K-C5548UP Switch
feature interface-vlan
feature lacp
feature dhcp
feature lldp
vrf context management
ip route 0.0.0.0/0 172.16.0.1
vlan 1
vlan 40
vlan 100
service dhcp
ip dhcp relay
interface Vlan1
no shutdown
interface Vlan40
description ** Server VLAN **
no shutdown
ip address 10.144.40.3/25
ip dhcp relay address 10.144.40.39
ip dhcp relay address 10.144.40.40
interface port-channel1
description ** Trunk Link to Switch A g1/0/23-24 **
switchport mode trunk
switchport trunk allowed vlan 1,30,40,100-101,122
speed 1000
interface Ethernet1/1
description ** Trunk Link to Switch A g1/0/23**
switchport mode trunk
switchport trunk allowed vlan 1,30,40,100-101,12
speed 1000
channel-group 1 mode active
interface Ethernet1/2
description ** Trunk Link to Switch A g1/0/24**
switchport mode trunk
switchport trunk allowed vlan 1,30,40,100-101,122
speed 1000
channel-group 1 mode active
interface Ethernet1/3
description **Connected to server B**
switchport access vlan 40
speed 1000
interface mgmt0
description connection to Switch A g2/0/20
no ip redirects
ip address 172.16.0.2/25
Thank you,
JN -
We have purchased a Nexus 5548UP switch for our SAN environment. I've only configured it for jumbo frames and currently doing testing on the performance, as some say use jumbo frames while others say do not. My question is, and I know this is a loaded question but how do you guys go about configuring your SAN switches? What exactly are you configuring on it? Such as for performance tuning or the like. The reason I ask, is we have the switch and it's pretty much working, but I'd like to learn more about it and how to tune it and fully take advantage of the switch.
That is correct, between two Dell Optiplex workstations. We also tested between the server that will go into prod and an Optiplex, but once again the Optiplex could be the limiting factor. You think that could be it? Here's my config, so you know how it's setup right now.
version 5.2(1)N1(7)
hostname N5K
feature telnet
feature lldp
feature vtp
username admin password 5 $1$oZ1234567898765432123456/ role network-admin
banner motd #Nexus 5000 Switch
ip domain-lookup
policy-map type network-qos jumbo
class type network-qos class-default
mtu 9216
multicast-optimize
system qos
service-policy type network-qos jumbo
snmp-server user admin network-admin auth md5 0x422842c9d320064123456789fc703d20
priv d3264f23456789000c703d20 localizedkey
vrf context management
port-profile default max-ports 512
interface Ethernet1/1
flowcontrol receive on
flowcontrol send on
interface Ethernet1/2
interface Ethernet1/3
interface Ethernet1/4
interface Ethernet1/5
flowcontrol receive on
flowcontrol send on
interface Ethernet1/6
interface Ethernet1/7
interface Ethernet1/8
interface Ethernet1/9
flowcontrol receive on
flowcontrol send on
interface Ethernet1/10
interface Ethernet1/11
interface Ethernet1/12
interface Ethernet1/13
flowcontrol receive on
flowcontrol send on
interface Ethernet1/14
interface Ethernet1/15
interface Ethernet1/16
interface Ethernet1/17
interface Ethernet1/18
interface Ethernet1/19
interface Ethernet1/20
interface Ethernet1/21
interface Ethernet1/22
interface Ethernet1/23
interface Ethernet1/24
interface Ethernet1/25
interface Ethernet1/26
interface Ethernet1/27
interface Ethernet1/28
interface Ethernet1/29
interface Ethernet1/30
interface Ethernet1/31
interface Ethernet1/32
interface mgmt0
ip address 11.11.11.11/24
line console
exec-timeout 720
line vty
boot kickstart bootflash:/n5000-uk9-kickstart.5.2.1.N1.7.bin
boot system bootflash:/n5000-uk9.5.2.1.N1.7.bin -
is it possible to change the airflow of the Nexus 5548UP in the field by replacing fan and power supply or must the correct airflow been ordered.
I just completed the change of airflow direction for Nexus 5548UP while the switch is still online and running. It is possible to swap fan and power modules without shutting down the switch. There are few catches that you need to pay attentions when you want to change the airflow directions:
To swap two fans and two power modules on Nexus 5548UP while it's running:
1) make sure you have the latest IOS or at least 6.0+, I have system: version 6.0(2)N2(1). Also, please don't forget to save running config just in case if the switch will be shutdown.
2) make sure you have all your new fans and power modules unpacked and ready to be installed
3) connect to the switch console port to monitor the logs and status
4) Pay attention to the switch console, it will give out warnings about fan failure (but switch will continue to run).
5) Important: The first new fan that you just replaced (with opposite airflow direction), the switch will detect the the incorrect airflow, and begin to give out warnings with countdown timer. You have only less than 60 seconds to complete the rest of swapping before the switch will shutdown. Not only you need to swap out each module quickly, but need to pay attention to each new module wait for it online before replacing the next module.
6) To start the process, insert in the first new fan with opposite airflow direction, take about few seconds and wait for spinning up [green light]. The switch console will display: "incorrect airflow detected, the switch will shutdown in 60 seconds.....". Just move onto next step...
7) replace the second fan, wait few seconds for new fan to spin up [green light].
8) replace the first power module
9) Important: make sure the first new power module is online [green light], then you can proceed and replace the second power module.
10) Completed! you may check "show inventory" to see if all new fans and power modules are online and shown. The switch was up and running the whole time.
Please give rating if it helps you! Thanks!
Maybe you are looking for
-
Trying to Do TotPlan Refresh but TotPlan.dmp file doesn't exist
I tried using C:\demos\TotPlan\PLN\Batch\Refresh_demo_TotPlan.bat , however I get an error when it tries to restore ORCL db using backup file - C:\demos\TotPlan\PLN\Backup\TotPlan.dmp . I search my drive and there is no .dmp file anywhere on the driv
-
8800GTS OC, no TV output signal.
Ran into a serious problem with a HDTV and a MSI 8800GTS OC gfx card. I had the computer hooked up via a Component cable (red, green, blue RCA) to the HDTV before, worked fine, untill I had to unplug it, to use a xbox360 for a weekend. now when I plu
-
Lost my iPhoto Albums (MY LIFE) How do I get them back?
Downloaded the latest OS X 10.9.4 Mavericks and lost my iPhoto Albums (MY LIFE) How do I get them back?
-
Discontinuation: calculation of remaining stock in planned orders
Hi Experts, In discontinuation component A is followed by component B. Component B will be used when stock of component A is depleted. In our system we now see that the calculation of available stock for component A is different for planned orders th
-
Recently when I connect my iphone 4 to my Mac for normal synchronising i found after a few minutes all my purchased apps were deleted and gone ? I have no problem to retrieve them back but that is exhausting and I am feeling sick ? what is the proble