Nexus 5548UP VPC and/or VRRP problem

Hi, I have two 5548UP + L3 card with LAN_ENTERPRISE_SERVICES_PKG and FC license.
This two Nexus are the core of my network.
Eight stacks of 2960S are connected to both NX with an etherchannel formed by two SX-1G or two SR-10G.
I've checked the conf and maked a lot of test and everything works fine. BUT, two days after the people start working on the new building, about half of the PC don't even reach the default gateway. (Nexus VRRP)
I've turned off VRRP and it works for minutes.
The problem disappear if I shutdown one of the links to NX01 or NX02.
I followed the destination MAC of one PC with the problem and the ARP table looks OK but I guest the problem is related with a corruption in the ARP table anyway.
system image file is: bootflash:///n5000-uk9.5.2.1.N1.1a.bin
Thanks in advance!
Guido./
interface Vlanxx
no shutdown
ip address 10.xx.xx.1/24
ip ospf passive-interface
ip router ospf 1 area 0.0.0.0
ip dhcp relay address xxxxx
vrrp 80
address 10.xx.xx.1
! Actualy is in shutdown
interface port-channel55
switchport mode trunk
switchport trunk allowed vlan 1-300,303-4094
ip dhcp snooping trust
speed 10000
vpc 55
interface port-channel111
switchport mode trunk
switchport trunk allowed vlan 1-224
ip dhcp snooping trust
spanning-tree port type network
speed 10000
vpc peer-link

Looks like you have configured same IP on physical and for standby. is this typo or configured on device ?
!----------- NX01 ----------------------------------------------
interface Vlan80
no shutdown
ip address 10.xx.80.1/24
ip ospf passive-interface
ip router ospf 1 area 0.0.0.0
ip dhcp relay address xxxxx
vrrp 80
    address 10.xx.80.1
! Actualy is in shutdown
!----------- NX02 ----------------------------------------------
!NX02
interface Vlan80
no shutdown
ip address 10.xx.80.2/24
ip ospf passive-interface
ip router ospf 1 area 0.0.0.0
ip dhcp relay address x
vrrp 80
    address 10.x.80.1
Also -Peer Gateway                      : Disabled
Optional but can be turnon to make both in forwarding mode.
Thanks
Ajay

Similar Messages

Nexus 5548UP - HSRP and vPC, tracking required?

Hi,
We've got two Nexus 5548UPs that are vPC and HSRP peers.
I've had some feedback that I should incorporate the tracking function to close the vPC down in the case of a layer 3 problem, the thing is I'm not sure it's required. I can see in this article it recommends implementing tracking when your L2 peer-link and L3 interfaces are on the same module (which it is in my case).. http://www.cisco.com/en/US/docs/switches/datacenter/sw/design/vpc_design/vpc_best_practices_design_guide.pdf
But in this article it says not to use tracking.. http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/design_guide_c07-625857.pdf
Any one got any real world experience and can offer some feedback.. I don't mind putting it in just want to understand why.
Thanks,
Nick.

Hi Nick
there is two tracking can be use din nexus enviroment
HSRP tracking and vPC tracking
for using one line card for the vPC peer link vPC tracking is recomnded
HSRP tracking is used to track L3 uplinks to the core
Using vPC with HSRP/VRRP object tracking may leads to traffic blackholing in case object tracking is triggered
its better to use separate L3 inter switch link instead of using HSRP tracking
hope this help

Nexus 5000 vpc and fabricpath considerations

Hello community,
I'm currently in the process of implementing a fabricpath environment which includes Nexus 5548UP as well Nexus 7009
NX OS on N5K is 6.0(2)N1(2)
Regarding the FP config on the N5K I wonder what is the best practice for the peer-link. Is it necessary to configure the Portchannel like below:
interface port-channel2
description VPC+ Peer Link
switchport mode fabricpath
spanning-tree port type network
vpc peer-link
There are several VLANs configured as FP.
As I understand we can remove the command:
spanning-tree port type network
Can anyone confirm this ?
Also I noticed a "cosmetic" problem. On two port 1/9 and 1/10 on both N5K it isn't possible to execute the command "speed"?!
When the command speed is executed I receive the following error:
ERROR: Ethernet1/9: Configuration does not match the port capability
Also please notice after the vPC and FP configuration we don't do a reload!
Thanks
Udo

Hi Simon -
Have done some testings in the lab on ISSU with FEXes either in Active/Active and Straight-through fashion, and it works.
Disabling BA on N5K(except the vPC peer link) is one of the requirements for ISSU .
In a lately lab testing with the following topo, BA is configured on the vpc 101 between the N5Ks and Cat6k. We have a repeated regular ping between the SVI interfaces of c3750 and Cat6K.
                      c3750
                         ||
                      vPC
                         ||
    N5K =====vPC====== N5K
                          ||
                     vpc 101
                          ||
                     Cat6k
When we changed the network type to disable BA, we observed some ping drops, which around 20-30.
I am not sure what your network looks like, hopefully this will give you some ideas about the ISSU. As a general recommendation, schedule a change window for some changes or even ISSU.
regards,
Michael

Nexus 5548UP vPC PIM-SSM

Hi
Does anyone configure pim-ssm in vPC domain ? I am looking for some config/experience before I start.
I know that PIM-SSM in vPC is only supported with FabricPath licencse which I allready got it.
Regs
Martin

Hi lilyzima1
direct link to the post : http://blog.alainmoretti.com/pim-ssm-through-nexus-vpc/

6500-VSS and NEXUS 56XX vPC interoperability

Hello, is it possible to establish a PORT CHANNEL between a couple of Cisco 6500 running VSS mode and a couple of NEXUS 5000 running vPC? . Design should be " Back-to-Back" : VSS-- Port-Channel--vPC.
I want also to support L2 and L3 flows between the two couples.
I read many forums but i am not sure it runs.
Is such design, if it runs; supported by Cisco?
Thanks a lot for your help.

Hi Tlequertier,
We have VSS 6509Es with Sup 2Ts & 6908 modules. These have a 40gb/sec (4 x 10gb/sec) uplink to our NEXUS 5548UP vPC switches.
So we have a fully meshed ether-channel between the 4 physical switches (2 x N5548UP & 2x6509E)
Kind regards,
Tim

3750 and Nexus 5548UP Support

I am working on a project that was handed down and several different engineers got their hands on. The project is (or should have been) a simple data storage/center. Fixing all the design problems has left me with very little time to research the security folks issues and I need help.
We are using Cisco Nexus 5548UP for our data center core and distribution/routing to encryptors connecting our remote sites which use Cisco 3750X series switches. The Nexus is running NOS 5.2(1)N1(4) and the 3750s use 12.2(55) IP base.
These are our particular issues:
1) For management and monitoring, what would be a good product to use to support this? If Cisco Prime Infrastructure, what ports would need to be allowed/opened through firewalls/ACLs (SNMP, syslog, etc)?
2) For switch login, the network security folks are reluctant to use TACACS and want to push for LDAP instead. Using Active Directory, is there any way to get the Cisco Nexus 5548UP and Cisco 3750Xs talking to Active Directory? I've found both 'yes' and 'no' answers online and am not sure. Do I need to use a different NOS and/or IOS? Are there specific directions somewhere? Or is it not possible?
3) Without TACACS, is there any way to implement command logging to a syslog server on the Nexus? On the 3750s, I make the following changes and all commands are relayed to our syslog server:
Enable
Configure terminal
Archive
Log config
Logging enable
Logging size 500
Hidekeys
Notify syslog
End
Is there anything similar for the Nexus?
4) In conjunction with #3, we need to be able to log each login attempt (success and failure) to a syslog server on the Nexus. On the 3750, using the "login on-[failure/success] log", it is can setup easy enough. On the Nexus, I haven't been able to find anything similar. I can't find any instructions on setting this up on the Nexus, though.
5) What IOS/NOS do we need to use to be able to lock out users after 3 failed logins (again, without using TACACS)?
If you need more information, please ask.
V/R,
Chris

The LRM is s special case transceiver which supports 10 Gbps over older FDDI grade multimode fiber when used with a mode conditioning patch cord. It is not supported on the Nexus 5548UP.
The SFP-10G-LR is used with single mode fiber for spans up to 10 km in length. It is supported on the 5548UP (and most every platform of Cisco's that takes SFPs).
Please see the product data sheet here.

Multicast: duplicated packets on nexus 7k with vpc and HSRP

Hi guys,
I'm testing multicast deployment on the lab shown below. The sender and the receiver are connected to the 6500 in two different vlans. The sender is in vlan 23 and the reciever in vlan 500. They are connected to the 6500 with a trunk link. There is VPc between the two nexus 7k and the 6500.
Furthermore, there is HSRP running on the two vlan interface 23 and 500 on both nexus.
I have configured the minimum to use PIM-SM with static RP. The RP is the 3750 above the nexus. (*,G) and (S,G) states are created correctly.
IGMP snopping is enabled on 6500, and the two nexus.
I'm using iperf to generate my flow, and netflow and snmp to monitor what happens.
All works correctly, my receiver receive the flow and it takes the good route. My problem is that I have four times more multicast traffic on the vlan interface 500 on both nexus but this traffic is only sent one time to the receiver (which is the good comportment) and the rest of the traffic is not shown on any other physical interface in outbound.
Indeed, I'm sending one flow, the two nexus receive it (one from peer link and the other from the 6500) in the vlan 23 (for example 25 packets inbound).
But when the flow is routed in the vlan 500, there is 100 packets on each interface vlan 500 on each nexus in outbound.
And when monitoring all physical interfaces, I only see 25 packets outbound on the interface linked with the receiver and the overflow isn't outgone.
I have joined the graphs I obtain on one of the nexus for the vlan 23 and the vlan 500. Netflow says the same things in bits/s.
Had someone already seen that? Any idea about the duplication of the packets?
Thanks for any comment,
Regards,
Configuration:
Nexus 1: n7000-s1-dk9.5.2.7.bin, 2 SUP1, 1 N7K-M132XP-12, 1 N7K-M148GS-11
Nexus 2: n7000-s1-dk9.5.2.7.bin, 2 SUP1, 1 N7K-M132XP-12, 1 N7K-M148GS-11
6500: s72033-adventerprisek9_wan-mz.122-33.SXI5.bin (12.2(33)SXI5)
3750: c3750-ipservicesk9-mz.122-50.SE5.bin (12.2(50)SE5)

Hi Kuldeep,
If you intend to put those routers on a non-vpc vlan, you may create a new inter-switch trunk between the N7K and allow that non-vpc vlan . However if those will be on a VPC vlan, best to create two links to the N7K pair and create a VPC, otherwise configure those ports as orphan ports which will leverage the VPC peer link .
HTH
Jay Ocampo

Nexus 5548UP and LACP

Hello,
I am trying to setup LACP on the Nexus 5548UP 10 Gig switch on Port-channel 3. However, when I setup LACP, eth ports 7 and 8 (on Port-channel 3) go into either inactive or down state (as below). The 10 gig ports (7 and 8) are connected to a server which has LACP capability.
ns5500(config-if)# do sh port-channel summary
Flags: D - Down        P - Up in port-channel (members)
        I - Individual H - Hot-standby (LACP only)
        s - Suspended   r - Module-removed
        S - Switched    R - Routed
        U - Up (port-channel)
        M - Not in use. Min-links not met
Group Port-       Type     Protocol Member Ports
      Channel
1     Po1(SU)     Eth      NONE      Eth1/15(P)   Eth1/16(P)
3     Po3(SD)     Eth      LACP      Eth1/7(D)    Eth1/8(D)
LACP setup as follows:
feature lacp
interface port-channel3
switchport access vlan 10
speed 10000
interface Ethernet1/7
switchport access vlan 10
channel-group 3 mode active
interface Ethernet1/8
switchport access vlan 10
channel-group 3 mode active
It would be great if anyone can help me with getting LACP up and running on the 10 Gig Nexus 5548UP. Please let me know if you need more information.
Thanks!

Thanks for your response. I do have vlan10 created and it is active. Thanks for correcting individual state instead of inactive.
I ran a few lacp commands below including "show lacp counters"
ns5500(config)# show lacp counters
                    LACPDUs         Marker      Marker Response    LACPDUs
Port              Sent   Recv     Sent   Recv     Sent   Recv      Pkts Err
port-channel3
Ethernet1/7        163655 13948    0      0        0      0        0
Ethernet1/8        161700 13976    0      0        0      0        0
By looking at LACP PDUs can we say that LACP is up and running?
ns5500(config)# show lacp port-channel
port-channel3
System Mac=54-7f-ee-8d-83-fc
Local System Identifier=0x8000,54-7f-ee-8d-83-fc
Admin key=0x2
Operational key=0x2
Partner System Identifier=0x0,0-0-0-0-0-0
Operational key=0x0
Max delay=0
VPC ID=0
Aggregate or individual=1
Member Port List=7-8
In the below command, it still says, interfaces 7 and 8 are down? What does that mean? An issue with the host? Is there anyway to test the nexus switch to check if it is doing its part and working correctly?
ns5500(config)# show port-channel summary
Flags: D - Down        P - Up in port-channel (members)
        I - Individual H - Hot-standby (LACP only)
        s - Suspended   r - Module-removed
        S - Switched    R - Routed
        U - Up (port-channel)
        M - Not in use. Min-links not met
Group Port-       Type     Protocol Member Ports
      Channel
1     Po1(SD)     Eth      NONE      --
3     Po3(SD)     Eth      LACP      Eth1/7(D)    Eth1/8(D)
Thanks.

Nexus 7000 with VPC and HSRP Configuration

Hi Guys,
I would like to know how to implement HSRP with the following setup:
There are 2 Nexus 7000 connected with VPC Peer link. Each of the Nexus 7000 has a FEX attached to it.
The server has two connections going to the FEX on each Nexus 7k (VPC). FEX's are not dual homed as far as I now they are not supported currently.
R(A)              R(S)
|                     |
7K Peer Link 7K
|                     |
FEX              FEX
Server connected to both FEX
The question is we have two routers connected to each of the Nexus 7k in HSRP (active and one is standby). How can I configure HSRP on the nexus switches and how the traffic will routed from the Standby Nexus switch to Active Nexus switch (I know HSRP works differently here as both of them can forward packets). Will the traffic go to the secondary switch and then via the peer link to the active switch and then to the active router ? (From what I read the packet from end hosts which will go via the peer link will get dropped)
Has anyone implemented this before ?
Thanks

Hi Kuldeep,
If you intend to put those routers on a non-vpc vlan, you may create a new inter-switch trunk between the N7K and allow that non-vpc vlan . However if those will be on a VPC vlan, best to create two links to the N7K pair and create a VPC, otherwise configure those ports as orphan ports which will leverage the VPC peer link .
HTH
Jay Ocampo

Cisco Nexus 5548UP and FI6248UP compatibility with FC SFP

Cisco Nexus 5548UP and FI 6248UP comes with Unified Ports. What are the SFP types this port can take? 1Gig, 10Gig and 2/4/8FC. Could you please clarify?
Thanks,
Cheriyan

Hi Cheriyan,
Here is te URL to the 6200 series FI data sheet:
http://www.cisco.com/en/US/prod/collateral/ps10265/ps11544/data_sheet_c78-675245.pdf
Check for the table to supported SFPs.
Same for the 5500 switches
http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/data_sheet_c78-618603.html.
Hope this helps!
./Abhinav

Ask the Expert: Cisco Nexus 2000, 5000, and 6000 Series Switches

with Cisco Expert Vinayak Sudame
Welcome to the Cisco Support Community Ask the Expert conversation. This is an opportunity to learn and ask questions how to configure and troubleshoot the Cisco Nexus 2000, 5000 and 6000 Series Switches with Cisco subject matter expert Vinayak Sudame. You can ask any question on configuration, troubleshooting, features, design and Fiber Channel over Ethernet (FCoE).
Vinayak Sudame is a Technical Lead in Data Center Switching Support Team within Cisco's Technical Services in RTP, North Carolina. His current responsibilities include but are not limited to Troubleshooting Technical support problems and Escalations in the areas of Nexus 5000, Nexus 2000, FCoE. Vinayak is also involved in developing technical content for Cisco Internal as well as external. eg, Nexus 5000 Troubleshooting Guide (CCO), Nexus 5000 portal (partners), etc. This involves cross team collaboration and working with multiple different teams within Cisco. Vinayak has also contributed to training account teams and partners in CAE (Customer Assurance Engineering) bootcamp dealing with Nexus 5000 technologies. In the past, Vinayak's responsibilities included supporting MDS platform (Fiber Channel Technologies) and work with EMC support on Escalated MDS cases. Vinayak was the Subject Matter Expert for Santap Technologies before moving to Nexus 5000 support. Vinayak holds a Masters in Electrical Engineering with Specialization in Networking from Wichita State University, Kansas. He also holds Cisco Certification CCIE (#20672) in Routing and Switching.
Remember to use the rating system to let Vinayak know if you have received an adequate response.
Vinayak might not be able to answer each question due to the volume expected during this event. Remember that you can continue the conversation on the Data Center sub-community, Other Data Center Topics discussion forum shortly after the event.
This event last through Friday July 12, 2013. Visit the community often to view responses to youe questions of other community members.

Hi Vinayak,
Output of "show cfs internal ethernet-peer database"
Switch 1
ETH Fabric
Switch WWN logical-if_index
20:00:54:7f:ee:b7:c2:80 [Local]
20:00:54:7f:ee:b6:3f:80 16000005
Total number of entries = 2
Switch 2
ETH Fabric
Switch WWN logical-if_index
20:00:54:7f:ee:b6:3f:80 [Local]
20:00:54:7f:ee:b7:c2:80 16000005
Total number of entries = 2
Output of "show system internal csm info trace"
Switch 1 in which "show cfs peers" show proper output
Mon Jul 1 05:46:19.145339 (CSM_T) csm_sp_buf_cmd_tbl_expand_range(8604): No range command in buf_cmd_tbl.
Mon Jul 1 05:46:19.145280 (CSM_T) csm_set_sync_status(6257): Peer RT status PSSed
Mon Jul 1 05:46:19.145188 (CSM_T) csm_sp_handle_local_verify_commit(4291):
Mon Jul 1 05:46:19.145131 csm_continue_verify_ac[597]: peer is not reachable over CFS so continuing with local verify/commit
Mon Jul 1 05:46:19.145071 csm_tl_lock(766): Peer information not found for IP address: '172.16.1.54'
Mon Jul 1 05:46:19.145011 csm_tl_lock(737):
Mon Jul 1 05:46:19.144955 (CSM_EV) csm_sp_build_tl_lock_req_n_send(941): sending lock-request for CONF_SYNC_TL_SESSION_TYPE_VERIFY subtype 0 to Peer ip = (172.16.1.54)
Mon Jul 1 05:46:19.143819 (CSM_T) csm_copy_image_and_internal_versions(788): sw_img_ver: 5.2(1)N1(2a), int_rev: 1
Mon Jul 1 05:46:19.143761 (CSM_T) csm_sp_get_peer_sync_rev(329): found the peer with address=172.16.1.54 and sync_rev=78
Mon Jul 1 05:46:19.143699 (CSM_T) csm_sp_get_peer_sync_rev(315):
Mon Jul 1 05:46:19.143641 (CSM_EV) csm_sp_build_tl_lock_req_n_send(838): Entered fn
Mon Jul 1 05:46:19.143582 (CSM_T) csm_set_sync_status(6257): Peer RT status PSSed
Switch 2 in which "show cfs peers" does not show proper output
Mon Jul 1 06:13:11.885354 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd switchport mode trunk, cmd pseq 77 seq 482
Mon Jul 1 06:13:11.884992 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd channel-group 51 mode active, cmd pseq 357 seq 369
Mon Jul 1 06:13:11.884932 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd switchport trunk allowed vlan 2, 11, cmd pseq 357 seq 368
Mon Jul 1 06:13:11.884872 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd switchport mode trunk, cmd pseq 357 seq 367
Mon Jul 1 06:13:11.884811 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd description process_vpc, cmd pseq 357 seq 366
Mon Jul 1 06:13:11.884750 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd channel-group 51 mode active, cmd pseq 352 seq 365
Mon Jul 1 06:13:11.884690 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd switchport trunk allowed vlan 2, 11, cmd pseq 352 seq 364
Mon Jul 1 06:13:11.884630 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd switchport mode trunk, cmd pseq 352 seq 363
Mon Jul 1 06:13:11.884568 (CSM_ERR) csm_pss_cmd_tree_walk_cb(2057): Parent command not found for cmd description process_vpc, cmd pseq 352 seq 362
Mon Jul 1 06:13:11.884207 (CSM_EV) csm_sp_acfg_gen_handler(3011): Preparing config into /tmp/csm_sp_acfg_1733916569.txt
Mon Jul 1 06:13:11.878695 csm_get_locked_ssn_ctxt[539]: Lock not yet taken.
Mon Jul 1 06:13:11.878638 (CSM_EV) csm_sp_acfg_gen_handler(2937): Recieved sp acfg merge request for type: running cfg
Mon Jul 1 06:12:29.527840 (CSM_T) csm_pss_del_seq_tbl(1989): Freeing seq tbl data
Mon Jul 1 06:12:29.513255 (CSM_T) csm_sp_acfg_gen_handler(3106): Done acfg file write
Mon Jul 1 06:12:29.513179 (CSM_EV) csm_sp_acfg_gen_handler(3011): Preparing config into /tmp/csm_sp_acfg_1733911262.txt
Mon Jul 1 06:12:29.508859 csm_get_locked_ssn_ctxt[539]: Lock not yet taken.
Mon Jul 1 06:12:29.508803 (CSM_EV) csm_sp_acfg_gen_handler(2937): Recieved sp acfg merge request for type: running cfg
Mon Jul 1 05:53:17.651236 Collecting peer info
Mon Jul 1 05:53:17.651181 Failed to get the argumentvalue for 'ip-address'
Mon Jul 1 05:40:59.262736 DB Unlocked Successfully
Mon Jul 1 05:40:59.262654 Unlocking DB, Lock Owner Details:Client:1 ID:1
Mon Jul 1 05:40:59.262570 (CSM_T) csm_sp_del_buf_cmd(1713): Deleting comand with Id = 1
Mon Jul 1 05:40:59.262513 DB Lock Successful by Client:1 ID:1
Mon Jul 1 05:40:59.262435 Recieved lock request by Client:1 ID:1
Mon Jul 1 05:40:41.741224 ssnmgr_ssn_handle_create_get: Session FSM already present, ID:1
Mon Jul 1 05:40:41.741167 ssnmgr_handle_mgmt_request: Create/Get request received for session[process_n5kprof]
show cfs lock gives no output.
Just to further clarify, we have 4 5548UP switches in the same management vlan. 2 switches are in one location lets say location A and they are CFS peers and are working fine.
These two switches which are having problem are in location B. All the switches are in the same vlan. Essentially the all CFS multicast messages will be seen by all 5548 switches as they are in the same vlan. I am assuming that this might not create any problems as we specify the peers in the respective configurations. Or do we have to change the CFSoIPv4 multicast addresses in location B or may be configure a different region.
Regards.

Partial collection Failure for nexus 5548UP in PI 2.1

Hi there,
I get "Partial Collection Failure" in the inventory collection status in Prime Infrastructure for all my Nexus 5548UP (8 devices).
i have seen in the PI 2.1 release notes that a bug CSCum16230 which look like my problem has been resolved in PI 2.1 but i continue getting the "partail collection failure"
Would like to know if the bug is still exist or get any other help to solve this problem.
Regards,
Alon.

hello
I have this problem as well...
we've got four N5K-C5548UP. Two with a layer 3 daughter card and two without.
interestingly we see the issue just on those boxes with the l3 daughter cards N55-D160L3-V2 installed...
Any help or ideas are highly appreciated
regards
roman
Sh inventory:
OK:
device-a# sh module
Mod Ports Module-Type Model Status
1 32 O2 32X10GE/Modular Universal Pla N5K-C5548UP-SUP active *
3 0 O2 Non L3 Daughter Card N55-DL2 ok
Mod Sw Hw World-Wide-Name(s) (WWN)
1 5.1(3)N2(1c) 1.0 --
3 5.1(3)N2(1c) 1.0 --
NOT OK:
device-b# sh modu
Mod Ports Module-Type Model Status
1 32 O2 32X10GE/Modular Universal Pla N5K-C5548UP-SUP active *
3 0 O2 Daughter Card with L3 ASIC N55-D160L3-V2 ok
Mod Sw Hw World-Wide-Name(s) (WWN)
1 5.1(3)N2(1c) 1.0 --
3 5.1(3)N2(1c) 1.0 --

Cisco Nexus 5548UP connect to dual NetApp controllers using FCOE

Here is my setup, I have two 5548UP's connected via VPC peer link. I am tring to use VPC to connect to a NetApp with dual 10gb ports using FCOE, with each 5548 getting one of the connections.
I then want to use VPC to connect to a dell server that has dual 10gb ports using FCOE as well with each 5548 getting a connection. I am new to FCOE, any help would be appreciated. I am getting confused in the configuration for both. Thanks

Erik,
Can you check the deployment guides from links pasted below -
http://www.cisco.com/en/US/solutions/ns340/ns414/ns742/ns743/ns1050/landing_flexpod.html
http://www.cisco.com/en/US/docs/solutions/SBA/February2013/Cisco_SBA_DC_NetAppStorageDeploymentGuide-Feb2013.pdf
Head to the Nexus 5k section and check how FCoE is configured, how vPC is configured..
Once you tackle 5k, depending on your Environment (from Netapp perspective), check how to create Interface groups.

Nexus 5548 UP and FCoE an brocade

Hi,
I need help.
Architecture :
I have got two Nexus 5548UP .
The nexus are linked to 2 brocade 200e.
Esxi are conrected to Nexus 2248PP, Fcoe and Data >>> interface 101/1/9
Problem:
I try configured Fcoe to Esxi 5.0 but the interface vfc 1 still down.
My configuration :
fex 101
pinning max-links 1
description "FEX101-N2232PP-S12"
fcoe
fex 102
pinning max-links 1
description "FEX102-N2232PP-Sxx"
fcoe
slot 1
port 31-32 type fc
vlan 2900
fcoe vsan 2900
vsan database
vsan 2900
feature npv
interface fc1/31
no shutdown
interface fc1/32
interface Ethernet101/1/9
descri TO-ESXI
switchport mode trunk
vfc1 is down (Error disabled)
    Bound interface is Ethernet101/1/9
    Hardware is Ethernet
    Port WWN is 20:00:54:7f:ee:b6:4b:bf
    Admin port mode is F, trunk mode is on
    snmp link state traps are enabled
    Port vsan is 2900
    1 minute input rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
    1 minute output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec
      0 frames input, 0 bytes
        0 discards, 0 errors
      0 frames output, 0 bytes
        0 discards, 0 errors
    last clearing of "show interface" counters never
Help me,
Cdlt,

Hi,
I had same configuration on both N5K.
I have removed the configuration Fcoe on second N5k.
Interface vfc1 seems to be Ok.
But i have another problem, On esxi the Emulex One command plug-in says ethernet's interfaces is up.
But Vcenter sees them down !!
Emulex One command :
In the distibuted Vswitch :
But LLDP seems Ok :

NEXUS 5548UP LAYOUT - Shared flogi between nexus

Hello,
I have 4 Nexus 5548UP, and I need to do they share information of FLOGI among the switches N5K1 and N5K3.
Today i can do this, the way shown above.
But I would like to have another link redundancy between switches N5K1 and N5K3.
I already tried adding this link redundancy on a port-channel, but when I do that I can not share the FLOGI informations between switches.
I would like your help to know what I can do in this case?.

In your picture I see, that you plan to use classical Fibrechannel for storage and FCoE for servers.
Fibrechannel and multihop FCoE has strict design rules of separate fabrics, which is very different to Ethernet (and IP) networking.
Specially vPC violates this separation; see eg. Fibre Channel over Ethernet Operations
http://www.cisco.com/c/en/us/td/docs/switches/datacenter/nexus5000/sw/operations/n5k_fcoe_ops.html#wp1079705
and
http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/mkt_ops_guides/513_n1_1/n5k_enhanced_vpc.html#wp1162674
SAN A and SAN B Traffic Isolation
You can deploy FCoE in an Enhanced vPC topology. Traditionally, the SAN network maintains two fabrics, the SAN A and SAN B. The traffic from side A is isolated from side B. Hosts and storage arrays are attached to host SAN networks for high availability. The FCoE traffic in an Enhanced vPC topology maintain the traffic isolation for two SAN networks. The FCoE command ensures the FCoE traffic from the FEX is only sent to one Cisco Nexus 5000 Series device is as follows:

Nexus 5548UP VPC and/or VRRP problem

Similar Messages

Maybe you are looking for