Nexus 5500 - Fabricpath Core Port - Error disabled. Reason:DCX-No ACK in 100 PDUs
Has anyone seen Fabricpath Core Interfaces between two Nexus 5596UP switches error-disabled because of missing DCBX Acks after 50mins?
I do not see interface errors and the peer is another 5500.
Both switches are running 5.1(3)N2(1) with this port config:
int e1/3
switchport mode fabricpath
! Cisco 5m Twinax cables
Log messages
2012 May 25 17:40:59 nexus1 %L3VM-5-FP_TPG_INTF_DOWN: Interface Ethernet1/3 down in fabricpath topology 0 - Interface down
2012 May 25 17:40:59 nexus1 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/3 is down (None)
2012 May 25 17:40:59 nexus1 %ISIS_FABRICPATH-5-ADJCHANGE: isis_fabricpath-default [3365] P2P adj L1 nexus5 over Ethernet1/3 - DOWN (Delete All) on MT-0
2012 May 25 17:40:59 nexus1 %CDP-5-NEIGHBOR_REMOVED: CDP Neighbor nexus5(FOX1550GDH1) on port Ethernet1/3 has been removed
2012 May 25 17:40:59 nexus1 %LLDP-5-SERVER_REMOVED: Server with Chassis ID 547f.ee63.fa88 Port ID Eth1/1 on local port Eth1/3 has been removed
2012 May 25 17:40:59 nexus1 %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/3 is down (Error disabled. Reason:DCX-No ACK in 100 PDUs)
Robert
Can you send the output of
show lldp interface ethernet 1/3
show lldp dcbx interface ethernet 1/3
a workaround may be to disable lldp on both sides on these physical interfaces
Similar Messages
-
Error disabled. Reason:DCX-No ACK in 100 PDUs
Hi,
I have a customer who lost all connectivity from the ESX host for both networking and FCoE because (as the title suggests) the interfaces were error disabled. This happened across all 8, dual ported, dual homed CNAs at the same time. Does anyone have any idea what this error comes from? The are using ESX 4.0 and are running Nexus 5020 with 4.2(1)N2(1a).
Thanks,
ThomDCBX Type Length Values(TLV) are packaged within a LLDP frame which is exchanged between the switch and the CNA. One such Control Sub-TLV is used for ACK which is sequence based. For example, the switch sends this control Sub-TLV with SeqNo of 1 and AckNo of 2. The host is supposed to inverse this and send a LLDP frame with control sub-TLV with SeqNo of 2 and AckNo of 1.
We expect this exchange every 30 seconds from the host and if the switch does not see it for 100 times 30 which is 3000 seconds (or 50 minutes), the switch error disables with following error
2011 May 13 12:03:23 CSX_5020_A1 %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet115/1/17 is down (Error disabled. Reason:DCX-No ACK in 100 PDUs)
2011 May 13 12:03:27 CSX_5020_A1 %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet116/1/16 is down (Error disabled. Reason:DCX-No ACK in 100 PDUs)
Some commands on the switch which helps in narrowing down root cause.
F340.24.10-5548-1# show lldp interface ethernet 1/22
Interface Information:
Enable (tx/rx/dcbx): Y/Y/Y Port Mac address: 00:05:73:ab:29:bd
Peer's LLDP TLVs:
Type Length Value
001 007 040000c9 9d2372
002 007 030000c9 9d2372
003 002 0078
006 045 456d756c 6578204f 6e65436f 6e6e6563 74203130 4762204d 756c7469
2066756e 6374696f 6e204164 61707465 72
007 004 00800080
127 055 001b2102 020a0000 00000002 00000001 04110000 c0000001 00003232
00000000 00000206 060000c0 00080808 0a0000c0 00890600 1b2108
000 000
F340.24.10-5548-1# show lldp dcbx interface ethernet 1/22
Local DCBXP Control information:
Operation version: 00 Max version: 00 Seq no: 1 Ack no: 2 <<---Our sequence # and Ack #
Type/
Subtype Version En/Will/Adv Config
003/000 000 Y/N/Y 0808
004/000 000 Y/N/Y 8906001b21 08
002/000 000 Y/N/Y 0001000032 32000000 00000002
Peer's DCBXP Control information:
Operation version: 00 Max version: 00 Seq no: 2 Ack no: 1 <<---Peer sequence # and Ack # should be reversed.
Type/ Max/Oper
Subtype Version En/Will/Err Config
002/000 000/000 Y/Y/N 0001000032 32000000 00000002
003/000 000/000 Y/Y/N 0808
004/000 000/000 Y/Y/N 8906001b21 08
F340.24.10-5548-1#
Root cause for this problem in most cases is misbehaving CNA/server or incorrect firmware/driver on the CNA. -
N5K err-disabled a port due to DCX-No ACK in 100 PDUs
I'm super new to Nexus, so I'm not really sure how to troubleshoot this. I did a quick search and found that this is related to DCBX TLVs in LLDP, which we apparently shouldn't be getting on a regular ethernet port. I'm pretty sure this is just a regular ethernet port. (Like I said, I'm pretty new to nexus. lol) I wonder if the following output indicates that we are receiving and sending DCBX TLVs in LLDP. If so, it sounds like the interface will go into err-disable state if the server stops sending ACK frames.
# show lldp dcbx int e1/17
Local DCBXP Control information:
Operation version: 00 Max version: 00 Seq no: 1 Ack no: 1
Type/
Subtype Version En/Will/Adv Config
004/000 000 Y/N/Y 8906001b21 08
002/000 000 Y/N/Y 0000000064 00000000 00000001
Peer's DCBXP Control information:
Operation version: 00 Max version: 00 Seq no: 1 Ack no: 1
Type/ Max/Oper
Subtype Version En/Will/Err Config
004/000 000/000 Y/Y/N 8906001b21 08
003/000 000/000 Y/Y/Y ff08
002/000 000/000 Y/Y/N ffffffff00 00000000 00000008
This is the first time we've run into this. Any idea what might really be going on?
Thanks!Hi,
Per the display it the Server Adapter is doing LLDP DCBX negotiation.
If not needed, then you might want to check the Server adapter settings.
DCBX is an extension of LLDP link layer discovery protocol; not restricted for FCOE usage.
Further informatin on LLDP for Nexus:
http://www.cisco.com/en/US/docs/switches/datacenter/nexus5500/sw/layer2/602_N1_1/b_5500_Layer2_Config_602N11_chapter_01010.html#task_1152779
Thanks!
Regards,
Carlos -
EEM on port error-disable due to UDLD
I would like to ask from the EEM community for some assistance in regards to crafting an EEM script for an ME-3800X. We have one or two appliances whereby the only uplink (TenGigabitEthernet0/1 and/or TenGigabitEthernet0/2) goes into error-disable and caused by UDLD. What I am looking for is a script to do the following:
1. If the ports TenGigabitEthernet0/1 and/or TenGigabitEthernet0/2 goes into error-disable caused by UDLD or link-flap then disable the port, wait for 5 seconds, enable the port;
2. Wait for 15 seconds and send an email.
I only want this EEM to work on the TenGigabitEthernet interfaces and I do not want the EEM script to do this on the access ports.
Error-disable recovery is a global option and there's no option to limit on a per-interface level.
Thank you in advance.Thanks for responding, Joe.
We were not able to take down the error messages but I believe they error messages could be:
%UDLD-4-UDLD_PORT_DISABLED: UDLD disabled interface Te0/2, unidirectional link detected
%PM-4-ERR_DISABLE: udld error detected on Te0/2, putting Te0/2 in err-disable state
Could an EEM script be created when an error message or an event of "unidirectional link detected" occurs, do the following:
1. In privilege mode, issue the command "udld reset".
2. Wait for 30 seconds and then send an email.
Thanks for your assistance and support, Joe. -
FI's uplink ports Error Disabled on ENM loop
Hi,
I have two UCS6120XP FIs connected to a Cat2948G-GE-TX switch via port 1/3 on each FI. One port on the Cat2948G-GE-TX acts as the uplink port and is connected to the LAN. All ports of the Cat2948G-GE-TX are in VLAN 1 to allow all connected devices to reach the Gateway via the LAN uplink port.
Now after a while both ports 1/3 on the FIs get error disabled on ENM loop.
'show cdp neighbor' on the Cat2k shows FIs hanging off of 2/45 & 2/46. The management ports of both FIs are connected to ports 2/1 and 2/2 of the
Cat2948G-GE-TX as well, as are some other devices.
I'd like to keep both FI uplink ports enabled for failover scenarios - how can I achieve that w/o the ports getting error-disabled?
Thanks,
MatthiasHi,
The reload was to test the loss of a FI prior to going into the production environment. A disassociate/reassociate of a SP made no difference.
I plan to upgrade to V2.2(1D) and re-test again tomorrow. -
New Trunking port Error Disabled on Nexus 5000
I configured my Nexus 5000 ports as so
Int Eth1000/1/48
switchport mode trunk
switchport trunk allowed vlan 8
speed 1000
channel-group 7 mode active
int Po7
switchport mode trunk
switchport trunk allowed vlan 8
vpc7
speed 1000
I configured my 3650 as so:
int Gig0/23
switchport trunk encapsulation dot1q
switchport trunk allowed vlan 8
switchport mode trunk
speed 1000
channel-group 1 mode active
Port channel 1
switchport trunk encapsulation dot1q
switchport trunk allowed vlan 8
switchport mode trunk
speed 1000
Both of these ports are connected Int Eth1000/1/48 and int Gig0/23. Int Eth1000/1/48 shut down and when I checked the logs on the N5K it said for the port ErrorDisabled REASON BPDUguard. I did not configure bpdufilter or bpduguard on either side. What is causing it?
I found 3 other ports the have bpdufilter on them would that be it?
Since the 3560 is an older switch how can I also ensure it get demoted to not be root bridge or secondary root bridge?Hi,
1- You tried to bundle GE and E interfaces with LACP on both switch but you did not mention the other bundle members, however, it looks the etherchannel did not comes up and interfaces work separately.
As a result, STP has prevented bridging loop and put one of them in errdisable state. I think you must check your etherchannel configuration.
2- you can use "spanning-tree vlan <> priority 61400" on 3560 switch to make sure it won't be a root bridge.
HTH
Houtan -
Nexus 5500 - unexplainable mutual-exclusion error when using "conf sync" mode
We have 2 Nexus 5548UP switches which are running NX-OS 7.0(5)N1(1).
I'm trying to reconfigure an interface, which was previously configured in conf t (local) mode on both switches, in conf sync mode.
Original config:
conf t:
interface Ethernet104/1/33
inherit port-profile DevServers
I've changed the configuration so that the vlan was manually configured and the port-profile was removed from the interface. Otherwise, it was not possible to configure a Port-profile inheritance in conf sync mode (as this was in conflict with the config in local mode).
Current config:
conf t:
interface Ethernet104/1/33
switchport access vlan 13
However, when I try to configure a PP inheritance for this interface in conf sync mode, I'm getting the same error as if there were a conflict:
conf sync:
interface Ethernet104/1/33
inherit port-profile DevServers
commit
Failed: Verify Failed
Status: Verify Failure
Error(s):
Following commands failed mutual-exclusion checks:
interface Ethernet104/1/33
inherit port-profile DevServers
When I configure another interface (not in use) with exactly the same configuration (so access vlan 13 in conft mode on both switches, and then a PP inheritance in conf sync mode), it is accepted and the configuration is correct. It looks like something is stuck within the NX-OS switch which makes it believe that the PP inheritance is still configured in conf t mode...
I've had this issue before on another interface, and found somewhere on the internet that the NX-OS keeps an internal database, which is mysteriously not always in sync with the current running-config, and that this could be forece manually with the command "resync-database" in conf-sync mode. On that other interface, this resolved the issue, but this time, it does not work and I keep getting the above error when I want to configure the port-profile.
Any suggestions?Ok... I found the source of the problem (looks to be buggy behaviour).
Here's my recent blog post that covers a detailed description and a fix/workaround:
http://nexp.com.ua/technologies/nx-os/troubleshooting-nx-os-config-sync/
Hope this will help anyone. -
Nexus 5500 "Mezz not found" error, system wont boot
Rebooted N5548UP after software upgrade didn't go as planned and now it wont boot up stating mezz not found. Attempting to get console access to boot the kickstart and load the image again but looking for direction if that doesn't work and what the mezz not found points to ??
A software upgrade attempt from 5.1.3 to 5.2.1 broke fiber channel connectivity so a reboot to revert back to original 5.1.3 was what got us stuck with a broken reboot for FYI.
daveWe had the same problem on a Notebook G71. If you can get to the BIOS, do a RAM and a Hard Drive test. Our Hard DRive test failed and we had to get a new hard drive. When we took the new hard drive through the Recovery phase, we still got a device missing error, not the same one as before though. We started the process over several times and finally it found what it was looking for and is working fine now.
Search these forums, you will find a lot of good advice. I did. -
Anyone ever seen this before? Trying to understand why the port error disabled.
2011 Jan 18 11:53:09 MTWDAVDC1BLDB9001 %ETHPORT-2-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/1 is down (Error disabled. Reason:requested by sap: MTS_SAP_DCX, req down_type: 2, req down_reason: 222 )
MTWDAVDC1BLDB9002# sh int eth1/1
Ethernet1/1 is down (DcxMultipleMSAPs)
Hardware: 1000/10000 Ethernet, address: 0027.0d23.4d8d (bia 0027.0d23.4d8d)
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
full-duplex, 10 Gb/s, media type is 10g
Input flow-control is off, output flow-control is off
Rate mode is dedicated
Switchport monitor is off
Last link flapped 1d03h
Last clearing of "show interface" counters never
1 minute input rate 0 bits/sec, 0 packets/sec
1 minute output rate 0 bits/sec, 0 packets/sec
Rx
153349455 input packets 143221479 unicast packets 3730739 multicast packets
6397237 broadcast packets 0 jumbo packets 0 storm suppression packets
66448449173 bytes
Tx
328643307 output packets 90031378 multicast packets
113132871 broadcast packets 12877361 jumbo packets
62121338327 bytes
0 input error 0 short frame 0 watchdog
0 no buffer 0 runt 0 CRC 0 ecc
0 overrun 0 underrun 0 ignored 0 bad etype drop
0 bad proto drop 0 if down drop 0 input with dribble
1416 input discard
0 output error 0 collision 0 deferred
0 late collision 0 lost carrier 0 no carrier
0 babble
0 Rx pause 0 Tx pause
8 interface resetsI looked into the error and would suggest opening a TAC case so our engineering team can look into this error. You can open a case using the supportforum as well to turn the thread into a case.
Sorry to not be able to help more, but looks like our internal team needs to look into this further.
Chad -
Vfc error disabled because of Ethernet port down?
We are building a new datacenter and is starting to set up the SAN.
This small DC consist of 2 Nexus 5596UP, a Compellent SAN and 2 Dell M1000e cassis with blade servers.
naive FC part in Nexus has been easy to set up but we have problems with the FCOE setup.
Since the blades are not installed yet none of the Ethernet ports are up. As soon as we bind an ethernet port to a vfc the vfc goes to error disable with this message:
%PORT-2-IF_DOWN_ERROR_DISABLED: %$VSAN 1900%$ Interface vfc101 is down (Error disabled)
Config snippets:
vlan 1900
fcoe vsan 1900
name VSAN-A-FCOE
vlan 1901
name VSAN-B-FCOE
vsan database
vsan 1900 name "VSAN-A"
vsan 1901 name "VSAN-B"
interface vfc101
bind interface Ethernet1/1
no shutdown
vsan database
vsan 1900 interface vfc101
vsan 1900 interface fc2/13
vsan 1900 interface fc2/14
vsan 1900 interface fc2/15
vsan 1900 interface fc2/16
interface Ethernet1/1
switchport mode trunk
spanning-tree port type edge trunk
vlan 1900
fcoe vsan 1900
name VSAN-A-FCOE
vlan 1901
name VSAN-B-FCOE
vsan database
vsan 1900 name "VSAN-A"
vsan 1901 name "VSAN-B"
vsan database
vsan 1900 interface vfc101
vsan 1900 interface fc2/13
vsan 1900 interface fc2/14
vsan 1900 interface fc2/15
vsan 1900 interface fc2/16
interface vfc101
bind interface Ethernet1/1
no shutdown
interface Ethernet1/1
switchport mode trunk
spanning-tree port type edge trunk
Do the vfc go error disable because the ethernet interface being down? I was under the impression it should just go "down"What you are seeing is normal.. Here are outputs from my lab switch where I shut Eth1/20 which is tied to vFC 20
24.10.5020A.1(config)# int ethernet 1/20
24.10.5020A.1(config-if)# shut
2011 Oct 21 10:16:01 24 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/20 is down(Config change)
2011 Oct 21 10:16:01 24 %FLOGI-5-MSG_PORT_LOGGED_OUT: %$VSAN 100%$ [VSAN 100, Interface vfc20: mode[TF]] Nx Port 21:00:00:c0:dd:12:0e:35 logged OUT.
2011 Oct 21 10:16:01 24 %PORT-5-IF_PORT_QUIESCE_FAILED: Interface vfc20 port quiesce failed due to failure reason: Epp Not Supported by Peer (0x19d)
2011 Oct 21 10:16:01 24 %PORT-5-IF_DOWN_NONE: %$VSAN 100%$ Interface vfc20 is down (None)
2011 Oct 21 10:16:01 24 %PORT-2-IF_DOWN_ERROR_DISABLED: %$VSAN 100%$ Interface vfc20 is down (Error disabled)
2011 Oct 21 10:16:02 24 %ETHPORT-5-IF_DOWN_ADMIN_DOWN: Interface Ethernet1/20 is down (Administratively down)
24.10.5020A.1(config-if)# -
(Error disabled. Reason:Disabled by Server Mgr triggered)
I´ve some ports in my Nexus 5k going to err-disable with the following message:
(Error disabled. Reason:Disabled by Server Mgr triggered)
These ports are connected in HPBlade 7000 through FEX Nexus B22 does someone know about this errors ?Hi,
Not sure if you already found the root cause of the issue,but this message generally comes from blade FEX's when there is an internal communication error or no connection between the FEX HIF's and the server chassis/software. This might come when a port is made "admin up" while is not configured or mapped blade from server perspective.
Thanks,
Ivan. -
I have a 3550 switch that gets a error-disabled copper ports. There is no errors ont the port. What else would cause it to be disabled?
Although there is no error on the port , there should be an error message in the log that should tell you the reason why the port got error disabled like port security violation , loopback detection , etherchannel misconfig etc.
You can enable errordisable recovery for all different causes by setting a timer. What happens is once this timer expires , the port is brough out of error dsiabled state.
Here are some of the useful commands.
D-C3550-2A(config)#errdisable ?
detect Error disable detection
recovery Error disable recovery
D-C3550-2A(config)#errdisable recovery ?
cause Enable error disable recovery for application
interval Error disable recovery timer value
Hope this helps.
Salman Z. -
FabricPath-Datacenter-Interconnection-only with Nexus 5500
Hi all,
we will interconnect 3 Datacenters in 3 different locations connected with DWDM.
The idea was to use 2x NX 5548 in each location to setup a FP Cloud between the sides.
But I am not sure, if we can use NX5500 in spine and leaf mode !
Or do we need a N7K pair as spine.
The documentation is not 100% clear at this point.
Would be great if someone can answer that ;-)
Ciao Andre!Command: show running-config vpc
!Time: Wed Sep 5 10:09:48 2012
version 5.1(3)N2(1a)
feature vpc
vpc domain 10
role priority 1024
system-priority 1024
peer-keepalive destination 10.158.100.101 source 10.158.100.100
delay restore 1
auto-recovery
fabricpath switch-id 10
ip arp synchronize
interface port-channel10
vpc peer-link
interface port-channel11
vpc 11
DCI-FP-001#
DCI-FP-001# sh run int eth 1/1
!Command: show running-config interface Ethernet1/1
!Time: Wed Sep 5 10:08:56 2012
version 5.1(3)N2(1a)
interface Ethernet1/1
description DC1-Backup, Te0/1#U
switchport mode trunk
switchport trunk allowed vlan 2-3967,4048-4093
storm-control broadcast level 3.00
storm-control multicast level 3.00
channel-group 11 mode active
DCI-FP-001# sh run int po 11
!Command: show running-config interface port-channel11
!Time: Wed Sep 5 10:09:37 2012
version 5.1(3)N2(1a)
interface port-channel11
description DC1-Backup, Po10#U
switchport mode trunk
switchport trunk allowed vlan 2-3967,4048-4093
spanning-tree port type normal
spanning-tree guard root
spanning-tree bpdufilter disable
storm-control broadcast level 3.00
storm-control multicast level 3.00
vpc 11
DCI-FP-001# sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 10
vPC+ switch id : 10
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
vPC fabricpath status : peer is reachable through fabricpath
Configuration consistency status: success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary
Number of vPCs configured : 1
Peer Gateway : Disabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
vPC Peer-link status
id Port Status Active vlans
1 Po10 up 2-501,2000-3499
vPC status
id Port Status Consistency Reason Active vlans vPC+ Attrib
11 Po11 up success success 2-501,2000-3 DF: Partial
499 -
I keep getting error 3004 when i try restoring and updateing my iphone 4 to iOS 7 i did everything 1. flushed dns 2. edited hosts 3. updated itunes and downloaded new one 4. switched usb ports 5. disabled antivirus 6. enabled ports 80 and 443 7. disabled firewall 8. even tryed putting mobile in DFU mode to restore it not of this worked so please help me
please replyyy i'm stuck on this like whole week
-
Campus Manager report - Ports in error Disabled state
Hi,
I have LMS 3.2 and I wonder how Campus Manager collects information from the switch to generate a report of discrepancies, namely a report of "Ports in Error Disabled state"??
I find that I have ports in errDisabled state but Campus Manger doesn´t show this information in "Ports in Error Dissabled state" report. What could be the problem?
Thanks.Hi,
Campus Manager do snmpwalk on the ciscoErrDisableMIB to get the status of the error disabled ports.
Thanks,
Gaganjeet Singh
Maybe you are looking for
-
How do I insert/Delete/Update a row to the DB Table from Business Component Browser
I am using the wizard and created a project containing Business component which contain some table. When I run the project I could see "Oracle Business Component Browser(local)" and when I select some table from "View Object Member" I get a window di
-
Any way to get Safari to handle bookmarks like Firefox?
I'm looking for one feature. Like many, I keep a folder in each of my bookmarks on the Bookmark Bar. I click on the item, and a list of URLs roll down. But in Safari, you must click on each folder to get it to open. When I click on the Firefox bookma
-
Set maximum server memory by using sql scripts
Dear all How to set maximum server memory by using sql scripts in sql server 2014? Thx a lot Best regards, Wallace
-
I "have" to buy a remote just to watch a DVD from my new iMac?
I can't even play a DVD on my new computer? I tried to look up "Front Row" tutorial on Apple's site. Well, I get over 230 topics, none of which relate to the "Front Row Application". This is pretty upsetting if I have to buy extra equipment just to w
-
Badges, We Don't Need No Stink'n Badges!
If there is a list of definitions of Badges in the Aperture user manual, I can't seem to find it. It doesn't turn up when you search Badges. (there should be a glossary) Does anyone know if there is such a list? Here's a sample of what I'm talking ab