SAN Port-Channel between Nexus 5000 and Brocade 5100
I have a Nexus 5000 running in NPV mode connected to a Brocade 5100 FC switch using two FC ports on a native FC module in the Nexus 5000. I would like to configure these two physical links as one logical link using a SAN Port-Channel/ISL-Trunk. An ISL trunking license is already installed on the Brocade 5100. The Nexus 5000 is running NX-OS 4.2(1), the Brocade 5100 Fabric OS 6.20. Does anybody know if this is a supported configuration? If so, how can this be configured on the Nexus 5000 and the Brocade 5100? Thank you in advance for any comments.
Best regards,
Florian
I tried that and I could see the status light on the ports come on but it still showed not connected.
I configured another switch (a 3560) with the same config and the same layout with the fiber and I got the connection up on it. I just cant seem to get it on the 4506, would it be something with the supervisor? Could it be wanting to use the 10gb port instead of the 1gb ports?
Similar Messages
-
Issues with a port-channel between Nexus 5K and 4506
I'm having some trouble configuring an up-link from a Cisco 4506 to a set of Nexus 5k switches and cannot get either side to recognize the media. My configuration is as follows...
Nexus 5k
interface Ethernet1/22
description ## 1A ##
switchport mode trunk
switchport trunk native vlan 150
speed 1000
Cisco 4506
interface GigabitEthernet1/6
switchport trunk encapsulation dot1q
switchport trunk native vlan 150
switchport mode trunk
I am using 1gb sfp's (GLC-SX-MM) and I have verified that the fiber cables I am using and the fiber between closets is in working condition. But I cannot get the interface to come up.I tried that and I could see the status light on the ports come on but it still showed not connected.
I configured another switch (a 3560) with the same config and the same layout with the fiber and I got the connection up on it. I just cant seem to get it on the 4506, would it be something with the supervisor? Could it be wanting to use the 10gb port instead of the 1gb ports? -
SAN Port Channel between 6120 and Brocade
Has anyone setup or know how to setup a SAN Port Channel between 6120s and a Brocade FC switch? I know that it requires UCS firmware 1.4 but I don't know what the Brocade requirements are.
The SAN port channel is Cisco proprietory. You cannot setup SAN port channel with Brocade. Sorry
-
Port channel between Nexus and Server is initializing
Hi all,
I will need your help.
I have Nexus 5000, there is a POrt Channel between Nexus and Server, but one port always is in initializing.
sh interface Ethernet101/1/27
Ethernet101/1/27 is down (initializing)
Hardware: 1000/10000 Ethernet, address: c8f9.f920.5b5c (bia c8f9.f920.5b5c)
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA
Port mode is trunk
auto-duplex, 10 Gb/s, media type is 10G
Beacon is turned off
Input flow-control is off, output flow-control is on
Rate mode is dedicated
Switchport monitor is off
Any idea?
Regardshow many ports are you using in this port channel.
can you paste the configuration of the channel ports and the interface.
check the sh log if you are getting any log related to the port channeling. -
Create port channel between UCS-FI and MDS 9124 (F Mode)
Dear Team,
We were trying to create port channel between UCS FI and MDS 9124
But the port channel not getting active in F mode on MDS 9124
FI is in FC End Host Mode
We have enabled FC uplink trunking on FI
We have enabled NPIV on MDS
We have enabled trunk on MDS
FI and MDS in default VSAN
To check we changed the FI mode to FC Switching mode and port channels became active but in E mode
when we enabled FC uplink trunking on FI and FC Switching mode port channels became active in TE mode
but in both the above cases showflogi database shows WWPN of SAN alone not showing any from FI.
How to achive this?
Have read that no need to change the swicthing mode to FC Switching mode and keep as FC Endhost mode
SO how to achieve Port channel with F mode in MDS and FI ( Mode showing as NProxy)
Does it has to do anything with MDS NX-OS version? (https://supportforums.cisco.com/thread/2179129)
If yes how to upgrade as license for ports came along with Device and we do not have any PAC/PAK or license file as it came
with license
Also we have seen 2 files availabe for download (m9100-s2ek9-kickstart-mz.5.2.8b.bin and m9100-s2ek9-mz.5.2.8b.bin) which to use
Thanks and Regards
JoseHi Jo Bo,
what version of software if your MDS running?
On your UCS do connect nxos and show inteface brieft and look at the mac address.
it is possible that you might be hitting the bug below. if this is the case you might need to upgrade the firmware on your MDS.
Add MAC OUI "002a6a", "8c604f", "00defb" for 5k/UCS-FI
http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCty04686
Symptom:
Nexus switch unable to connect any other Nexus or other Cisco Switch in NPV mode with a F port-channel. Issue might be seen in earlier 5.1 releases like
5.1.3.N1.1a
but not the latest
5.1.3.N2.1c
release. Issue is also seen in
5.2(1)N1(1)
and
6.0(2)N1(1)
and later releases.
Conditions:
Nexus configured for SAN PortChannels or NPIV trunking mode Nexus connected to UCS via regular F port channel where UCS in NPV mode NPV edge switch: Port WWN OUI from UCS FI or other Cisco manufactured switch: xx:xx:00:2a:6a:xx:xx:xx OR xx:xx:8c:60:4f:xx:xx:xx
Workaround:
Turn-off trunking mode on Nexus 5k TF-port Issue does not happen with standard F-PORT Remove SAN Portchannel config
Further Problem Description:
To verify the issue please collect show flogi internal event-history errors Each time the port is attempted OLS, NOS, LRR counters will increment. This can be determined via the following output, show port internal info all show port internal event-history errors -
Configure port channel between IO Module and FI
Hi,
I have the current setup
UCS chassis (4 uplinks) --> FI --> (Port channel) --> N5K --> (port channel) --> VSS 6500
I configure port channel between IO Module and the FI by changing to policy to "Port Channel" and set the link to 4
FI has created a portchannel under "Internal" containing all the FI interfaces that are connected to the IO module.
I have installed ESXI on a blade but i was unable to reach it, even the esx was unable to ping the gateway.
VLAN tagging is enabled from the ESX server.
I have issued the command "show mac address-table | inc <mac address of the vnic assigned from thre service profile> on both the N5K and thr 6500 and the mac is there.
I have allowed all the vlans on the vNIC from the service profile.
am I missing anything?
thanksHello,
Can you please check whether your ESXi vmkernel interface ip address learned on right VLAN on FI / upstream switch or not.
connect nxos
show mac-address-table | inc
Padma -
UCS FI 6248 to Nexus 5548 San port-channel - not working
Hi all,
I'm sure I am missing something fairly obvious and stupid but I need several sets of eyes and help.
Here is the scenario:
I want to be able to create san port-channels between the FI and Nexus. I don't need to trunk yet as I can't even get the channel to come up.
UCS FI 6248:
Interfaces fc1/31-32
Nexus 5548
interfaces fc2/15-16
FI is in end-host mode and Nexus is running NPIV mode with fport-channel-trunk feature enabled.
I'm going to output the relevants configurations below.
Nexus 5548:
NX5KA(config)# show feature | include enabled
fcoe 1 enabled
fex 1 enabled
fport-channel-trunk 1 enabled
hsrp_engine 1 enabled
interface-vlan 1 enabled
lacp 1 enabled
lldp 1 enabled
npiv 1 enabled
sshServer 1 enabled
vpc 1 enabled
interface san-port-channel 133
channel mode active
no switchport trunk allowed vsan all
switchport trunk mode off
interface fc2/15
switchport trunk mode off
channel-group 133 force
no shutdown
interface fc2/16
switchport trunk mode off
channel-group 133 force
no shutdown
NX5KA# show vsan membership
vsan 1 interfaces:
fc2/13 fc2/14
vsan 133 interfaces:
fc2/15 fc2/16 san-port-channel 133
vsan 4079(evfp_isolated_vsan) interfaces:
vsan 4094(isolated_vsan) interfaces:
NX5KA# show san-port-channel summary
U-Up D-Down B-Hot-standby S-Suspended I-Individual link
summary header
Group Port- Type Protocol Member Ports
Channel
133 San-po133 FC PCP (D) FC fc2/15(D) fc2/16(D)
UCS Fabric Interconnect outputs:
UCS-FI-A-A(nxos)# show san-port-channel summary
U-Up D-Down B-Hot-standby S-Suspended I-Individual link
summary header
Group Port- Type Protocol Member Ports
Channel
133 San-po133 FC PCP (D) FC fc1/31(D) fc1/32(D)
UCS-FI-A-A(nxos)#
UCS-FI-A-A(nxos)# show run int fc1/31-32
!Command: show running-config interface fc1/31-32
!Time: Fri Dec 20 22:58:51 2013
version 5.2(3)N2(2.21b)
interface fc1/31
switchport mode NP
channel-group 133 force
no shutdown
interface fc1/32
switchport mode NP
channel-group 133 force
no shutdown
UCS-FI-A-A(nxos)#
UCS-FI-A-A(nxos)# show run int san-port-channel 133
!Command: show running-config interface san-port-channel 133
!Time: Fri Dec 20 22:59:09 2013
version 5.2(3)N2(2.21b)
interface san-port-channel 133
channel mode active
switchport mode NP!Command: show running-config interface san-port-channel 133
!Time: Sat May 16 04:59:07 2009
version 5.1(3)N1(1)
interface san-port-channel 133
channel mode active
switchport mode F
switchport trunk mode off
Changed it as you suggested...
Followed the order of operations for "no shut"
Nexus FC -> Nexus SAN-PC -> FI FC -> FI SAN-PC.
Didn't work:
NX5KA(config-if)# show san-port-channel summary
U-Up D-Down B-Hot-standby S-Suspended I-Individual link
summary header
Group Port- Type Protocol Member Ports
Channel
133 San-po133 FC PCP (D) FC fc2/15(D) fc2/16(D)
NX5KA(config-if)#
Here is the output as you requested:
NX5KA(config-if)# show int san-port-channel 133
san-port-channel 133 is down (No operational members)
Hardware is Fibre Channel
Port WWN is 24:85:00:2a:6a:5a:81:00
Admin port mode is F, trunk mode is off
snmp link state traps are enabled
Port vsan is 133
1 minute input rate 1256 bits/sec, 157 bytes/sec, 0 frames/sec
1 minute output rate 248 bits/sec, 31 bytes/sec, 0 frames/sec
3966 frames input, 615568 bytes
0 discards, 0 errors
0 CRC, 0 unknown class
0 too long, 0 too short
2956 frames output, 143624 bytes
0 discards, 0 errors
46 input OLS, 41 LRR, 73 NOS, 0 loop inits
257 output OLS, 189 LRR, 219 NOS, 0 loop inits
last clearing of "show interface" counters never
Member[1] : fc2/15
Member[2] : fc2/16
NX5KA(config-if)#
NX5KA(config-if)# show int brief
Interface Vsan Admin Admin Status SFP Oper Oper Port
Mode Trunk Mode Speed Channel
Mode (Gbps)
fc2/13 1 auto on sfpAbsent -- -- --
fc2/14 1 auto on sfpAbsent -- -- --
fc2/15 133 F off init swl -- 133
fc2/16 133 F off init swl -- 133 -
FC Port Channel between UCS and MDS.
Hi All,
I am new to Cisco Fabric Concepts. In my enviornment i have a F port channel(8 Port Group) created on MDS 9513 switch and this Fport
channel is connected to Cisco UCS 6296 FI. The Cisco UCS Blade servers are connected to the Fabric Interconnect .
On MDS NPIV is enabled.
Can anyone explain the below questions.
1. Why do we create an F port Channel Group and connect it to the UCS FI? Is this something similar to Brocade Edge to AG Switch Connectivity.
2. How to configure F port Channel Group in MDS . Can anyone explain with an example.
3. Do we need to make any Configuration on UCS FI ports for server connectivity and Channel port Connectivity if yes what are the steps required to
do the same.Does the WWPN shows up in the FLOGI Database if the connectivity and configuration looks good in UCS FI and MDS.
4. What happens when a VSAN on MDS switch is added to the Port Channel.
Thanks and Regards,
Santosh suryaLook at my remarks in
https://supportforums.cisco.com/discussion/12468266/fc-port-channels-between-mds-and-ucs-fi-best-practice
1. Why do we create an F port Channel Group and connect it to the UCS FI? Is this something similar to Brocade Edge to AG Switch Connectivity.
F port channel is proprietary; therefore any such F port channel between UCS FI and Brocade doesn't work.
2. How to configure F port Channel Group in MDS . Can anyone explain with an example.
see eg.
https://supportforums.cisco.com/sites/default/files/legacy/9/9/2/53299-UCS_1-4-1_F-port_channel-trunk-v1.pdf
3. Do we need to make any Configuration on UCS FI ports for server connectivity and Channel port Connectivity if yes what are the steps required to
see eg.
https://supportforums.cisco.com/sites/default/files/legacy/9/9/2/53299-UCS_1-4-1_F-port_channel-trunk-v1.pdf
Does the WWPN shows up in the FLOGI Database if the connectivity and configuration looks good in UCS FI and MDS.
flogi database is on the MDS, not FI; there are however UCS CLI commands, like "show npv ...."
4. What happens when a VSAN on MDS switch is added to the Port Channel.
If its not created on UCS, it will just not become the status "up" -
LACP port channel between 6509 and Nexus 7K
We are in the process of migrating from dual 6509's to dual 7010's. We have moved our 5k/2K's behind the 7K and have layer 2 up between the 6509 and 7K. This link is configured as a port channel with 2 1gig links using LACP. The port channel is up and working and traffic is passing but it doesn't appear the load it equally distributed between the links. Both the 7K and 6K are setup for src-dst-ip for the load balancing. The links have been in place for over 12 hours and I would have expected them to "equal" out. Has anyone had this issue in or is this to be expected? For clarification there is not VPC inolved in this configuration it is simply a port-channel between one 6509 and a 7010.
Thanks,
JoeWe are in the process of migrating from dual 6509's to dual 7010's. We have moved our 5k/2K's behind the 7K and have layer 2 up between the 6509 and 7K. This link is configured as a port channel with 2 1gig links using LACP. The port channel is up and working and traffic is passing but it doesn't appear the load it equally distributed between the links. Both the 7K and 6K are setup for src-dst-ip for the load balancing. The links have been in place for over 12 hours and I would have expected them to "equal" out. Has anyone had this issue in or is this to be expected? For clarification there is not VPC inolved in this configuration it is simply a port-channel between one 6509 and a 7010.
Thanks,
Joe -
FC port channels between MDS and UCS FI best practice?
Hi,
We would like to create FC port channels between our UCS FI's and MDS9250 switches.
At the moment we have 2 separate 8Gbps links to the FI's.
Are there any disadvantages or reasons to NOT do this?
Is it a best practice?
Thanks.As Walter said, having port-channels is best practice. Here is a little more information on why.
Let's take your example of two 8Gbps links, not in a port-channel ( and no static pinning ) for Fibre Channel connectivity:
Hosts on the UCS get automatically assigned ( pinned ) to the individual uplinks in a round-robin fashion.
(1)If you have some hosts that are transferring a lot of data, to and from storage, these hosts can end up pinned to the same uplink and could hurt their performance.
In a port-channel, the hosts are pinned to the port-channel and not individual links.
(2)Since hosts are assigned to an individual link, if that link goes down, the hosts now have to log back into the fabric over the existing working link. Now you would have all hosts sharing a single link. The hosts will not get re-pinned to a link until they leave and rejoin the fabric. To get them load balanced again would require taking them out of the fabric and adding them back, again via log out, power off, reload, etc...
If the links are in a port-channel, the loss of one link will reduce the bandwidth of course, but when the link is restored, no hosts have to be logged out to regain the bandwidth.
Best regards,
Jim -
Greetings Everyone,
I have been beating my head on the desk for the last few days tring to get a FC connection established between a NX5010 and a MDS9509. The 9509 is running the legacy storage systems but we are moving to FCoE on the NEXUS. I am not getting link on the fiber between the 2 devices. I have checked and verified the MM cable both SFP units have been swapped out.
I keep getting the following on the MDS when I bring up the interface.
2011 Apr 22 20:39:42 MDS9509_01 %PORT-5-IF_DOWN_INACTIVE: %$VSAN 1%$ Interface fc1/9 is down (Inactive)
fc1/9 is down (Inactive)
Port description is Connection to Nexus 5kSW01 [FC2/1]
Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
Port WWN is xxxxxxxxxxxxxxx
Admin port mode is auto, trunk mode is on
On the NX 5010 I have
fc2/1 is down (Link failure or not-connected)
Hardware is Fibre Channel, SFP is short wave laser w/o OFC (SN)
Port WWN is xxxxxxxxxxxxxxxxx
Admin port mode is auto, trunk mode is on
snmp link state traps are enabled
Port vsan is 1
Receive data field Size is 2112
I dont have anything really configured I am just tring to get a link to establish. If someone has a sample configuration for this or a suggestion, I would certainly appreciate it.
Cheers
MikeYes, the trunk interfaces must be assigned into active VSAN, even though they are trunk (TE) ports and might not even be trunking that VSAN.
There is no concept of Spanning-Tree in Fibre Channel. Don't confuse Ethernet with FC, a lot of things a different. VSANs are similar to VLANs and they allow you to segregate traffic, and VSAN trunking also has the same goal as VLAN trunking, but that's where the similarity with Ethernet ends.
The loop prevention is achieved through FSPF (FC shortest path first) algorithm. Think of it as OSPF. Each VSAN runs its own FSPF process. Each FC switch has a unique Domain ID (value from 1 to 254) assigned by the FC Domain process in each VSAN. FSPF process is automatically on, it detects other switches and determines a best path between domain IDs based on FSPF interface costs (per VSAN). So it's actually more like IP routing than Ethernet STP. FC addresses are 3-byte FCID addresses where the first byte is the domain ID of the switch that the node (storage or HBA) is connected to. You are probably familiar with WWN's, but WWN's are not actually used in fibre channel frame headers, instead they are mapped to FCIDs.
FC/SANOS is a fun topic, consider becoming CCIE Storage expert (http://www.iementor.com/ccie-storage-workbook-walkthrough-bundle-p-338.html)
I'm not sure why it took 2 minutes for interface to come up, it should have been instanteneous, are you saying the actual interfaces didn't go Up for two minutes after changes were made?
There's no VPC concept in fibre channel. There is a regular port channel that Cisco has on MDS/NX-OS FC switches. Yes, you can configure Port channel between NX-OS on N5K and SAN-OS/NX-OS on MDS9K. It must be configured between two switches and can't span multiple switches. -
UCS - san-port-channel over vpc
Hi,
I'm hoping someone can help out with this,
I have a setup with 2 Nexus 5548's connected over a vpc peer link and a keepalive, These two nexus switch's have a standard VPC connection to an upstream 6500. this is working fine,
Then there are multiple native FC connections from the 5548's to 6248's. I know there is the option to configure FC port-channel's on the UCS 2.0 but is it possible to put fc interfaces of the nexus 5548 into a san port-channel across a vpc between the the nexus 5548's.
so for example, can i port-channel the following across a vpc or is a san port-channel restricted to ports on the same nexus switch only.
Fabric A fc1/31 & fc1/32 uplinked to -> NX5K-1 Port fc1/31 & NX5K-2 Port fc1/32 (san port-channel 10 over a VPC)
Fabric B fc1/31 & fc1/32 uplinked to -> NX5K-1 Port fc1/32 & NXFK-2 Port fc1/31 (san port-channel 11 over a VPC)
Thanks,
Ray.This is not possible. Vpc is layer 2 only ethernet port channel. San port channel cannot be built accross vpc
Sent from Cisco Technical Support iPhone App -
Hello All
What can be the max difference in cable lengths that we can have between the ISLs in a port-channel between MDS switches? Do we have any documentation?
Thanks
Chetancompetitive solution instead recommends a distance variance of 30 meters or less among ISLs within a trunk. If the distance variance is greater than 30 meters, undesired and degraded performance will occur. For example, if a trunk has a distance of 100 kilometers, the competitive trunking solution allows a cable length variance of only 0.03 percent!
ref;
http://www.cisco.com/c/en/us/products/collateral/storage-networking/mds-9500-series-multilayer-directors/white_paper_c11-534878.html
hth
regards
inayath
**********PLZ dont forget to rate if this info is helpfull. -
Creating san-port-channel on 6248 using CLI
I can create the san port channel using UCS manager. But I would like to know the syntax using CLI. So far I was able to figure out the following. One thing missing was moving the port channel from the default VSAN(1) to a different VSAN i.e VSAN 10 in my case. I have looked at the CLI guide, but have not found the commands syntax. Appreciate if anyone can post the syntax
### Create Port Channel ###
scope fc-uplink
scope fabric a
create port-channel 1
enable
set name port-channel-1
set adminspeed auto
commit-buffer
end
### Add interfaces to Port Channel ###
scope fc-uplink
scope fabric a
scope port-channel 1
create member-port 1 29
exit
create member-port 1 30
commit-buffer
endThanx Wdey. That's exactly what I was looking for. Here is the syntax which works for me.
scope fc-uplink
scope fabric a
create port-channel 1
enable
set name port-channel-1
set adminspeed auto
commit-buffer
end
scope fc-uplink
scope fabric a
enter port-channel 1
enable
enter member-port 1 29
enable
exit
enter member-port 1 30
enable
exit
set adminspeed auto
exit
enter vsan VSAN10 10 10
set fc-zoning disabled
set fcoe-vlan 10
set id 10
enter member-port-channel a 1
exit
localize
exit
end
commit-buffer -
Port-channel between ACE4710 and switch
Hi all,
I have configured port-channels on ACE and switch. Full-duplex and speed 1000Mbps are set on both sides. The configurations of port-channel on both sides is same. But there are output drops on the switch. See:
Last clearing of "show interface" counters 00:31:24
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 536
Why there are output drops on the switch? There is no half-duplex and both sides have the same speeds.
Thank you
RomanHi Roman,
Please paste the configuration of the ACE and Switch
Cesar R
ANS Team
Maybe you are looking for
-
Airport Extreme no longer recognizes external HDD
My Airport Extreme has suddenly stopped recognizing the external HDD I have attached to it. This happened about 2 weeks ago, and has been driving me absolutely insane since (I use this HDD to store all my music, and as such have not been able to list
-
Hi Experts, We are using cFolders for two envelope bidding from SRM 701. Could you please help me with the following questions? cFolder 1) Is there a Database instances? 2) Where can find the supported OS/DB in the PAM for cFolder? 3) Is this Java or
-
I have just recently lost use of 2 USB ports and my isight camera. My keyboard works fine, but there is not any indication of connections when probing USB in "About this MAC". I have rebooted, executed a PRAM reset, and reloaded my OS, but to no av
-
Problem in Activating from New data to Active data in DSO
Hi All, For my DSO I am fetcdhing some fields from other DSO table , through END Routine ,. After running the DTP , I am getting data for the fileds which i am fetching through routine in New data Table. After Activating the New data table to A
-
I am wondering if it is illegal to download and use Java for my TX. I know Palm does not support it, but does that mean I can't use it if I find it somewhere else for download, such as http://www.palminfocenter.com/news/7769/five-tips-to-improve-the-