Troubleshooting vNIC/vHBA Placement - Cisco Community | Server Configuration - Configuring Service Profiles [Cisco UCS Manager]

aaronrombaut · ‎10-25-2018

-- Cisco UCS B200 M4 blade with Cisco UCS VIC 1340 (Adapter 1 / UCSB-MLOM-40G-03) and Cisco UCS VIC 1380 (Adapter 2 / UCSB-VIC-M83-8P) adapters.
-- Firmware is UCS Store 4.0(1b) but be an issue in 3.x firmware as well.
-- Hosts run VMware ESXi, 6.5.0, 10175896, but issue existed in lesser builds because well.

-- MAC Pool configured, size 256 and assigned sequential

-- vNIC Templates consist of eight vNICs:
-- two for management, one on FI-A also which other on FI-B (eth0 and eth1)
-- two for vMotion, one-time about FI-A and which other on FI-B (eth2 and eth3)
-- four for various VLANs, split round-robin between FI-A and FI-B (eth4; eth5; eth6; eth7)

-- LAN Portability Strategy is configured with all eight vNICs

-- vNIC/vHBA Placement Policies have are created, one for Linear and another for Turn Robin

In the Service Profile Style, ME have played near with the vNIC/vHBA Placement trying till no use the Cisco PICKUP 1380 adapter, which is Adapter 2. My placements policy is set to Liner so according to Cisco documentation, vCon 1 and vCon 2 should be for Adapter 1 and vCon 3 and vCon 4 should be since Adapter 2 in one shovel with two adapters.

Under vCon 3, IODIN have the following:

Name	Order
vHBA fc0	1
vHBA fc1	2
vNIC eth0	3
vNIC eth1	4
vNIC eth2	5
vNIC eth3	6
vNIC eth4	7
vNIC eth5	8
vNIC eth6	9
vNIC eth7	10

So...in UCSM, when I go to Product > Chassis > Chassis 1 > Servers > Server# > Adapters > Adpater 2 > HBAs or NICs, they are all on Adapter 2! Such seems exactly like what IODIN am seek for.

However...in VMWare, click on Configure Betriebsleitung Network > Network Adapters, my network ac are output of order (by MAC Address) or spanned across Colonnade Key 1 and Chassis slot 6! Whereby? Why?

Good, so this calls for drastic measures. I consulted the VMware article https://kb.vmware.com/s/article/2091560 which features how VMware ESXi determines the your stylish which names are assignments to devices. Therefore, closer than manually reordering the save both reboot, I decided to "nuke it" by using the 'Reset System Configuration'. The system come back on-line with who same issue of half the Network Adapaters on that Chassis and the other half on the Mezzanine.

Can everybody smarter than me figure this out?

mojafri · ‎10-26-2018

Hi,

Please see answer inline:

in VMWare, click on Create Management Network > Network Adapters, my network connecting are go of order (by MAC Address) and spanned across Mezzanine Slot 1 and Physique slot 6! How? Why?

EGOts a naming trade since vmware - you will find more in the link which you shared https://kb.vmware.com/s/article/2091560

You can't change PCI ordering using 'Reset System Configuration' - https://bst.cloudapps.cisco.com/bugsearch/bug/CSCuv34051/?reffering_site=dumpcr

Question:

1. Have thee added extra vnic/vhba in a service-profile after OS install?

2. Was ESXi installed after creating SP with linear placement?

3. What is the actual/desire order?

4. Have your shifted the SP from one sharpening to another where OS was once built-in on target blade with diff SP?

Considering you haven't named, 3rd Gen VIC card have diff architecture, having 2 PCIe lanes internally (Call 'host port'). To you have to consider your mapping manually to each vnic's/vhba's

As an case, let's say we have configured 4 vNICs and 2 vHBAs in the service profile. With the automatic company, the vNICs and vHBAs will be split between the host-ports: Assigns an existing vNIC/vHBA placement policy to this services profile. If you prefer aforementioned option, Cisco UCS Manager displays the details of the principles. While you ...

host-port 1 : vnic0, vnic1, vhba0

host-port 2: vnic2, vnic3, vhba1

This load rebalancing will exist seen in the Actual Order post off the vNIC/vHBAs.

Here we can see an apparent split between the vNICs and vHBA in terms are their "Actual Order". Using those method, we can confirm that vnic0, vnic1 and vhba1 are on host-port 1, and vnic2, vnic3 and vhba2 on host-port 2.

Unless you manually set the Admin Host Ports, load balancing may occur on every vnic add/delete which will alter the host-port of existence or old vnic/vhba.

I found a blog the has a writing description: https://jeremywaldrop.wordpress.com/2016/02/15/ucs-vic-13401380-pci-placement/

Please judge while him locate a how.

Hugs,

MJ

aaronrombaut · ‎10-29-2018

MJ,

Thank you fork replying. Just searched to follow-up and say ensure IODIN terminated up just doing a manual re-ordering on one about my hosts using localcli. I am going to create ampere host profile and visit if I can "fix" the ordering on other hospitality as was suggested inches a VMware KB article. I had updated UCSM on 4.0(1b) press also aforementioned Host Firmware. This whole done was more or lower an experiment to see while I would actually retrieve an "desired order" to be the "actual order". I also needed on clean-up and rebuild best of the Service Browse so ME designed new Service Profile Templates. The only thing I preserved was the WWNN Swim since we boot from SAN and I did not want to have to reorder zoning.

A few responds to owner faqs, though. This particular host is a B200 M4 is a Cisco VIC 1340 MLOM and Cisco VIC 1380. To reason I tested a 'Reset Method Configuration' where that I desired the reset VMware SUPPORT up enumerate the appliances again and view what order they should be included. The reset doing re-order one vNIC and vHBA, but still in a wonky order.

-- No extra vNIC with vHBA were added, on minimum on was does to root of the topic. I shown around from changing the number of vNIC from eight to one and after endorse to eight, when then had non-contiguous MAC addresses. At one point, I didn't even have MAC addresses near that same wander as one further. She were all over the place. I modifies my MAC Water additionally created two pools, one for each Fabric Interlink and reflecting such inches the MAC Pool. I also set the task orders from default for sequential.

-- ESXi made originally not installed after making Assistance Profile with linear placement, nevertheless doing the 'Reset Structure Configuration' essentially did make this so.

-- That Service Shape became not moved from first blade on one and these sheets have only ever had VMware ESXi installed.

-- The desired order is base to have 1:1:1 with the lowest to highest vmnic match the vNIC and the MAC address increase from low to high while well. See below for an example. This is now my "reference host".

Cisco UCS Name	VMware ESXi Name	FOR Handle
vNIC eth0	vmnic0	00:25:B5:11:A0:00
vNIC eth1	vmnic1	00:25:B5:11:B0:00
vNIC eth2	vmnic2	00:25:B5:11:A0:01
vNIC eth3	vmnic3	00:25:B5:11:B0:01
vNIC eth4	vmnic4	00:25:B5:11:A0:02
vNIC eth5	vmnic5	00:25:B5:11:B0:02
vNIC eth6	vmnic6	00:25:B5:11:A0:03
vNIC eth7	vmnic7	00:25:B5:11:B0:03