Unable to create VLANs with SR-IOV / VF NIC

[Railgun]

This is a follow up from https://forum.opnsense.org/index.php?topic=27414.msg133006#msg133006.

For the basic relevant bits here:

-EPYC 7282 with a Supermicro H12SSL-i board running ESXi 7.
-Broadcom P225P/BCM57414 NIC with SR-IOV enabled. 

After the basic setup of getting these NICs sorted, I'm attempting to further this setup along.  Immediately after setting VLANs up within the UI, I'm met with the following:

Code: [Select]

vlan0: changing name to 'bnxt2_vlan2'
vlan0: changing name to 'bnxt2_vlan2'
vlan1: changing name to 'bnxt2_vlan3'
vlan1: changing name to 'bnxt2_vlan3'
bnxt2: Timeout sending HWRM_RING_ALLOC: (timeout: 2000) seq: 378
bnxt2: Timeout sending HWRM_FUNC_RESET: (timeout: 2000) seq: 379
bnxt0: Timeout sending HWRM_PORT_PHY_QCFG: (timeout: 2000) seq: 162
bnxt0: Timeout sending HWRM_PORT_PHY_QCFG: (timeout: 2000) seq: 163
bnxt0: Timeout sending HWRM_PORT_PHY_QCFG: (timeout: 2000) seq: 164
bnxt1: Timeout sending HWRM_PORT_PHY_QCFG: (timeout: 2000) seq: 162
The HWRM timeout messages are also seen in another FreeBSD based VM that has not had any config change made. 

These are VMs under ESXi7.  I have setup portgroups as follows for this particular message:

Physical NIC: vmnic2 -> vswitch: 25G-1 -> Port Group: ALL-1 (VL4095)

And in this instance, four interfaces have been created on this VM; one mgmt with a usual VMXNET interface, and three via SR-IOV.  One that is allowing all VLANs as depicted above and will tag within OPNSense, and two that have tagged port groups where I will not be tagging in the firewall. 

Given this error is seen across multiple VMs, this leads me to believe it's a possible HW setup issue.  However, this is the first time I've been playing with SR-IOV and am at a bit of a loss.  I haven't really been able to find this message and what the actual issue is.