OPNsense only detects one of two ConnectX-3 cards

[jackgriffith03]

I have two Mellanox ConnectX-3 CXC353A cards.
OPNsense detects both via shell:

Code Select Expand


root@opnsense:~ # pciconf -l | grep mlx
mlx4_core0@pci0:16:0:0: class=0x028000 rev=0x00 hdr=0x00 vendor=0x15b3 device=0x1003 subvendor=0x15b3 subdevice=0x0051
mlx4_core1@pci0:33:0:0: class=0x028000 rev=0x00 hdr=0x00 vendor=0x15b3 device=0x1003 subvendor=0x15b3 subdevice=0x0051


However, it only allows me to assign one of the two.

Code Select Expand


Enter an option: 1

Do you want to configure LAGGs now? [y/N]: n
Do you want to configure VLANs now? [y/N]: n

Valid interfaces are:

re0              ##:##:##:##:##:## RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet
mlxen0           ##:##:##:##:##:##

If you do not know the names of your interfaces, you may choose to use
auto-detection. In that case, disconnect all interfaces now before
hitting 'a' to initiate auto detection.


I've tried swapping them into different PCI-E slots to rule out a problematic card.
Both cards are good.
Whichever is in the first PCI-E slot can be assigned. The other can't.

Has anyone else encountered this?

[jackgriffith03]

This problem was solved with a workaround.
I uninstalled OPNsense and installed Ubuntu Server.
Both cards are now detected and functioning normally.