1
Hardware and Performance / Mellanox Connectx3 QSFP+
« on: November 22, 2024, 07:19:43 pm »
Hello,
First im a total Beginner. I did build a box, installed opnsense, working fine.
For a network card i chose a connectx3. It has 2 QSFP+ Ports. I wanted to connect to my Mikrotik switch via AOC Cable. I cant get it to link up.
DAC to a second Server with Connectx3 is working. SFP+ Coper and Fiber 10gbe is working. 1g copper is working. All cabels are connecting the second server with TrueNas and connectx3 without a problem.
I got no clue how to continue. I thing it must be opnsense.
root@Router:~ # ifconfig -vvm mlxen0
mlxen0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN (wan)
options=8c00a8<VLAN_MTU,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,LINKSTATE,HWSTATS>
capabilities=ed07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS>
ether f4:52:14:54:a1:e1
inet6 fe80::f652:14ff:fe54:a1e1%mlxen0 prefixlen 64 scopeid 0x5
media: Ethernet autoselect
status: no carrier
supported media:
media autoselect
media 40Gbase-CR4 mediaopt full-duplex
media 10Gbase-CX4 mediaopt full-duplex
media 10Gbase-SR mediaopt full-duplex
media 1000baseT mediaopt full-duplex
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
drivername: mlxen0
root@Router:~ # /usr/bin/mst status -v
PCI devices:
------------
DEVICE_TYPE MST PCI RDMA NET
NUMA
ConnectX3(rev:1) pci0:1:0:0 01:00.0
root@Router:~ # /usr/bin/flint_ext -d pci0:1:0:0 q
Image type: FS2
FW Version: 2.42.5000
FW Release Date: 5.9.2017
Product Version: 02.42.50.00
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: f45214030054a1e0 f45214030054a1e1 f45214030054a1e2 f45214030054a1e3
MACs: f4521454a1e1 f4521454a1e2
VSD:
PSID: MT_1090110018
Maybe someone can point me in the right dirrection...
First im a total Beginner. I did build a box, installed opnsense, working fine.
For a network card i chose a connectx3. It has 2 QSFP+ Ports. I wanted to connect to my Mikrotik switch via AOC Cable. I cant get it to link up.
DAC to a second Server with Connectx3 is working. SFP+ Coper and Fiber 10gbe is working. 1g copper is working. All cabels are connecting the second server with TrueNas and connectx3 without a problem.
I got no clue how to continue. I thing it must be opnsense.
root@Router:~ # ifconfig -vvm mlxen0
mlxen0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN (wan)
options=8c00a8<VLAN_MTU,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,LINKSTATE,HWSTATS>
capabilities=ed07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS>
ether f4:52:14:54:a1:e1
inet6 fe80::f652:14ff:fe54:a1e1%mlxen0 prefixlen 64 scopeid 0x5
media: Ethernet autoselect
status: no carrier
supported media:
media autoselect
media 40Gbase-CR4 mediaopt full-duplex
media 10Gbase-CX4 mediaopt full-duplex
media 10Gbase-SR mediaopt full-duplex
media 1000baseT mediaopt full-duplex
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
drivername: mlxen0
root@Router:~ # /usr/bin/mst status -v
PCI devices:
------------
DEVICE_TYPE MST PCI RDMA NET
NUMA
ConnectX3(rev:1) pci0:1:0:0 01:00.0
root@Router:~ # /usr/bin/flint_ext -d pci0:1:0:0 q
Image type: FS2
FW Version: 2.42.5000
FW Release Date: 5.9.2017
Product Version: 02.42.50.00
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: f45214030054a1e0 f45214030054a1e1 f45214030054a1e2 f45214030054a1e3
MACs: f4521454a1e1 f4521454a1e2
VSD:
PSID: MT_1090110018
Maybe someone can point me in the right dirrection...