Infiniband as Network interface?

[studiofunk]

Hi there,

we have a few Mellanox Infiniband interfaces (MCX354A-FCBT) and would love to get the 40G speed into our OPNsense system.
Anything possible?

I just found that the mlx4en driver is available. not the mlx4ib.

Could I get this to work somehow?

Best regards,
Thomas

[mimugmail]

I compiled it years ago for pfSense 2.1 but didn't touched it yet again.
Infiniband and FreeBSD isn't really funny, you should stick to en where possible.

[studiofunk]

Thank you very much!

Too bad 

[studiofunk]

With the sources package from FreeBSD 11.2 it's not a problem...

fetch ftp://ftp.freebsd.org/pub/FreeBSD/releases/amd64/11.2-RELEASE/src.txz
tar -C / -xvzf src.txz

echo '#!/bin/sh -e' > ofed_install.sh
echo -en '\n' >> ofed_install.sh
echo 'cd /usr/src/sys/modules' >> ofed_install.sh
echo 'for module in mlx4 ibcore mlx4ib ipoib; do ' >> ofed_install.sh
echo '    cd $module' >> ofed_install.sh
echo '    make' >> ofed_install.sh
echo '    make install' >> ofed_install.sh
echo '    sync' >> ofed_install.sh
echo '    kldload $module || true' >> ofed_install.sh
echo '    printf "${module}_load=\"YES\"\n" >> /boot/loader.conf.local' >> ofed_install.sh
echo '    cd ..' >> ofed_install.sh
echo 'done' >> ofed_install.sh
echo 'kldstat' >> ofed_install.sh

ibv_devinfo

sysctl sys.device.mlx4_core0.mlx4_port1=ib
sysctl sys.device.mlx4_core0.mlx4_port2=ib