OPNsense Forum

English Forums => Hardware and Performance => Topic started by: studiofunk on March 21, 2019, 01:03:18 pm

Title: Infiniband as Network interface?
Post by: studiofunk on March 21, 2019, 01:03:18 pm
Hi there,

we have a few Mellanox Infiniband interfaces (MCX354A-FCBT) and would love to get the 40G speed into our OPNsense system.
Anything possible?

I just found that the mlx4en driver is available. not the mlx4ib.

Could I get this to work somehow?

Best regards,
Thomas
Title: Re: Infiniband as Network interface?
Post by: mimugmail on March 21, 2019, 02:36:24 pm
I compiled it years ago for pfSense 2.1 but didn't touched it yet again.
Infiniband and FreeBSD isn't really funny, you should stick to en where possible.
Title: Re: Infiniband as Network interface?
Post by: studiofunk on March 25, 2019, 10:43:22 am
Thank you very much!

Too bad  :-\
Title: Re: Infiniband as Network interface?
Post by: studiofunk on March 26, 2019, 03:59:06 pm
With the sources package from FreeBSD 11.2 it's not a problem...

fetch ftp://ftp.freebsd.org/pub/FreeBSD/releases/amd64/11.2-RELEASE/src.txz
tar -C / -xvzf src.txz

echo '#!/bin/sh -e' > ofed_install.sh
echo -en '\n' >> ofed_install.sh
echo 'cd /usr/src/sys/modules' >> ofed_install.sh
echo 'for module in mlx4 ibcore mlx4ib ipoib; do ' >> ofed_install.sh
echo '    cd $module' >> ofed_install.sh
echo '    make' >> ofed_install.sh
echo '    make install' >> ofed_install.sh
echo '    sync' >> ofed_install.sh
echo '    kldload $module || true' >> ofed_install.sh
echo '    printf "${module}_load=\"YES\"\n" >> /boot/loader.conf.local' >> ofed_install.sh
echo '    cd ..' >> ofed_install.sh
echo 'done' >> ofed_install.sh
echo 'kldstat' >> ofed_install.sh

ibv_devinfo

sysctl sys.device.mlx4_core0.mlx4_port1=ib
sysctl sys.device.mlx4_core0.mlx4_port2=ib