APU4C4 interface flapping

Started by s.vanrossem, August 11, 2024, 09:31:04 PM

Previous topic - Next topic
Hi guys,

I'm experiencing interface flapping since FreeBSD 13.0, I think OPNsense 22.1, so this isn't really related to the latest upgrade. I've found a custom way to avoid these issues but didn't find the time to post a topic about it.

Since FreeBSD 13.0, the `igb` driver was merged into the iflib framework, see https://man.freebsd.org/cgi/man.cgi?query=igb&apropos=0&sektion=0&manpath=FreeBSD+13.0-RELEASE&arch=default&format=html and https://reviews.freebsd.org/D8299
I'm using a PC engines APU4C4 (see https://www.pcengines.ch/apu4c4.htm which is shipped with a I211-AT Intel Network Adapter.

When I'm running default (no tunables), the interfaces start flapping, very annoying...

dmesg is flooded with interface up-down error messages

igb1: link state changed to DOWN
igb1_vlanX: link state changed to DOWN
igb1: link state changed to UP
igb1_vlanX: link state changed to UP
igb1: link state changed to DOWN
igb1_vlanX: link state changed to DOWN
igb1: link state changed to UP
igb1_vlanX: link state changed to UP



dev.igb.3.iflib.driver_version: 2.5.19-fbsd
dev.igb.2.iflib.driver_version: 2.5.19-fbsd
dev.igb.1.iflib.driver_version: 2.5.19-fbsd
dev.igb.0.iflib.driver_version: 2.5.19-fbsd



$ dmidecode -s bios-version
v4.19.0.1


The problem solved when using Intel's official `igb` driver...

I've been running a few APUs for years using that NIC with the official FreeBSD drivers in OPNsense and never had an issue.

That flapping could be caused by the upstream device connected to the APU, the port negotiation might occasionally fail, in which case you can force the OPNsense interfaces to run at 1Gbps full duplex

Quote from: newsense on August 11, 2024, 10:55:06 PM
I've been running a few APUs for years using that NIC with the official FreeBSD drivers in OPNsense and never had an issue.

That flapping could be caused by the upstream device connected to the APU, the port negotiation might occasionally fail, in which case you can force the OPNsense interfaces to run at 1Gbps full duplex

I didn't have issues before. I'll try forcing that setting on upstream.