OPNsense Forum

English Forums => 24.7, 24.10 Legacy Series => Topic started by: s.vanrossem on August 11, 2024, 09:31:04 PM

Title: APU4C4 interface flapping
Post by: s.vanrossem on August 11, 2024, 09:31:04 PM
Hi guys,

I'm experiencing interface flapping since FreeBSD 13.0, I think OPNsense 22.1, so this isn't really related to the latest upgrade. I've found a custom way to avoid these issues but didn't find the time to post a topic about it.

Since FreeBSD 13.0, the `igb` driver was merged into the iflib framework, see https://man.freebsd.org/cgi/man.cgi?query=igb&apropos=0&sektion=0&manpath=FreeBSD+13.0-RELEASE&arch=default&format=html (https://man.freebsd.org/cgi/man.cgi?query=igb&apropos=0&sektion=0&manpath=FreeBSD+13.0-RELEASE&arch=default&format=html) and https://reviews.freebsd.org/D8299 (https://reviews.freebsd.org/D8299)
I'm using a PC engines APU4C4 (see https://www.pcengines.ch/apu4c4.htm (https://www.pcengines.ch/apu4c4.htm) which is shipped with a I211-AT Intel Network Adapter.

When I'm running default (no tunables), the interfaces start flapping, very annoying...

dmesg is flooded with interface up-down error messages

igb1: link state changed to DOWN
igb1_vlanX: link state changed to DOWN
igb1: link state changed to UP
igb1_vlanX: link state changed to UP
igb1: link state changed to DOWN
igb1_vlanX: link state changed to DOWN
igb1: link state changed to UP
igb1_vlanX: link state changed to UP



dev.igb.3.iflib.driver_version: 2.5.19-fbsd
dev.igb.2.iflib.driver_version: 2.5.19-fbsd
dev.igb.1.iflib.driver_version: 2.5.19-fbsd
dev.igb.0.iflib.driver_version: 2.5.19-fbsd



$ dmidecode -s bios-version
v4.19.0.1


The problem solved when using Intel's official `igb` driver...
Title: Re: APU4C4 interface flapping
Post by: newsense on August 11, 2024, 10:55:06 PM
I've been running a few APUs for years using that NIC with the official FreeBSD drivers in OPNsense and never had an issue.

That flapping could be caused by the upstream device connected to the APU, the port negotiation might occasionally fail, in which case you can force the OPNsense interfaces to run at 1Gbps full duplex
Title: Re: APU4C4 interface flapping
Post by: s.vanrossem on August 12, 2024, 07:05:33 AM
Quote from: newsense on August 11, 2024, 10:55:06 PM
I've been running a few APUs for years using that NIC with the official FreeBSD drivers in OPNsense and never had an issue.

That flapping could be caused by the upstream device connected to the APU, the port negotiation might occasionally fail, in which case you can force the OPNsense interfaces to run at 1Gbps full duplex

I didn't have issues before. I'll try forcing that setting on upstream.