OPNsense Forum
English Forums => 24.7 Production Series => Topic started by: newsense on October 13, 2024, 12:34:39 am
-
For those interested, Franco built a test kernel based on a sizable import of Intel related fixes that recently made it into FreeBSD. You can review the new commits on Github in opnsense/src section.
To install and verify you're on the new kernel:
# opnsense-update -zkr 24.7.6-intel
Fetching kernel-24.7.6-intel-amd64.txz: ..... done
!!!!!!!!!!!! ATTENTION !!!!!!!!!!!!!!!
! A critical upgrade is in progress. !
! Please do not turn off the system. !
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Installing kernel-24.7.6-intel-amd64.txz... done
Please reboot.
# opnsense-shell reboot
root@OPNsense:~ # uname -a
FreeBSD OPNsense.home.arpa 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 stable/24.7-n267903-51187ea746d SMP amd64
In case of issues you can always boot the old kernel from the boot menu. Snapshots are also available on ZFS - although in this case it may be a bit overkill.
I'm running on this kernel for over 24h without issues, 3 FWs with igc NICs and one APU with igb.
Any feedback welcome, and potential issues will have a chance to be fixed before these patches make it into 24.7.7+
-
No issues after applying this. Will run for a few days and report any issues.
-
similarly, works for several days without problems on this machine - https://bsd-hardware.info/?probe=d408973732 (https://bsd-hardware.info/?probe=d408973732)
-
Thanks for the early testing! Currently busy with the business release so I haven't been all over this yet.
Can you all also give reference to the Intel drivers you are using? I think this touches every driver so some reference might be good.
Cheers,
Franco
-
What specific Intel NIC issues are this kernel fix?
I upgraded to it so far; other than the WAN interface, which does not get a public IPv6 address (/128) anymore, so far, so good.
Using iXL driver with Intel x710..
-
Here is the abbreviated commit list off git:
6fbe7e4dd14 e1000: Re-add AIM
ca95baff951 netpfil tests: run in parallel
5c0dbb73dd5 iflib: Make iflib_stop() static
7751551389f if_vlan: handle VID conflicts
51187ea746d ixgbe: add reset count field to HW struct
1f9500080f6 ixgbe: increase VF reset timeout
f33b5451eaa ixgbe: add missing QV defines
767371038e7 ixgbe: fix PHY ID for X550
6cd77c97666 ixgbe: fix misleading indentation in ixgbe_phy
4e9b87df887 ixgbe: update ixgbe_phy with ix-3.3.38 changes
1a6466a912a ixgbe: improve Atom C3000 SWFW semaphore acq
33d5bb2e927 ixgbe: remove circular dependency in ixgbe_mbx.h
654abbb71f5 ixgbe: increase DCB BW calculation for MTU
81fe0f394a4 ixgbe: fix fw_recovery_mode callout
eeb0c0b11e6 ixgbe: remove unused function prototypes
3e83bfba1e9 ixgbe: Remove Atom C3000 HIC FW access
c087e7b2eef iflib: Correct indentation according to style(9)
ff29eb0cc4f iflib: Fix compiler warnings
43c6e9c9f1b iflib: Prefer C99's __func__ over GCC's __FUNCTION__
3e0e7b69522 iflib: Many style fixes
47574d67a50 ixgbe: prevent PBA read over eeprom word size
1c2f9ecb475 ixgbe: use primary and block terminology
6885c77664f ixgbe: improve function comments
64d62bb4433 ixgbe: replace implicit fall-through comments
1f5c31409b6 ixgbe: Switch if_sriov read/write back to ixgbe_mbx APIs
00e3c3efac4 ixgbe: update if_sriov with ix-3.3.38 changes
5e3a969e037 ixgbe: update if_sriov to use the new mailbox apis
7ab90af94b8 ixgbe: fix compilation for VF
8ae4b93f5c9 ixgbe: update ixgbe_mbx with ix-3.3.38 changes
aef03eaa67f ixgbe: introduce new mailbox API
be5e1c89e36 ixgbe: correct register names to match datasheet
792d5e06e80 ixgbe: rename VF message type macros
73405b8ffb0 ixv: fix x550 VF link speed reported
1b4494eb64a ixgbe: update if_ix and ixgbe api with ix-3.3.38 changes
b2a392c64f5 ixgbe: update if_bypass to ix-3.3.38
90a1709624f e1000: remove NEEDGIANT from a couple sysctls
f6ce5c29b9c e1000: drop NEEDGIANT from em_sysctl_debug_info use
7ea6e25ab12 e1000: drop NEEDGIANT on em_sysctl_reg_handler uses
0ae5fc2a34c e1000: fix link power down
72d2c5f8472 e1000: Update igb driver version to 2.5.28-fbsd
8e7ea373c8f igc: Add NVM/firmware prints and sysctl
7941470ba5c e1000: Clean up ITR/EITR in preparation for AIM
653e6f0ac29 e1000: Delay safe_pause switch until SI_SUB_CLOCKS
9457b504321 e1000: Add sysctl for igb(4) DMA Coalesce
1af69a3af35 e1000: Handle igb EEE sysctl
38de8de9e60 e1000: Add sysctls for some missing MAC stats
7ceca538aee iflib: Simplify iflib_legacy_setup
82ec23b1ccc e1000: Clean up legacy absolute and packet timers
3ce46d49d19 igc: Remove non-existent legacy absolute and packet timers
f36281617b9 netmap: Make the memory ops function pointer table const
719c7eb93b3 iflib: Use if_alloc_dev() to allocate the ifnet
246cf4bd41b if_enc(4): Make enc_add_hhooks() void
I've uploaded a second one with a couple more changes (the top ones in the list).
# opnsense-update -zkr 24.7.6-intel2
Cheers,
Franco
-
Franco,
Thanks for the list of fixes.. That is a lot..
-
All good here on 24.7.6-intel2 kernel, same firewalls as in the original post.
-
Beautiful!
New & Franco thx so much.
I will test this out today (on N100 DDR5 unit) once I have a free slot and report back.
Regards,
S.
-
Seems to work fine here, hardware is I211/igb https://bsd-hardware.info/?probe=85f998d2ab (https://bsd-hardware.info/?probe=85f998d2ab)
-
Here is the abbreviated commit list off git:
6fbe7e4dd14 e1000: Re-add AIM
ca95baff951 netpfil tests: run in parallel
5c0dbb73dd5 iflib: Make iflib_stop() static
7751551389f if_vlan: handle VID conflicts
51187ea746d ixgbe: add reset count field to HW struct
1f9500080f6 ixgbe: increase VF reset timeout
f33b5451eaa ixgbe: add missing QV defines
767371038e7 ixgbe: fix PHY ID for X550
6cd77c97666 ixgbe: fix misleading indentation in ixgbe_phy
4e9b87df887 ixgbe: update ixgbe_phy with ix-3.3.38 changes
1a6466a912a ixgbe: improve Atom C3000 SWFW semaphore acq
33d5bb2e927 ixgbe: remove circular dependency in ixgbe_mbx.h
654abbb71f5 ixgbe: increase DCB BW calculation for MTU
81fe0f394a4 ixgbe: fix fw_recovery_mode callout
eeb0c0b11e6 ixgbe: remove unused function prototypes
3e83bfba1e9 ixgbe: Remove Atom C3000 HIC FW access
c087e7b2eef iflib: Correct indentation according to style(9)
ff29eb0cc4f iflib: Fix compiler warnings
43c6e9c9f1b iflib: Prefer C99's __func__ over GCC's __FUNCTION__
3e0e7b69522 iflib: Many style fixes
47574d67a50 ixgbe: prevent PBA read over eeprom word size
1c2f9ecb475 ixgbe: use primary and block terminology
6885c77664f ixgbe: improve function comments
64d62bb4433 ixgbe: replace implicit fall-through comments
1f5c31409b6 ixgbe: Switch if_sriov read/write back to ixgbe_mbx APIs
00e3c3efac4 ixgbe: update if_sriov with ix-3.3.38 changes
5e3a969e037 ixgbe: update if_sriov to use the new mailbox apis
7ab90af94b8 ixgbe: fix compilation for VF
8ae4b93f5c9 ixgbe: update ixgbe_mbx with ix-3.3.38 changes
aef03eaa67f ixgbe: introduce new mailbox API
be5e1c89e36 ixgbe: correct register names to match datasheet
792d5e06e80 ixgbe: rename VF message type macros
73405b8ffb0 ixv: fix x550 VF link speed reported
1b4494eb64a ixgbe: update if_ix and ixgbe api with ix-3.3.38 changes
b2a392c64f5 ixgbe: update if_bypass to ix-3.3.38
90a1709624f e1000: remove NEEDGIANT from a couple sysctls
f6ce5c29b9c e1000: drop NEEDGIANT from em_sysctl_debug_info use
7ea6e25ab12 e1000: drop NEEDGIANT on em_sysctl_reg_handler uses
0ae5fc2a34c e1000: fix link power down
72d2c5f8472 e1000: Update igb driver version to 2.5.28-fbsd
8e7ea373c8f igc: Add NVM/firmware prints and sysctl
7941470ba5c e1000: Clean up ITR/EITR in preparation for AIM
653e6f0ac29 e1000: Delay safe_pause switch until SI_SUB_CLOCKS
9457b504321 e1000: Add sysctl for igb(4) DMA Coalesce
1af69a3af35 e1000: Handle igb EEE sysctl
38de8de9e60 e1000: Add sysctls for some missing MAC stats
7ceca538aee iflib: Simplify iflib_legacy_setup
82ec23b1ccc e1000: Clean up legacy absolute and packet timers
3ce46d49d19 igc: Remove non-existent legacy absolute and packet timers
f36281617b9 netmap: Make the memory ops function pointer table const
719c7eb93b3 iflib: Use if_alloc_dev() to allocate the ifnet
246cf4bd41b if_enc(4): Make enc_add_hhooks() void
I've uploaded a second one with a couple more changes (the top ones in the list).
# opnsense-update -zkr 24.7.6-intel2
As far as I can see most of the changes are related to ixgbe ( 10 Gigabit ) so I wonder what benefits they bring to other interfaces.
-
Went with the upgrade Kernel intel2,
Installation went without problems, device booted without problems.
All looks so far good on my Prod device:
N100 - i226-V | Crucial 16G 4800 DDR5 | S 980 500G
Regards,
S.
-
Thanks for testing so far. Looks quite ok for the moment, but for extra testing we will skip kernel updates in 24.7.7 this week so this batch will likely land in 243.7.8.
Cheers,
Franco
-
Thanks for testing so far. Looks quite ok for the moment, but for extra testing we will skip kernel updates in 24.7.7 this week so this batch will likely land in 243.7.8.
219 more years for the kernel update. =) I have time (j/k).
-
Hehe :)
-
Thanks for testing so far. Looks quite ok for the moment, but for extra testing we will skip kernel updates in 24.7.7 this week so this batch will likely land in 243.7.8.
Cheers,
Franco
Upgraded to 24.7.7, will I get into trouble to install the kernel patch on top of 24.7.7?
-
No trouble at all, 24.7.7 has no new kernel.
For those already on the 24.7.6-intel2 kernel there are two options:
a) Install 24.7.7 which will revert your kernel to 24.7.6
b) Temporary lock the kernel in the GUI until 24.7.8 is available, so you can upgrade to 24.7.7 without issues. Don't forget to unlock before upgrading to 24.7.8 though
-
New kernel
igc: Add AIM
igc is derived from igb and has never had an AIM implementation. The
same algorithm from e1000 is appropriate here.
Upon more detailed study of the Linux driver which has a newer AIM
implementation, it finally became clear to me this is actually a
holdoff timer and not an interrupt limit as it is conventionally
(statically) programmed and displayed as an interrupt rate. The data
sheets also make this somewhat clear.
Thus, AIM accomplishes two beneficial things for a wide variety of
workloads[1]:
1. At low throughput/packet rates, it will significantly lower latency
(by counter-intuitively "increasing" the interrupt rate.. better
thought of as decreasing the holdoff timer because you will modulate
down before coming anywhere near these interrupt rates).
2. At bulk data rates, it is tuned to achieve a lower interrupt rate
(by increasing the holdoff timer) than the current static 8000/s. This
decreases processing overhead and yields more headroom for other work
such as packet filters or userland.
For a single NIC this might be worth a few sys% on common CPUs, but may
be meaningful when multiplied such as if_lagg, if_bridge and forwarding
setups.
The AIM algorithm was re-introduced from the older igb or out of tree
driver, and then modernized with permission to use Intel code from other
drivers.
[1]: http://iommu.com/datasheets/ethernet/controllers-nics/intel/e1000/gbe-controllers-interrupt-moderation-appl-note.pdf
https://github.com/opnsense/src/commit/42bf31316a551230f13e247dba5cb11e8e1b06e8 (https://github.com/opnsense/src/commit/42bf31316a551230f13e247dba5cb11e8e1b06e8)
# opnsense-update -zkr 24.7.6-intel3
# opnsense-shell reboot
-
New kernel
igc: Add AIM
igc is derived from igb and has never had an AIM implementation. The
same algorithm from e1000 is appropriate here.
Upon more detailed study of the Linux driver which has a newer AIM
implementation, it finally became clear to me this is actually a
holdoff timer and not an interrupt limit as it is conventionally
(statically) programmed and displayed as an interrupt rate. The data
sheets also make this somewhat clear.
Thus, AIM accomplishes two beneficial things for a wide variety of
workloads[1]:
1. At low throughput/packet rates, it will significantly lower latency
(by counter-intuitively "increasing" the interrupt rate.. better
thought of as decreasing the holdoff timer because you will modulate
down before coming anywhere near these interrupt rates).
2. At bulk data rates, it is tuned to achieve a lower interrupt rate
(by increasing the holdoff timer) than the current static 8000/s. This
decreases processing overhead and yields more headroom for other work
such as packet filters or userland.
For a single NIC this might be worth a few sys% on common CPUs, but may
be meaningful when multiplied such as if_lagg, if_bridge and forwarding
setups.
The AIM algorithm was re-introduced from the older igb or out of tree
driver, and then modernized with permission to use Intel code from other
drivers.
[1]: http://iommu.com/datasheets/ethernet/controllers-nics/intel/e1000/gbe-controllers-interrupt-moderation-appl-note.pdf
https://github.com/opnsense/src/commit/42bf31316a551230f13e247dba5cb11e8e1b06e8 (https://github.com/opnsense/src/commit/42bf31316a551230f13e247dba5cb11e8e1b06e8)
# opnsense-update -zkr 24.7.6-intel3
# opnsense-shell reboot
Alright this looks juicy!
New were you able already see the benefits on the igc based NIC such as i225 i226?
Regards,
S.
-
Things are rather quiet for now on the two FW I got to reboot, a bit hard to tell since they're only up for ~90 minutes
-
Still thanks for the reply.
I am currently unable to install/reboot my unit. But once I can I will go for that kernel.
Personally my setup uses LAGGs so I am looking for this.
Regards,
S.
-
No trouble at all, 24.7.7 has no new kernel.
For those already on the 24.7.6-intel2 kernel there are two options:
a) Install 24.7.7 which will revert your kernel to 24.7.6
b) Temporary lock the kernel in the GUI until 24.7.8 is available, so you can upgrade to 24.7.7 without issues. Don't forget to unlock before upgrading to 24.7.8 though
Thanks! Applied intel3 patch on top of 24.7.7. so far so good.. Intel x710-DA2.
-
I seem to be having issues with the intel3 kernel with PPPoE and DHCPv6 on WAN. Very similar to the problem discussed a little while ago with dhcp6c. Reverting to the intel2 kernel and restarting seems to consistently fix the issue. To re-iterate, WAN receives an IPv6 address but not a prefix. It seems weird since I use an igb interface, and most of the changes regarding that were already present in intel2. Happy to provide more info if needed.
Edit: Clicking apply in the interface settings seems to work, it's just after boot up that it is not picked up. Will try to narrow it down more.
Edit 2: Seems like an ISP issue, just something to keep an eye on.
-
New kernel today
# opnsense-update -zkr 24.7.6-intel4
# opnsense-shell reboot
-
intel4 will probably be the state of the final 24.7.8 later this week. All testing is welcome.
Cheers,
Franco
-
Running Intel4 after running Intel3 for 1.5 weeks.
No issues so far!
-
Same here, no issues with intel3.
Intel4 running on 3/4 FWs already and all is fine.
-
As per special request the "intel5" kernel contains temporary test patches for e1000/igb:
https://reviews.freebsd.org/D47336
https://reviews.freebsd.org/D47337
# opnsense-update -zkr 24.7.6-intel5
Cheers,
Franco
-
intel5 running, no issues that I can see so far. Mellanox (igb)
-
# opnsense-update -zkr 24.7.6-intel5
installed intel5 running with Intel x710 ixl driver.
-
Opnsense 24.7.8
o src: assorted FreeBSD stable patches for Intel ixgbe, igb, igc and e1000 drivers
is this the latest version of the kernel ?
-
It's equivalent to intel4 test.
Cheers,
Franco
-
I locked intel5 prior to upgrading so I wouldn't lose the kernel
-
Intel6 kernel available, this time with ice driver updates.
# opnsense-update -zkr 24.7.8-intel6
-
Apologies to invade this thread: Once on 24.7.8, is there a way to revert to the previous intel drivers for testing purposes? Since .8 I've been having CARP issues (interfaces going up and down randomly: https://forum.opnsense.org/index.php?topic=43934.0 (https://forum.opnsense.org/index.php?topic=43934.0)) and I'd like to narrow down the cause of the issue. This is a Protectli FW4B with Intel i211. Thanks!
-
Normal kernels are selected without -z and their respective OPNsense release version so in this case 24.7.6:
# opnsense-update -kr 24.7.6
Cheers,
Franco
-
Thank you -- worked like a charm. Now that I know how to revert, I may as well also try the intel6 kernel for good measure. Thanks!
-
Ok, if it's part of the kernel changes in 24.7.8 I'm afraid we will have to look into it more closely as these are queued up for FreeBSD 14.2 as well.
Cheers,
Franco
-
If using the ice driver this kernel has RSS fixes for you.
opnsense-update -zkr 24.7.8-ice
-
We haven't tested the RSS bit yet. Only do this if you have time to kill. ;)
Cheers,
Franco
-
We haven't tested the RSS bit yet. Only do this if you have time to kill. ;)
Sure, but I am using the x710 card, not sure if I am helping at all..
-
Yes, you can safely skip this one.
Cheers,
Franco
-
Ok, if it's part of the kernel changes in 24.7.8 I'm afraid we will have to look into it more closely as these are queued up for FreeBSD 14.2 as well.
So I tried intel6 on both my primary and backup box, and I am seeing the following errors periodically in my DHCP logs:
2024-11-15T08:19:46-05:00 Informational dhcpd Server starting service.
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_lan: I move from communications-interrupted to startup
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_opt1: I move from communications-interrupted to startup
2024-11-15T08:19:46-05:00 Informational dhcpd Sending on Socket/fallback/fallback-net
2024-11-15T08:19:46-05:00 Informational dhcpd Sending on BPF/igb1/00:e0:67:2f:04:39/192.168.5.0/24
2024-11-15T08:19:46-05:00 Informational dhcpd Sending updates to dhcp_lan.
2024-11-15T08:19:46-05:00 Informational dhcpd balanced pool 29121b317180 192.168.5.0/24 total 154 free 74 backup 74 lts 0 max-misbal 22
2024-11-15T08:19:46-05:00 Informational dhcpd balancing pool 29121b317180 192.168.5.0/24 total 154 free 79 backup 69 lts 5 max-own (+/-)15
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_lan: Both servers normal
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_lan: I move from communications-interrupted to normal
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_lan: peer moves from normal to normal
2024-11-15T08:19:46-05:00 Informational dhcpd balanced pool 29121b317240 192.168.9.0/24 total 105 free 52 backup 48 lts 2 max-misbal 15
2024-11-15T08:19:46-05:00 Informational dhcpd balancing pool 29121b317240 192.168.9.0/24 total 105 free 52 backup 48 lts 2 max-own (+/-)10
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_opt1: Both servers normal
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_opt1: I move from communications-interrupted to normal
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_opt1: peer moves from normal to normal
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_lan: I move from startup to communications-interrupted
2024-11-15T08:19:46-05:00 Informational dhcpd failover peer dhcp_opt1: I move from startup to communications-interrupted
2024-11-15T08:19:46-05:00 Informational dhcpd Listening on BPF/igb1/00:e0:67:2f:04:39/192.168.5.0/24
2024-11-15T08:19:46-05:00 Informational dhcpd Sending on BPF/igb2/00:e0:67:2f:04:3a/192.168.9.0/24
2024-11-15T08:19:46-05:00 Informational dhcpd Listening on BPF/igb2/00:e0:67:2f:04:3a/192.168.9.0/24
2024-11-15T08:19:46-05:00 Informational dhcpd Wrote 205 leases to leases file.
2024-11-15T08:19:46-05:00 Informational dhcpd Wrote 0 new dynamic host decls to leases file.
2024-11-15T08:19:46-05:00 Informational dhcpd Wrote 0 deleted host decls to leases file.
2024-11-15T08:19:46-05:00 Informational dhcpd Wrote 0 class decls to leases file.
2024-11-15T08:19:46-05:00 Informational dhcpd For info, please visit https://www.isc.org/software/dhcp/
2024-11-15T08:19:46-05:00 Informational dhcpd All rights reserved.
2024-11-15T08:19:46-05:00 Informational dhcpd Copyright 2004-2022 Internet Systems Consortium.
2024-11-15T08:19:46-05:00 Informational dhcpd Internet Systems Consortium DHCP Server 4.4.3-P1
2024-11-15T08:19:46-05:00 Informational dhcpd PID file: /var/run/dhcpd.pid
2024-11-15T08:19:46-05:00 Informational dhcpd Database file: /var/db/dhcpd.leases
2024-11-15T08:19:46-05:00 Informational dhcpd Config file: /etc/dhcpd.conf
2024-11-15T08:19:46-05:00 Informational dhcpd For info, please visit https://www.isc.org/software/dhcp/
2024-11-15T08:19:46-05:00 Informational dhcpd All rights reserved.
2024-11-15T08:19:46-05:00 Informational dhcpd Copyright 2004-2022 Internet Systems Consortium.
2024-11-15T08:19:46-05:00 Informational dhcpd Internet Systems Consortium DHCP Server 4.4.3-P1
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_opt1: I move from normal to communications-interrupted
2024-11-15T08:19:45-05:00 Informational dhcpd peer dhcp_opt1: disconnected
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_lan: I move from normal to communications-interrupted
2024-11-15T08:19:45-05:00 Informational dhcpd peer dhcp_lan: disconnected
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_opt1: Both servers normal
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_opt1: peer moves from communications-interrupted to normal
2024-11-15T08:19:45-05:00 Informational dhcpd balanced pool 3fa62b117240 192.168.9.0/24 total 105 free 52 backup 48 lts 2 max-misbal 15
2024-11-15T08:19:45-05:00 Informational dhcpd balancing pool 3fa62b117240 192.168.9.0/24 total 105 free 52 backup 48 lts 2 max-own (+/-)10
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_opt1: I move from communications-interrupted to normal
2024-11-15T08:19:45-05:00 Informational dhcpd failover peer dhcp_opt1: peer moves from normal to communications-interrupted
2024-11-15T08:19:40-05:00 Informational dhcpd failover peer dhcp_opt1: I move from normal to communications-interrupted
2024-11-15T08:19:40-05:00 Informational dhcpd peer dhcp_opt1: disconnected
2024-11-15T08:19:40-05:00 Error dhcpd timeout waiting for failover peer dhcp_opt1
Around the same time, I am seeing this in the general log:
2024-11-15T08:20:33-05:00 Notice opnsense /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "Virtual Guest IP (192.168.9.1) (4@igb2)" has resumed the state "MASTER" for vhid 4
2024-11-15T08:19:48-05:00 Notice kernel <6>carp: 4@igb2: BACKUP -> MASTER (preempting a slower master)
2024-11-15T08:19:45-05:00 Notice kernel <6>carp: demoted by -240 to 0 (pfsync bulk done)
2024-11-15T08:19:45-05:00 Notice kernel <6>carp: demoted by 240 to 240 (pfsync bulk start)
2024-11-15T08:19:45-05:00 Notice kernel <6>carp: 4@igb2: INIT -> BACKUP (initialization complete)
2024-11-15T08:19:45-05:00 Notice kernel <6>carp: 4@igb2: MASTER -> INIT (hardware interface up)
2024-11-15T08:19:44-05:00 Notice kernel <6>carp: 4@igb2: BACKUP -> MASTER (master timed out)
2024-11-15T08:19:42-05:00 Notice opnsense /usr/local/etc/rc.syshook.d/carp/20-openvpn: Carp cluster member "Virtual Guest IP (192.168.9.1) (4@igb2)" has resumed the state "BACKUP" for vhid 4
2024-11-15T08:19:40-05:00 Notice kernel <6>carp: demoted by -240 to 0 (interface up)
2024-11-15T08:19:40-05:00 Notice kernel <6>carp: 4@igb2: INIT -> BACKUP (initialization complete)
I then reverted the kernel of my backup box to the 24.7.6 one, and I have so far not seen these issues for the past hour three days anymore. My primary is still on intel6. Can't say 100% that the above issues are related to the new drivers, I'm merely reporting what I see.
P.S.: Both boxes are identical twins (Protectli FW4B) running coreboot. Hardware details below (hw-probe):
HOST:
arch:amd64
boot_mode:EFI
cores:4
dual_boot:0
dual_boot_win:0
filesystem:zfs
freebsd_release:14.1
freebsd_version:14.1-RELEASE-p6
kernel:14.1-RELEASE-p5
lang:C.UTF-8
microarch:Silvermont
model:FW4B
nics:4
part_scheme:GPT
probe_ver:1.6
ram_total:4194304
ram_used:274432
sockets:1
space_total:21
space_used:2
system:opnsense-24.7.8
system_version:24.7.8
threads:1
type:desktop
vendor:Protectli
year:2022
DEVICES:
pci:8086-1539;02-00-00;works;network;igb;Intel Corporation;I211 Gigabit Network Connection
pci:8086-1539;02-00-00;works;network;igb;Intel Corporation;I211 Gigabit Network Connection
pci:8086-1539;02-00-00;works;network;igb;Intel Corporation;I211 Gigabit Network Connection
pci:8086-1539;02-00-00;works;network;igb;Intel Corporation;I211 Gigabit Network Connection
pci:8086-2280-8086-7270;06-00-00;detected;bridge;hostb;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series SoC Transaction Register
pci:8086-2284-8086-7270;04-03-00;detected;sound;hdac;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series High Definition Audio Controller
pci:8086-2292-8086-7270;0c-05-00;detected;smbus;ichsmb;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx SMBus Controller
pci:8086-229c-8086-7270;06-01-00;detected;bridge;isab;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series PCU
pci:8086-22a3-8086-7270;01-06-01;works;storage;ahci;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series SATA Controller
pci:8086-22b1-8086-7270;03-00-00;detected;graphics card;vgapci;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Integrated Graphics Controller
pci:8086-22b5-8086-7270;0c-03-30;detected;usb controller;xhci;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series USB xHCI Controller
pci:8086-22c8-8086-7270;06-04-00;detected;bridge;pcib;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series PCI Express Port
pci:8086-22ca-8086-7270;06-04-00;detected;bridge;pcib;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series PCI Express Port
pci:8086-22cc-8086-7270;06-04-00;detected;bridge;pcib;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series PCI Express Port
pci:8086-22ce-8086-7270;06-04-00;works;bridge;pcib;Intel Corporation;Atom/Celeron/Pentium Processor x5-E8000/J3xxx/N3xxx Series PCI Express Port
usb:1d6b-0003;09-00-00;detected;hub;uhub;BSD;XHCI root HUB
0;;detected;;;;
bios:coreboot-v4-12-0-8-10-25-2022;;works;bios;;coreboot;BIOS v4.12.0.8 10/25/2022
board:protectli-fw4b-1-0;;works;motherboard;;Protectli;Motherboard FW4B 1.0
cpu:intel-6-76-4-celeron-j3160;;works;cpu;;Intel;Celeron CPU J3160 @ 1.60GHz
cpu:intel-6-76-4-celeron-j3160;;works;cpu;;Intel;Celeron CPU J3160 @ 1.60GHz
cpu:intel-6-76-4-celeron-j3160;;works;cpu;;Intel;Celeron CPU J3160 @ 1.60GHz
cpu:intel-6-76-4-celeron-j3160;;works;cpu;;Intel;Celeron CPU J3160 @ 1.60GHz
ide:transcend-ts32gmts400-serial-1d60f49bfd09be47dc06ee30ef0346ff;;works;disk;ada, ahcich;Transcend;TS32GMTS400 32GB
mem:ram-module-4gb-1600-serial-aaec96992031920b10ead184d63872b5;;works;memory;;;RAM Module 4GB 1600MT/s