26.7.1_1 -> 26.7.2 Boot loop

[axsdenied]

Apologies in advanced as this post won't have a lot of useful info yet. Unfortunately, I don't have time this morning to figure out what happened but when upgrading to 26.7.2 I ended up in a boot loop.  I changed my BE back to 26.7.1_1 and was back up.

I have time later today to see what was going on and provide logs, but I wanted to post in case someone else was running into the same thing and might have more to share.

Quick addition, I do not have cpu microcode installed.

[adamklein]

same as here. kernel panic..

[franco]

Something really fishing going on here.

https://www.reddit.com/r/opnsense/comments/1vmeevo/comment/p395i6t/

Looking into it.

[nicospavlou]

Hello,

Same issue here!

Had to connect a screen and select option 6, to boot in old kernel.

If I can do something to troubleshoot just tell me.

Cheers,
Nicos

[meyergru]

Could that also have to do something with the old, buggy bootloader that triggered the os-microcode bug in the first place?

I updated all bootloaders beforehand and saw no problems on any system I upgraded.

[franco]

No it gets too far and chokes on an ifconfig call into the kernel to an interface that doesn't have counters allocated (or already freed).


Cheers,
Franco

[Labfox]

Hello,

I've got the same issue, on a practically blank OPNSense install. Same problem as everyone, the old kernel worked.

I've attached the crash dumps. I am using ZFS, and realtek-re-kmod. This may not be related, but the machine's CPU started overheating while in the boot loop, which never happenned before with this setup.

[Shoog]

Can confirm this behaviour on my system. Infinite bootloop.
At the first opnsense console if I select option 6. kernel and use the retained kernel.old everything works.
So it seems to be  dodgy kernel upgrade. This is an unusustainable solution since if opnsense does a reboot for any reason it goes back to a bootloop.

Hope this can be resolved quickly. 

UPDATE: applying

opnsense-update -zkr 26.7.2_4

fixed it  for now.

[lmoore]

No it gets too far and chokes on an ifconfig call into the kernel to an interface that doesn't have counters allocated (or already freed).


Cheers,
Franco

I thought it might be to do with my igb0-3 NIC's. I've pulled them out and the infinite boot loop continues.

Here is some information from my crash. It sat at "igb3: link state changed to UP" for a good while before the panic.

Just got to work out how to get the prompt to appear and boot from previous kernel.

Code Select Expand

swapon: adding /dev/ada0p3 as swap device
.ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/ipsec /usr/local/lib/perl5/5.42/mach/CORE
32-bit compatibility ldconfig path:
done.
>>> Invoking early script 'upgrade'
>>> Invoking early script 'configd'
Starting configd.
>>> Invoking early script 'templates'
Generating configuration: templates...done
>>> Invoking early script 'carp'
CARP event system: OK
Launching the init system...done.
Initializing..........done.
igb0: link state changed to UP
igb1: link state changed to UP
igb2: link state changed to UP
igb3: link state changed to UP
spin lock 0xfffff80003038d80 ((null)) held by 0xfffff80102a3b780 (tid 100422) too long
panic: spin lock held too long
cpuid = 7
time = 1786552438
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d317f770
vpanic() at vpanic+0x136/frame 0xfffffe00d317f8a0
panic() at panic+0x43/frame 0xfffffe00d317f900
_mtx_lock_indefinite_check() at _mtx_lock_indefinite_check+0x64/frame 0xfffffe00d317f910
thread_lock_flags_() at thread_lock_flags_+0xdb/frame 0xfffffe00d317f970
propagate_priority() at propagate_priority+0x58/frame 0xfffffe00d317f9b0
turnstile_wait() at turnstile_wait+0x2d2/frame 0xfffffe00d317fa00
__mtx_lock_sleep() at __mtx_lock_sleep+0x175/frame 0xfffffe00d317fa90
re_init() at re_init+0x27/frame 0xfffffe00d317fab0
dump_iface() at dump_iface+0x11a/frame 0xfffffe00d317fb50
dump_cb() at dump_cb+0x1c/frame 0xfffffe00d317fb70
if_foreach_sleep() at if_foreach_sleep+0x227/frame 0xfffffe00d317fbf0
rtnl_handle_getlink() at rtnl_handle_getlink+0x257/frame 0xfffffe00d317fcd0
rtnl_handle_message() at rtnl_handle_message+0x195/frame 0xfffffe00d317fd30
nl_taskqueue_handler() at nl_taskqueue_handler+0x469/frame 0xfffffe00d317fe40
taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe00d317fec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00d317fef0
fork_exit() at fork_exit+0x7b/frame 0xfffffe00d317ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d317ff30
--- trap 0, rip = 0xd8e26f56, rsp = 0, rbp = 0x200200000000 ---
KDB: enter: panic
[ thread pid 0 tid 100424 ]
Stopped at      kdb_enter+0x33: movq    $0,0x15a8af2(%rip)
db:0:kdb.enter.default> textdump set
textdump set
db:0:kdb.enter.default>  capture on
db:0:kdb.enter.default>  run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo>  show alllocks
No such command; use "help" to list available commands
db:1:lockinfo>  show lockedvnods
Locked vnodes
db:0:kdb.enter.default>  show pcpu
cpuid        = 7
dynamic pcpu = 0xfffffe0098816a00
curthread    = 0xfffff80009e83780: pid 0 tid 100424 critnest 1 "netlink_socket (PID"
curpcb       = 0xfffff80009e83cd0
fpcurthread  = none
idlethread   = 0xfffff80102a00000: tid 100010 "idle: cpu7"
self         = 0xffffffff83617000
curpmap      = 0xffffffff81d97550
tssp         = 0xffffffff83617384
rsp0         = 0xfffffe00d3180000
kcr3         = 0x80000000b3265001
ucr3         = 0xffffffffffffffff
scr3         = 0x4edc48a5
gs32p        = 0xffffffff83617404
ldt          = 0xffffffff83617444
tss          = 0xffffffff83617434
curvnet      = 0xfffff80001224740
db:0:kdb.enter.default>  bt
Tracing pid 0 tid 100424 td 0xfffff80009e83780
kdb_enter() at kdb_enter+0x33/frame 0xfffffe00d317f8a0
panic() at panic+0x43/frame 0xfffffe00d317f900
_mtx_lock_indefinite_check() at _mtx_lock_indefinite_check+0x64/frame 0xfffffe00d317f910
thread_lock_flags_() at thread_lock_flags_+0xdb/frame 0xfffffe00d317f970
propagate_priority() at propagate_priority+0x58/frame 0xfffffe00d317f9b0
turnstile_wait() at turnstile_wait+0x2d2/frame 0xfffffe00d317fa00
__mtx_lock_sleep() at __mtx_lock_sleep+0x175/frame 0xfffffe00d317fa90
re_init() at re_init+0x27/frame 0xfffffe00d317fab0
dump_iface() at dump_iface+0x11a/frame 0xfffffe00d317fb50
dump_cb() at dump_cb+0x1c/frame 0xfffffe00d317fb70
if_foreach_sleep() at if_foreach_sleep+0x227/frame 0xfffffe00d317fbf0
rtnl_handle_getlink() at rtnl_handle_getlink+0x257/frame 0xfffffe00d317fcd0
rtnl_handle_message() at rtnl_handle_message+0x195/frame 0xfffffe00d317fd30
nl_taskqueue_handler() at nl_taskqueue_handler+0x469/frame 0xfffffe00d317fe40
taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe00d317fec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00d317fef0
fork_exit() at fork_exit+0x7b/frame 0xfffffe00d317ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d317ff30
--- trap 0, rip = 0xd8e26f56, rsp = 0, rbp = 0x200200000000 ---
db:0:kdb.enter.default>  ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  872   871   848     0  S       sbwait  0xfffff8001b73560c  ifconfig
  871   850   848     0  S       piperd  0xfffffe010d96be60  php
  870   869   848     0  S       sbwait  0xfffff8000bfdd60c  ifconfig
  869   850   848     0  S       piperd  0xfffffe010ee8be60  php
  863   862    21     0  S+      select  0xfffff8004e6bf040  php
  862   861    21     0  S+      piperd  0xfffffe010f336420  php
  861   860    21     0  S+      piperd  0xfffffe010ee8b2e0  php
  860    21    21     0  S+      wait    0xfffffe00c09f1000  flock
  850   848   848     0  S       (threaded)                  python3.13
100403                   S       accept  0xfffff8001b5c1610  python3.13
100420                   S       wait    0xfffffe00c09e7020  python3.13
100423                   S       wait    0xfffffe00c09e7020  python3.13
  848     1   848     0  Ss      wait    0xfffffe00c09edac0  python3.13
   35     0     0     0  DL      aiordy  0xfffffe00c09fcac0  [aiod4]
   34     0     0     0  DL      aiordy  0xfffffe00c09f0060  [aiod3]
   33     0     0     0  DL      aiordy  0xfffffe00c09f9ae0  [aiod2]
   32     0     0     0  DL      aiordy  0xfffffe00c09f05c0  [aiod1]
   21     1    21     0  Ss+     wait    0xfffffe00c09ee020  sh
   20     0     0     0  DL      idle    0xfffffe00c09e8040  [enc_daemon0]
   19     0     0     0  DL      syncer  0xffffffff8221f978  [syncer]
   18     0     0     0  DL      vlruwt  0xfffffe00c0805ae0  [vnlru]
   17     0     0     0  DL      (threaded)                  [bufdaemon]
100202                   D       psleep  0xffffffff8221e988  [bufdaemon]
100203                   D       -       0xffffffff81a01e80  [bufspacedaemon-0]
100204                   D       -       0xffffffff81a02100  [bufspacedaemon-1]
100205                   D       -       0xffffffff81a02380  [bufspacedaemon-2]
100206                   D       -       0xffffffff81a02600  [bufspacedaemon-3]
100207                   D       -       0xffffffff81a02880  [bufspacedaemon-4]
100208                   D       -       0xffffffff81a02b00  [bufspacedaemon-5]
100209                   D       -       0xffffffff81a02d80  [bufspacedaemon-6]
   16     0     0     0  DL      psleep  0xffffffff822558b0  [vmdaemon]
    9     0     0     0  DL      (threaded)                  [pagedaemon]
100200                   D       psleep  0xffffffff8223bf48  [dom0]
100210                   D       launds  0xffffffff8223bf54  [laundry: dom0]
100211                   D       umarcl  0xffffffff80fb9710  [uma]
    8     0     0     0  DL      -       0xffffffff81bdc048  [rand_harvestq]
   15     0     0     0  DL      tzpoll  0xffffffff81bd2498  [acpi_thermal]
    7     0     0     0  DL      pftm    0xffffffff827c9980  [pf purge]
    6     0     0     0  DL      (threaded)                  [zfskern]
100165                   D       t->zthr 0xfffff80003642048  [arc_evict]
100166                   D       t->zthr 0xfffff80003643d48  [arc_reap]
100167                   D       -       0xfffff80003643b00  [dbu_evict]
100168                   D       dbuf_ev 0xffffffff82bf1d80  [dbuf_evict_thread]
100169                   D       -       0xfffff80003643800  [z_vdev_file_0]
100170                   D       -       0xfffff80003643800  [z_vdev_file_1]
100171                   D       -       0xfffff80003643800  [z_vdev_file_2]
100172                   D       -       0xfffff80003643800  [z_vdev_file_3]
100173                   D       -       0xfffff80003643800  [z_vdev_file_4]
100174                   D       -       0xfffff80003643800  [z_vdev_file_5]
100175                   D       -       0xfffff80003643800  [z_vdev_file_6]
100176                   D       -       0xfffff80003643800  [z_vdev_file_7]
100177                   D       -       0xfffff80003643800  [z_vdev_file_8]
100178                   D       -       0xfffff80003643800  [z_vdev_file_9]
100179                   D       -       0xfffff80003643800  [z_vdev_file_10]
100180                   D       -       0xfffff80003643800  [z_vdev_file_11]
100181                   D       -       0xfffff80003643800  [z_vdev_file_12]
100182                   D       -       0xfffff80003643800  [z_vdev_file_13]
100183                   D       -       0xfffff80003643800  [z_vdev_file_14]
100184                   D       -       0xfffff80003643800  [z_vdev_file_15]
100185                   D       l2arc_f 0xffffffff82bf1078  [l2arc_feed_thread]
100186                   D       -       0xfffff80003644500  [zfsvfs]
100187                   S       zevent_ 0xffffffff82bf2380  [sysevent]
100285                   D       -       0xfffff80003545900  [z_zvol]
100286                   D       -       0xfffff80003545700  [z_metaslab_0]
100287                   D       -       0xfffff80003545700  [z_metaslab_1]
100288                   D       -       0xfffff80003545700  [z_metaslab_2]
100289                   D       -       0xfffff80003545700  [z_metaslab_3]
100290                   D       -       0xfffff80003545200  [z_prefetch_0]
100291                   D       -       0xfffff80003545200  [z_prefetch_1]
100292                   D       -       0xfffff80003545200  [z_prefetch_2]
100293                   D       -       0xfffff80003545200  [z_prefetch_3]
100294                   D       -       0xfffff80003545200  [z_prefetch_4]
100295                   D       -       0xfffff80003545200  [z_prefetch_5]
100296                   D       -       0xfffff80003545200  [z_prefetch_6]
100297                   D       -       0xfffff80003545200  [z_prefetch_7]
100298                   D       -       0xfffff800037d4800  [z_upgrade_0]
100299                   D       -       0xfffff800037d4800  [z_upgrade_1]
100300                   D       -       0xfffff800037d4800  [z_upgrade_2]
100301                   D       -       0xfffff800037d4800  [z_upgrade_3]
100302                   D       -       0xfffff800037d4800  [z_upgrade_4]
100303                   D       -       0xfffff800037d4800  [z_upgrade_5]
100304                   D       -       0xfffff800037d4800  [z_upgrade_6]
100305                   D       -       0xfffff800037d4800  [z_upgrade_7]
100308                   D       -       0xfffff80001466800  [dp_sync_taskq_0]
100309                   D       -       0xfffff80001466800  [dp_sync_taskq_1]
100310                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100311                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100312                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100313                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100314                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100315                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100316                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100317                   D       -       0xfffff80001466600  [dp_zil_clean_taskq_]
100318                   D       -       0xfffff80001467c00  [z_zrele_0]
100319                   D       -       0xfffff80001467c00  [z_zrele_1]
100320                   D       -       0xfffff80001467c00  [z_zrele_2]
100321                   D       -       0xfffff80001467c00  [z_zrele_3]
100322                   D       -       0xfffff80001467c00  [z_zrele_4]
100323                   D       -       0xfffff80001467c00  [z_zrele_5]
100324                   D       -       0xfffff80001467c00  [z_zrele_6]
100325                   D       -       0xfffff80001467c00  [z_zrele_7]
100326                   D       -       0xfffff80001467300  [z_unlinked_drain_0]
100327                   D       -       0xfffff80001467300  [z_unlinked_drain_1]
100328                   D       -       0xfffff80001467300  [z_unlinked_drain_2]
100329                   D       -       0xfffff80001467300  [z_unlinked_drain_3]
100330                   D       -       0xfffff80001467300  [z_unlinked_drain_4]
100331                   D       -       0xfffff80001467300  [z_unlinked_drain_5]
100332                   D       -       0xfffff80001467300  [z_unlinked_drain_6]
100333                   D       -       0xfffff80001467300  [z_unlinked_drain_7]
100349                   D       tx->tx_ 0xfffff80001b26550  [txg_thread_enter]
100350                   D       tx->tx_ 0xfffff80001b26530  [txg_thread_enter]
100351                   D       mmp->mm 0xfffffe00db06f588  [mmp_thread_enter]
100352                   D       t->zthr 0xfffff80003877a48  [raidz_expand]
100353                   D       t->zthr 0xfffff8000350a348  [z_indirect_condense]
100354                   D       t->zthr 0xfffff8000350b248  [z_livelist_destroy]
100355                   D       t->zthr 0xfffff8000350b548  [z_livelist_condense]
100356                   D       t->zthr 0xfffff80003b43048  [z_checkpoint_discar]
   14     0     0     0  DL      (threaded)                  [usb]
100098                   D       -       0xfffffe00d3772440  [usbus0]
100099                   D       -       0xfffffe00d3772498  [usbus0]
100100                   D       -       0xfffffe00d37724f0  [usbus0]
100101                   D       -       0xfffffe00d3772548  [usbus0]
100102                   D       -       0xfffffe00d37725a0  [usbus0]
    5     0     0     0  DL      -       0xffffffff81b596c0  [busdma]
    4     0     0     0  DL      (threaded)                  [cam]
100089                   D       -       0xffffffff81bad240  [doneq0]
100090                   D       -       0xffffffff81bad2c0  [doneq1]
100091                   D       -       0xffffffff81bad1c0  [async]
100199                   D       -       0xffffffff81bad090  [scanner]
    3     0     0     0  DL      (threaded)                  [crypto]
100080                   D       crypto_ 0xffffffff82239470  [crypto]
100081                   D       crypto_ 0xfffff80001549830  [crypto returns 0]
100082                   D       crypto_ 0xfffff80001549880  [crypto returns 1]
100083                   D       crypto_ 0xfffff800015498d0  [crypto returns 2]
100084                   D       crypto_ 0xfffff80001549920  [crypto returns 3]
100085                   D       crypto_ 0xfffff80001549970  [crypto returns 4]
100086                   D       crypto_ 0xfffff800015499c0  [crypto returns 5]
100087                   D       crypto_ 0xfffff80001549a10  [crypto returns 6]
100088                   D       crypto_ 0xfffff80001549a60  [crypto returns 7]
   13     0     0     0  DL      (threaded)                  [geom]
100069                   D       -       0xffffffff81d96958  [g_event]
100070                   D       -       0xffffffff81d96960  [g_up]
100071                   D       -       0xffffffff81d96968  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100059                   I                                   [clock (0)]
100060                   I                                   [clock (1)]
100061                   I                                   [clock (2)]
100062                   I                                   [clock (3)]
100063                   I                                   [clock (4)]
100064                   I                                   [clock (5)]
100065                   I                                   [clock (6)]
100066                   I                                   [clock (7)]
   12     0     0     0  WL      (threaded)                  [intr]
100031                   I                                   [swi6: task queue]
100032                   I                                   [swi6: Giant taskq]
100034                   I                                   [swi5: fast taskq]
100067                   I                                   [swi1: netisr 0]
100097                   I                                   [irq148: xhci0]
100103                   I                                   [irq149: ahci0]
100105                   I                                   [irq151: hdac0]
100107                   I                                   [swi0: uart]
100108                   I                                   [irq1: atkbd0]
100190                   I                                   [swi1: pf send]
100191                   I                                   [swi1: pfsync]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   Run     CPU 0                       [idle: cpu0]
100004                   Run     CPU 1                       [idle: cpu1]
100005                   Run     CPU 2                       [idle: cpu2]
100006                   Run     CPU 3                       [idle: cpu3]
100007                   Run     CPU 4                       [idle: cpu4]
100008                   Run     CPU 5                       [idle: cpu5]
100009                   Run     CPU 6                       [idle: cpu6]
100010                   CanRun                              [idle: cpu7]
    1     0     1     0  SLs     wait    0xfffffe00c0802040  [init]
   10     0     0     0  DL      audit_w 0xffffffff82239970  [audit]
    0     0     0     0  LLs     (threaded)                  [kernel]
100000                   D       -       0xffffffff8345aff0  [kernel]
100011                   D       -       0xfffff80001325a00  [softirq_0]
100012                   D       -       0xfffff80001325800  [softirq_1]
100013                   D       -       0xfffff80001325600  [softirq_2]
100014                   D       -       0xfffff80001325400  [softirq_3]
100015                   D       -       0xfffff80001325200  [softirq_4]
100016                   D       -       0xfffff80001325000  [softirq_5]
100017                   D       -       0xfffff80001326d00  [softirq_6]
100018                   D       -       0xfffff80001326b00  [softirq_7]
100019                   D       -       0xfffff80001326900  [if_io_tqg_0]
100020                   D       -       0xfffff80001326700  [if_io_tqg_1]
100021                   D       -       0xfffff80001326500  [if_io_tqg_2]
100022                   D       -       0xfffff8000131e700  [if_io_tqg_3]
100023                   D       -       0xfffff8000131e500  [if_io_tqg_4]
100024                   D       -       0xfffff8000131e300  [if_io_tqg_5]
100025                   D       -       0xfffff8000131e100  [if_io_tqg_6]
100026                   D       -       0xfffff8000131fe00  [if_io_tqg_7]
100027                   D       -       0xfffff8000131fc00  [if_config_tqg_0]
100028                   D       -       0xfffff8000131fa00  [kqueue_ctx taskq]
100029                   D       -       0xfffff8000131f800  [jail_remove taskq]
100030                   D       -       0xfffff8000131f600  [bus taskq]
100033                   D       -       0xfffff80001320d00  [thread taskq]
100035                   D       -       0xfffff80001320800  [aiod_kick taskq]
100036                   D       -       0xfffff80001320600  [deferred_unmount ta]
100037                   D       -       0xfffff80001320400  [inm_free taskq]
100038                   D       -       0xfffff80001320200  [in6m_free taskq]
100039                   D       -       0xfffff80001320000  [linuxkpi_irq_wq]
100040                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_0]
100041                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_1]
100042                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_2]
100043                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_3]
100044                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_4]
100045                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_5]
100046                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_6]
100047                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_7]
100048                   D       -       0xfffff80001321d00  [linuxkpi_short_wq_8]
100049                   D       -       0xfffff80001321300  [linuxkpi_long_wq_0]
100050                   D       -       0xfffff80001321300  [linuxkpi_long_wq_1]
100051                   D       -       0xfffff80001321300  [linuxkpi_long_wq_2]
100052                   D       -       0xfffff80001321300  [linuxkpi_long_wq_3]
100053                   D       -       0xfffff80001321300  [linuxkpi_long_wq_4]
100054                   D       -       0xfffff80001321300  [linuxkpi_long_wq_5]
100055                   D       -       0xfffff80001321300  [linuxkpi_long_wq_6]
100056                   D       -       0xfffff80001321300  [linuxkpi_long_wq_7]
100057                   D       -       0xfffff80001321300  [linuxkpi_long_wq_8]
100068                   D       -       0xfffff800013f3d00  [firmware taskq]
100072                   D       -       0xfffff800013f4600  [crypto_0]
100073                   D       -       0xfffff800013f4600  [crypto_1]
100074                   D       -       0xfffff800013f4600  [crypto_2]
100075                   D       -       0xfffff800013f4600  [crypto_3]
100076                   D       -       0xfffff800013f4600  [crypto_4]
100077                   D       -       0xfffff800013f4600  [crypto_5]
100078                   D       -       0xfffff800013f4600  [crypto_6]
100079                   D       -       0xfffff800013f4600  [crypto_7]
100092                   D       -       0xfffff80001892a00  [if_igb0_tq]
100094                   D       -       0xfffff800019ae300  [if_igb1_tq]
100095                   D       -       0xfffff800019afa00  [if_igb2_tq]
100096                   D       -       0xfffff80001807d00  [if_igb3_tq]
100104                   D       -       0xfffff80001894700  [re0 taskq]
100106                   D       -       0xfffff80001894100  [if_em0_tq]
100109                   D       -       0xfffff80003404000  [system_taskq_0]
100110                   D       -       0xfffff80003404000  [system_taskq_1]
100111                   D       -       0xfffff80003404000  [system_taskq_2]
100112                   D       -       0xfffff80003404000  [system_taskq_3]
100113                   D       -       0xfffff80003404000  [system_taskq_4]
100114                   D       -       0xfffff80003404000  [system_taskq_5]
100115                   D       -       0xfffff80003404000  [system_taskq_6]
100116                   D       -       0xfffff80003404000  [system_taskq_7]
100117                   D       -       0xfffff80003403600  [system_delay_taskq_]
100118                   D       -       0xfffff80003403600  [system_delay_taskq_]
100119                   D       -       0xfffff80003403600  [system_delay_taskq_]
100120                   D       -       0xfffff80003403600  [system_delay_taskq_]
100121                   D       -       0xfffff80003403600  [system_delay_taskq_]
100122                   D       -       0xfffff80003403600  [system_delay_taskq_]
100123                   D       -       0xfffff80003403600  [system_delay_taskq_]
100124                   D       -       0xfffff80003403600  [system_delay_taskq_]
100125                   D       -       0xfffff800035c6b00  [zvol_tq-0_0]
100126                   D       -       0xfffff800035c6b00  [zvol_tq-0_1]
100127                   D       -       0xfffff800035c6b00  [zvol_tq-0_2]
100128                   D       -       0xfffff800035c6b00  [zvol_tq-0_3]
100129                   D       -       0xfffff800035c6b00  [zvol_tq-0_4]
100130                   D       -       0xfffff800035c6b00  [zvol_tq-0_5]
100131                   D       -       0xfffff800035c6b00  [zvol_tq-0_6]
100132                   D       -       0xfffff800035c6b00  [zvol_tq-0_7]
100133                   D       -       0xfffff800035c6b00  [zvol_tq-0_8]
100134                   D       -       0xfffff800035c6b00  [zvol_tq-0_9]
100135                   D       -       0xfffff800035c6b00  [zvol_tq-0_10]
100136                   D       -       0xfffff800035c6b00  [zvol_tq-0_11]
100137                   D       -       0xfffff800035c6b00  [zvol_tq-0_12]
100138                   D       -       0xfffff800035c6b00  [zvol_tq-0_13]
100139                   D       -       0xfffff800035c6b00  [zvol_tq-0_14]
100140                   D       -       0xfffff800035c6b00  [zvol_tq-0_15]
100141                   D       -       0xfffff800035c7900  [zvol_tq-1_0]
100142                   D       -       0xfffff800035c7900  [zvol_tq-1_1]
100143                   D       -       0xfffff800035c7900  [zvol_tq-1_2]
100144                   D       -       0xfffff800035c7900  [zvol_tq-1_3]
100145                   D       -       0xfffff800035c7900  [zvol_tq-1_4]
100146                   D       -       0xfffff800035c7900  [zvol_tq-1_5]
100147                   D       -       0xfffff800035c7900  [zvol_tq-1_6]
100148                   D       -       0xfffff800035c7900  [zvol_tq-1_7]
100149                   D       -       0xfffff800035c7900  [zvol_tq-1_8]
100150                   D       -       0xfffff800035c7900  [zvol_tq-1_9]
100151                   D       -       0xfffff800035c7900  [zvol_tq-1_10]
100152                   D       -       0xfffff800035c7900  [zvol_tq-1_11]
100153                   D       -       0xfffff800035c7900  [zvol_tq-1_12]
100154                   D       -       0xfffff800035c7900  [zvol_tq-1_13]
100155                   D       -       0xfffff800035c7900  [zvol_tq-1_14]
100156                   D       -       0xfffff800035c7900  [zvol_tq-1_15]
100157                   D       -       0xfffff800035c8700  [arc_prune]
100158                   D       -       0xfffff800035c8500  [arc_evict_0]
100159                   D       -       0xfffff800035c8500  [arc_evict_1]
100160                   D       -       0xfffff800035c8500  [arc_evict_2]
100161                   D       -       0xfffff800035c8100  [arc_flush_0]
100162                   D       -       0xfffff800035c8100  [arc_flush_1]
100163                   D       -       0xfffff800035c8100  [arc_flush_2]
100164                   D       -       0xfffff800035c8100  [arc_flush_3]
100188                   D       -       0xfffff80003645700  [ip_mroute_tskq task]
100192                   D       -       0xfffff80003642900  [acpi_task_0]
100193                   D       -       0xfffff80003642900  [acpi_task_1]
100194                   D       -       0xfffff80003642900  [acpi_task_2]
100197                   D       -       0xfffff80001219600  [mca taskq]
100198                   D       -       0xfffff8000131ea00  [CAM taskq]
100215                   D       -       0xfffff8000358ae00  [z_null_iss]
100216                   D       -       0xfffff8000358ac00  [z_null_int]
100217                   D       -       0xfffff8000358aa00  [z_rd_iss_0]
100218                   D       -       0xfffff8000358aa00  [z_rd_iss_1]
100219                   D       -       0xfffff8000358aa00  [z_rd_iss_2]
100220                   D       -       0xfffff8000358aa00  [z_rd_iss_3]
100221                   D       -       0xfffff8000358aa00  [z_rd_iss_4]
100222                   D       -       0xfffff8000358aa00  [z_rd_iss_5]
100223                   D       -       0xfffff8000358aa00  [z_rd_iss_6]
100224                   D       -       0xfffff8000358aa00  [z_rd_iss_7]
100225                   D       -       0xfffff8000358a100  [z_rd_int_0_0]
100226                   D       -       0xfffff8000358a100  [z_rd_int_0_1]
100227                   D       -       0xfffff8000358a100  [z_rd_int_0_2]
100228                   D       -       0xfffff8000358bc00  [z_rd_int_1_0]
100229                   D       -       0xfffff8000358bc00  [z_rd_int_1_1]
100230                   D       -       0xfffff8000358bc00  [z_rd_int_1_2]
100231                   D       -       0xfffff8000358b800  [z_wr_iss_0]
100232                   D       -       0xfffff8000358b800  [z_wr_iss_1]
100233                   D       -       0xfffff8000358b800  [z_wr_iss_2]
100234                   D       -       0xfffff8000358b800  [z_wr_iss_3]
100235                   D       -       0xfffff8000358b800  [z_wr_iss_4]
100236                   D       -       0xfffff8000358b800  [z_wr_iss_5]
100237                   D       -       0xfffff8000358b100  [z_wr_int_0_0]
100238                   D       -       0xfffff8000358b100  [z_wr_int_0_1]
100239                   D       -       0xfffff8000358b100  [z_wr_int_0_2]
100240                   D       -       0xfffff8000358cc00  [z_wr_int_1_0]
100241                   D       -       0xfffff8000358cc00  [z_wr_int_1_1]
100242                   D       -       0xfffff8000358cc00  [z_wr_int_1_2]
100243                   D       -       0xfffff8000358c800  [z_fr_iss_0_0]
100244                   D       -       0xfffff8000358c800  [z_fr_iss_0_1]
100245                   D       -       0xfffff8000358c800  [z_fr_iss_0_2]
100246                   D       -       0xfffff8000358c800  [z_fr_iss_0_3]
100247                   D       -       0xfffff8000358c800  [z_fr_iss_0_4]
100248                   D       -       0xfffff8000358c800  [z_fr_iss_0_5]
100249                   D       -       0xfffff8000358c800  [z_fr_iss_0_6]
100250                   D       -       0xfffff8000358c800  [z_fr_iss_0_7]
100251                   D       -       0xfffff8000358c800  [z_fr_iss_0_8]
100252                   D       -       0xfffff8000358c800  [z_fr_iss_0_9]
100253                   D       -       0xfffff8000358c800  [z_fr_iss_0_10]
100254                   D       -       0xfffff8000358c800  [z_fr_iss_0_11]
100255                   D       -       0xfffff8000358c800  [z_fr_iss_0_12]
100256                   D       -       0xfffff8000358c800  [z_fr_iss_0_13]
100257                   D       -       0xfffff8000358c800  [z_fr_iss_0_14]
100258                   D       -       0xfffff8000358c800  [z_fr_iss_0_15]
100259                   D       -       0xfffff80003543d00  [z_fr_iss_1_0]
100260                   D       -       0xfffff80003543d00  [z_fr_iss_1_1]
100261                   D       -       0xfffff80003543d00  [z_fr_iss_1_2]
100262                   D       -       0xfffff80003543d00  [z_fr_iss_1_3]
100263                   D       -       0xfffff80003543d00  [z_fr_iss_1_4]
100264                   D       -       0xfffff80003543d00  [z_fr_iss_1_5]
100265                   D       -       0xfffff80003543d00  [z_fr_iss_1_6]
100266                   D       -       0xfffff80003543d00  [z_fr_iss_1_7]
100267                   D       -       0xfffff80003543d00  [z_fr_iss_1_8]
100268                   D       -       0xfffff80003543d00  [z_fr_iss_1_9]
100269                   D       -       0xfffff80003543d00  [z_fr_iss_1_10]
100270                   D       -       0xfffff80003543d00  [z_fr_iss_1_11]
100271                   D       -       0xfffff80003543d00  [z_fr_iss_1_12]
100272                   D       -       0xfffff80003543d00  [z_fr_iss_1_13]
100273                   D       -       0xfffff80003543d00  [z_fr_iss_1_14]
100274                   D       -       0xfffff80003543d00  [z_fr_iss_1_15]
100275                   D       -       0xfffff80003544b00  [z_fr_int]
100276                   D       -       0xfffff80003544900  [z_cl_iss]
100277                   D       -       0xfffff80003544700  [z_cl_int]
100278                   D       -       0xfffff80003544500  [z_flush_iss]
100279                   D       -       0xfffff80003544300  [z_flush_int]
100280                   D       -       0xfffff80003544100  [z_trim_iss_0]
100281                   D       -       0xfffff80003544100  [z_trim_iss_1]
100282                   D       -       0xfffff80003544100  [z_trim_iss_2]
100283                   D       -       0xfffff80003544100  [z_trim_iss_3]
100284                   D       -       0xfffff80003545b00  [z_trim_int]
100422                   L      *KDB: reentering
KDB: stack backtrace:

[lmoore]

In my case it is something to do with having a Realtek NIC installed. I've removed the Realtek NIC and it boots to the login prompt just fine.  Re-installed the Intel 4-port NIC and it too has booted to the login prompt.

[bamf]

Update ran without any issues here. Not using any Realtek NICs, only Intel.

[lmoore]

Removing plugin "os-realtek-re: 1.0" has resolved my boot-loop.

I'll swap machines over shortly and report back if any new problems arise.

[franco]

Larry, that's helpful and appears to make sense in the grand scheme of things as AF_MAX constant was modified but ports rebuilds for drivers are not happening at the same time.  But there could also be other spots in the kernel that are affected.

https://github.com/opnsense/src/commit/af063949d

I've reverted the commit we actually picked up from stable/15 and replaced the base/kernel sets on the mirror and see if the reports will stop over the next hours.  Not all mirrors sync fast but it's the best we can do.


Cheers,
Franco

[axsdenied]

It appears removing the realtek drivers worked for me as well.  While my motherboard's nic is realtek, I don't use it, I use an intel pci-e 4 port card so I was ok disabling it.

Below are my logs from the boot with the realtek drivers installed showing the panic:
P.S. the new services widget, is much improved, thanks for that :)

Code Select Expand

---<<BOOT>>---
Copyright (c) 1992-2025 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 15.1-RELEASE-p2 stable/26.7-n283714-dd064f22c895 SMP amd64
FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2)
[1] VT(efifb): resolution 1024x768
[1] CPU: Intel(R) Core(TM) i5-7600 CPU @ 3.50GHz (3500.00-MHz K8-class CPU)
[1]   Origin="GenuineIntel"  Id=0x906e9  Family=0x6  Model=0x9e  Stepping=9
[1]   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
[1]   Features2=0x7ffafbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
[1]   AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
[1]   AMD Features2=0x121<LAHF,ABM,Prefetch>
[1]   Structured Extended Features=0x29c6fbf<FSGSBASE,TSCADJ,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,NFPUSG,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PROCTRACE>
[1]   Structured Extended Features3=0xbc002e00<MCUOPT,MD_CLEAR,TSXFA,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD>
[1]   XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
[1]   IA32_ARCH_CAPS=0xc04<RSBA>
[1]   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
[1]   TSC: P-state invariant, performance statistics
[1] real memory  = 8589934592 (8192 MB)
[1] avail memory = 8186134528 (7806 MB)
[1] Event timer "LAPIC" quality 600
[1] ACPI APIC Table: <DELL   CBX3   >
[1] FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
[1] FreeBSD/SMP: 1 package(s) x 4 core(s)
[1] random: registering fast source Intel Secure Key Seed
[1] random: fast provider: "Intel Secure Key Seed"
[1] random: unblocking device.
[1] ioapic0 <Version 2.0> irqs 0-119
[1] Launching APs: 3 2 1
[1] random: entropy device external interface
[1] wlan: mac acl policy registered
[1] kbd1 at kbdmux0
[1] WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 16.0.
[1] efirtc0: <EFI Realtime Clock>
[1] efirtc0: registered as a time-of-day clock, resolution 1.000000s
[1] smbios0: <System Management BIOS> at iomem 0xf0600-0xf0617
[1] smbios0: Entry point: v3 (64-bit), Version: 3.0
[1] aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS>
[1] acpi0: <DELL CBX3   >
[1] acpi0: Power Button (fixed)
[1] cpu0: <ACPI CPU> on acpi0
[1] hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
[1] Timecounter "HPET" frequency 24000000 Hz quality 950
[1] Event timer "HPET" frequency 24000000 Hz quality 550
[1] Event timer "HPET1" frequency 24000000 Hz quality 440
[1] Event timer "HPET2" frequency 24000000 Hz quality 440
[1] Event timer "HPET3" frequency 24000000 Hz quality 440
[1] Event timer "HPET4" frequency 24000000 Hz quality 440
[1] atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
[1] atrtc0: Warning: Couldn't map I/O.
[1] atrtc0: registered as a time-of-day clock, resolution 1.000000s
[1] Event timer "RTC" frequency 32768 Hz quality 0
[1] attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
[1] Timecounter "i8254" frequency 1193182 Hz quality 0
[1] Event timer "i8254" frequency 1193182 Hz quality 100
[1] Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
[1] acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0
[1] pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
[1] pci0: <ACPI PCI bus> on pcib0
[1] pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
[1] pci1: <ACPI PCI bus> on pcib1
[1] pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
[1] pci2: <ACPI PCI bus> on pcib2
[1] pcib3: <PCI-PCI bridge> irq 17 at device 1.0 on pci2
[1] pci3: <PCI bus> on pcib3
[1] igc0: <Intel(R) Ethernet Controller I226-V> mem 0xf7a00000-0xf7afffff,0xf7b00000-0xf7b03fff irq 17 at device 0.0 on pci3
[1] igc0: EEPROM V2.17-0 eTrack 0x80000303
[1] igc0: Using 1024 TX descriptors and 1024 RX descriptors
[1] igc0: Using 4 RX queues 4 TX queues
[1] igc0: Using MSI-X interrupts with 5 vectors
[1] igc0: Ethernet address: b0:b1:a1:b6:72:37
[1] igc0: netmap queues/slots: TX 4/1024, RX 4/1024
[1] pcib4: <PCI-PCI bridge> irq 18 at device 2.0 on pci2
[1] pci4: <PCI bus> on pcib4
[1] igc1: <Intel(R) Ethernet Controller I226-V> mem 0xf7700000-0xf77fffff,0xf7800000-0xf7803fff irq 18 at device 0.0 on pci4
[1] igc1: EEPROM V2.17-0 eTrack 0x80000303
[1] igc1: Using 1024 TX descriptors and 1024 RX descriptors
[1] igc1: Using 4 RX queues 4 TX queues
[1] igc1: Using MSI-X interrupts with 5 vectors
[1] igc1: Ethernet address: b0:b1:a1:b6:72:34
[1] igc1: netmap queues/slots: TX 4/1024, RX 4/1024
[1] pcib5: <PCI-PCI bridge> irq 19 at device 3.0 on pci2
[1] pci5: <PCI bus> on pcib5
[1] igc2: <Intel(R) Ethernet Controller I226-V> mem 0xf7400000-0xf74fffff,0xf7500000-0xf7503fff irq 19 at device 0.0 on pci5
[1] igc2: EEPROM V2.17-0 eTrack 0x80000303
[1] igc2: Using 1024 TX descriptors and 1024 RX descriptors
[1] igc2: Using 4 RX queues 4 TX queues
[1] igc2: Using MSI-X interrupts with 5 vectors
[1] igc2: Ethernet address: b0:b1:a1:b6:72:35
[1] igc2: netmap queues/slots: TX 4/1024, RX 4/1024
[1] pcib6: <PCI-PCI bridge> irq 16 at device 4.0 on pci2
[1] pci6: <PCI bus> on pcib6
[1] igc3: <Intel(R) Ethernet Controller I226-V> mem 0xf7100000-0xf71fffff,0xf7200000-0xf7203fff irq 16 at device 0.0 on pci6
[1] igc3: EEPROM V2.17-0 eTrack 0x80000303
[1] igc3: Using 1024 TX descriptors and 1024 RX descriptors
[1] igc3: Using 4 RX queues 4 TX queues
[1] igc3: Using MSI-X interrupts with 5 vectors
[1] igc3: Ethernet address: b0:b1:a1:b6:72:36
[1] igc3: netmap queues/slots: TX 4/1024, RX 4/1024
[1] vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xf6000000-0xf6ffffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0
[1] vgapci0: Boot video device
[1] xhci0: <Intel Union Point USB 3.0 controller> mem 0xf7d10000-0xf7d1ffff irq 17 at device 20.0 on pci0
[1] xhci0: 32 bytes context size, 64-bit DMA
[1] xhci0: xECP capabilities <PROTO,PROTO,VEND(c0),LEGACY,VEND(c6),VEND(c7),VEND(c2),DEBUG,VEND(c3),VEND(c4),VEND(c5)>
[1] usbus0: waiting for BIOS to give up control
[1] xhci_interrupt: host controller halted
[1] usbus0 on xhci0
[1] usbus0: 5.0Gbps Super Speed USB v3.0
[1] pci0: <simple comms> at device 22.0 (no driver attached)
[1] ahci0: <Intel Union Point AHCI SATA controller> port 0xf090-0xf097,0xf080-0xf083,0xf060-0xf07f mem 0xf7d28000-0xf7d29fff,0xf7d2c000-0xf7d2c0ff,0xf7d2b000-0xf7d2b7ff irq 22 at device 23.0 on pci0
[1] ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier not supported
[1] ahcich0: <AHCI channel> at channel 0 on ahci0
[1] ahcich1: <AHCI channel> at channel 1 on ahci0
[1] ahciem0: <AHCI enclosure management bridge> on ahci0
[1] pcib7: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
[1] pci7: <ACPI PCI bus> on pcib7
[1] re0: <Realtek PCIe GbE Family Controller> port 0xe000-0xe0ff mem 0xf7c04000-0xf7c04fff,0xf7c00000-0xf7c03fff irq 16 at device 0.0 on pci7
[1] re0: Using Memory Mapping!
[1] re0: Using 1 MSI-X message
[1] re0: ASPM disabled
[1] re0: version:1.102.01
[1] re0: Ethernet address: d8:9e:f3:37:ec:a0
[1]
[1] This product is covered by one or more of the following patents:           
[1] US6,570,884, US6,115,776, and US6,327,625.
[1] re0: Ethernet address: d8:9e:f3:37:ec:a0
[1] isab0: <PCI-ISA bridge> at device 31.0 on pci0
[1] isa0: <ISA bus> on isab0
[1] pci0: <memory> at device 31.2 (no driver attached)
[1] hdac0: <Intel Kaby Lake-H HDA Controller> mem 0xf7d20000-0xf7d23fff,0xf7d00000-0xf7d0ffff irq 21 at device 31.3 on pci0
[1] acpi_button0: <Sleep Button> on acpi0
[1] acpi_button1: <Power Button> on acpi0
[1] acpi_tz0: <Thermal Zone> on acpi0
[1] acpi_tz1: <Thermal Zone> on acpi0
[1] uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
[1] atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
[1] atkbd0: <AT Keyboard> irq 1 on atkbdc0
[1] kbd0 at atkbd0
[1] atkbd0: [GIANT-LOCKED]
[1] driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
[1] orm0: <ISA Option ROMs> at iomem 0xc0000-0xcffff,0xd0000-0xd0fff pnpid ORM0000 on isa0
[1] hwpstate_intel0: <Intel Speed Shift> on cpu0
[1] cpufreq0: <CPU frequency control> on cpu0
[1] hwpstate_intel1: <Intel Speed Shift> on cpu1
[1] cpufreq1: <CPU frequency control> on cpu1
[1] hwpstate_intel2: <Intel Speed Shift> on cpu2
[1] cpufreq2: <CPU frequency control> on cpu2
[1] hwpstate_intel3: <Intel Speed Shift> on cpu3
[1] cpufreq3: <CPU frequency control> on cpu3
[1] Timecounter "TSC-low" frequency 1751996437 Hz quality 1000
[1] Timecounters tick every 1.000 msec
[1] ZFS filesystem version: 5
[1] ZFS storage pool version: features support (5000)
[1] hdacc0: <Realtek ALC255 HDA CODEC> at cad 0 on hdac0
[1] hdaa0: <Realtek ALC255 Audio Function Group> at nid 1 on hdacc0
[1] pcm0: <Realtek ALC255 (Rear Analog Line-out)> at nid 27 on hdaa0
[1] hdacc1: <Intel Kaby Lake HDA CODEC> at cad 2 on hdac0
[1] hdaa1: <Intel Kaby Lake Audio Function Group> at nid 1 on hdacc1
[1] pcm1: <Intel Kaby Lake (HDMI/DP 8ch)> at nid 5 on hdaa1
[1] pcm2: <Intel Kaby Lake (HDMI/DP 8ch)> at nid 6 on hdaa1
[1] pcm3: <Intel Kaby Lake (HDMI/DP 8ch)> at nid 7 on hdaa1
[1] ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WD Blue SA510 2.5 500GB 52046100> ACS-4 ATA SATA 3.x device
ada0: Serial Number 22303Q802015
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 476940MB (976773168 512 byte sectors)
[1] cd0 at ahcich1 bus 0 scbus1 target 0 lun 0
cd0: <HL-DT-ST DVD+-RW GU90N A1C1> Removable CD-ROM SCSI device
cd0: Serial Number M1IG6CK1400
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
[1] ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
[1] ses0: ada0,pass0 in 'Slot 00', SATA Slot: scbus0 target 0
[1] ses0: cd0,pass1 in 'Slot 01', SATA Slot: scbus1 target 0
[1] Trying to mount root from zfs:zroot/ROOT/default []...
[1] ugen0.1: <Intel XHCI root HUB> at usbus0
[1] uhub0 on usbus0
[1] uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
[2] Root mount waiting for: usbus0
[2] uhub0: 22 ports with 22 removable, self powered
[2] ugen0.2: <American Power Conversion Back-UPS XS 1500M FW:947.d11 .D USB FW:d11> at usbus0
[3] ugen0.3: <PiKVM PiKVM Composite Device> at usbus0
[3] usbhid0 on uhub0
[3] usbhid0: <PiKVM PiKVM Composite Device, class 0/0, rev 2.00/1.00, addr 2> on usbus0
[3] hidbus0: <HID bus> on usbhid0
[3] hkbd0: <PiKVM PiKVM Composite Device Keyboard> on hidbus0
[3] kbd2 at hkbd0
[3] usbhid1 on uhub0
[3] usbhid1: <PiKVM PiKVM Composite Device, class 0/0, rev 2.00/1.00, addr 2> on usbus0
[3] hidbus1: <HID bus> on usbhid1
[3] usbhid2 on uhub0
[3] usbhid2: <PiKVM PiKVM Composite Device, class 0/0, rev 2.00/1.00, addr 2> on usbus0
[3] hidbus2: <HID bus> on usbhid2
[3] umass0 on uhub0
[3] umass0: <PiKVM PiKVM Composite Device, class 0/0, rev 2.00/1.00, addr 2> on usbus0
[3] umass0:  SCSI over Bulk-Only; quirks = 0x0
[3] umass0:3:0: Attached to scbus3
[3] cd1 at umass-sim0 bus 0 scbus3 target 0 lun 0
cd1: <PiKVM Optical Drive 1.00> Removable CD-ROM SCSI-2 device
cd1: 40.000MB/s transfers
cd1: Attempt to query device size failed: NOT READY, Medium not present
cd1: quirks=0x10<10_BYTE_ONLY>
[7] igc0: link state changed to UP
[7] igc1: link state changed to UP
[7] igc2: link state changed to UP
[7] kernel trap 12 with interrupts disabled
[7]
[7]
[7] Fatal trap 12: page fault while in kernel mode
[7] cpuid = 3; apic id = 06
[7] fault virtual address = 0x22710068
[7] fault code = supervisor write data, page not present
[7] instruction pointer = 0x20:0xffffffff80c71200
[7] stack pointer         = 0x28:0xfffffe008a3679c0
[7] frame pointer         = 0x28:0xfffffe008a367a00
[7] code segment = base 0x0, limit 0xfffff, type 0x1b
[7] = DPL 0, pres 1, long 1, def32 0, gran 1
[7] processor eflags = resume, IOPL = 0
[7] current process = 0 (netlink_socket (PID)
[7] rdi: fffff800120593c0 rsi: fffff800663bf2b8 rdx: fffff800120593e0
[7] rcx: fffff80012059420  r8: 0000000000000000  r9: 0000000000000010
[7] rax: 0000000022710000 rbx: fffff8001207a780 rbp: fffffe008a367a00
[7] r10: 0000000000000000 r11: 0000000000000570 r12: ffffffff82213e28
[7] r13: 0000000000000000 r14: fffff800663bf420 r15: fffff800120593c0
[7] trap number = 12
[7] panic: page fault
[7] cpuid = 3
[7] time = 1786544944
[7] KDB: stack backtrace:
[7] db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008a367710
[7] vpanic() at vpanic+0x136/frame 0xfffffe008a367840
[7] panic() at panic+0x43/frame 0xfffffe008a3678a0
[7] trap_pfault() at trap_pfault+0x37d/frame 0xfffffe008a3678f0
[7] calltrap() at calltrap+0x8/frame 0xfffffe008a3678f0
[7] --- trap 0xc, rip = 0xffffffff80c71200, rsp = 0xfffffe008a3679c0, rbp = 0xfffffe008a367a00 ---
[7] turnstile_wait() at turnstile_wait+0x120/frame 0xfffffe008a367a00
[7] __mtx_lock_sleep() at __mtx_lock_sleep+0x175/frame 0xfffffe008a367a90
[7] re_init() at re_init+0x27/frame 0xfffffe008a367ab0
[7] dump_iface() at dump_iface+0x11a/frame 0xfffffe008a367b50
[7] dump_cb() at dump_cb+0x1c/frame 0xfffffe008a367b70
[7] if_foreach_sleep() at if_foreach_sleep+0x227/frame 0xfffffe008a367bf0
[7] rtnl_handle_getlink() at rtnl_handle_getlink+0x257/frame 0xfffffe008a367cd0
[7] rtnl_handle_message() at rtnl_handle_message+0x195/frame 0xfffffe008a367d30
[7] nl_taskqueue_handler() at nl_taskqueue_handler+0x469/frame 0xfffffe008a367e40
[7] taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe008a367ec0
[7] taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe008a367ef0
[7] fork_exit() at fork_exit+0x7b/frame 0xfffffe008a367f30
[7] fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008a367f30
[7] --- trap 0xc, rip = 0x3deae40b0c8a, rsp = 0x3deae6647f48, rbp = 0x3deae6647f60 ---
[7] KDB: enter: panic


[franco]

This is only true for the main mirror at the moment: if you want to force a reinstall use this:

# opnsense-update -fbkr 26.7.2

The realtek plugin should work again afterwards.  But still curious there was a second panic unrelated to realtek...


Cheers,
Franco