Messages

Hi there,

I was able to reproduce the above behaviour on another, identical device.

The firewall crashed, when I added _the second_ WLAN interface (second virtual WLAN/second SSID/call it as you like...)

Correction to initial statement above: WPA/WPA2/Both does not seem to matter.

Here's what I got after clicking 'Apply' after configuring the second virtual WLAN I got this:


Fatal trap 12: page fault while in kernel mode
cpuid = 3; apic id = 03
fault virtual address   = 0xffff
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff80d5faed
stack pointer           = 0x28:0xfffffe0062d7acd0
frame pointer           = 0x28:0xfffffe0062d7ad00
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 0 (ath0 net80211 taskq)
rdi: 0000000000040000 rsi: 0000000000000001 rdx: 000000000000ffff
rcx: 00000000480c0408  r8: 0000000000000000  r9: 0000000000000180
rax: fffff8000aebd142 rbx: fffff800bbdb7000 rbp: fffffe0062d7ad00
r10: 0000000000000000 r11: 000007fffffff000 r12: fffffe0008db1000
r13: fffff8000aebd138 r14: fffff800bbdb7000 r15: fffffe008da87000
trap number             = 12
panic: page fault
cpuid = 3
time = 1659834958
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0062d7a9c0
vpanic() at vpanic+0x131/frame 0xfffffe0062d7aaf0
panic() at panic+0x43/frame 0xfffffe0062d7ab50
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe0062d7abb0
trap_pfault() at trap_pfault+0x46/frame 0xfffffe0062d7ac00
calltrap() at calltrap+0x8/frame 0xfffffe0062d7ac00
--- trap 0xc, rip = 0xffffffff80d5faed, rsp = 0xfffffe0062d7acd0, rbp = 0xfffffe0062d7ad00 ---
ieee80211_beacon_construct() at ieee80211_beacon_construct+0x7d/frame 0xfffffe0062d7ad00
ieee80211_beacon_alloc() at ieee80211_beacon_alloc+0xb3/frame 0xfffffe0062d7ad40
ath_beacon_alloc() at ath_beacon_alloc+0x84/frame 0xfffffe0062d7ad80
ath_newstate() at ath_newstate+0x3f2/frame 0xfffffe0062d7adf0
ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1fc/frame 0xfffffe0062d7ae40
taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe0062d7aec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe0062d7aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0062d7af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0062d7af30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 0 tid 100061 ]
Stopped at      kdb_enter+0x33: movq    $0,0xfd08d2(%rip)
db:0:kdb.enter.default> textdump set
textdump set
db:0:kdb.enter.default>  capture on
db:0:kdb.enter.default>  run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo>  show alllocks
No such command; use "help" to list available commands
db:1:lockinfo>  show lockedvnods
Locked vnodes
db:0:kdb.enter.default>  show pcpu
cpuid        = 3
dynamic pcpu = 0xfffffe00871be300
curthread    = 0xfffff800038fc000: pid 0 tid 100061 critnest 1 "ath0 net80211 taskq"
curpcb       = 0xfffff800038fc520
fpcurthread  = none
idlethread   = 0xfffff80003570000: tid 100006 "idle: cpu3"
self         = 0xffffffff82613000
curpmap      = 0xffffffff81b81590
tssp         = 0xffffffff82613384
rsp0         = 0xfffffe0062d7b000
kcr3         = 0x24ea000
ucr3         = 0xffffffffffffffff
scr3         = 0xc41ae000
gs32p        = 0xffffffff82613404
ldt          = 0xffffffff82613444
tss          = 0xffffffff82613434
curvnet      = 0
db:0:kdb.enter.default>  bt
Tracing pid 0 tid 100061 td 0xfffff800038fc000
kdb_enter() at kdb_enter+0x33/frame 0xfffffe0062d7aaf0
panic() at panic+0x43/frame 0xfffffe0062d7ab50
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe0062d7abb0
trap_pfault() at trap_pfault+0x46/frame 0xfffffe0062d7ac00
calltrap() at calltrap+0x8/frame 0xfffffe0062d7ac00
--- trap 0xc, rip = 0xffffffff80d5faed, rsp = 0xfffffe0062d7acd0, rbp = 0xfffffe0062d7ad00 ---
ieee80211_beacon_construct() at ieee80211_beacon_construct+0x7d/frame 0xfffffe0062d7ad00
ieee80211_beacon_alloc() at ieee80211_beacon_alloc+0xb3/frame 0xfffffe0062d7ad40
ath_beacon_alloc() at ath_beacon_alloc+0x84/frame 0xfffffe0062d7ad80
ath_newstate() at ath_newstate+0x3f2/frame 0xfffffe0062d7adf0
ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1fc/frame 0xfffffe0062d7ae40
taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe0062d7aec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe0062d7aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe0062d7af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0062d7af30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
db:0:kdb.enter.default>  ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
71690 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
71170 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
70971 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
70468 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
69580 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
68881 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
68502 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
68465 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
67639 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
67342 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
66416 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
65707 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
64964 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
64929 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
64264 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
64058 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
63461 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
63287 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
63092 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
63056 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
62108 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
61620 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
60707 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
60654 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
60002 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
59303 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
59047 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
58460 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
57873 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
56767 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
55708 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
55702 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
54965 50652 50652     0  S       nanslp  0xffffffff81bc47e2  php-cgi
54370 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
54213 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
53221 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
53139 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
52622 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
52187 50261 50261     0  S       accept  0xfffff8000abd9e10  php-cgi
51539 50652 50652     0  S       accept  0xfffff8000ac73210  php-cgi
50652 49462 50652     0  Ss      wait    0xfffffe006e175000  php-cgi
50261 49462 50261     0  Ss      wait    0xfffffe008d9175c0  php-cgi
49462     1 48645     0  S       kqread  0xfffff8005ad12c00  lighttpd
68201     1 68201     0  Ss      bpf     0xfffff8005aa6d400  filterlog
39576     1 39576   136  Ss      select  0xfffff800c45086c0  dhcpd
25719     1 25719     0  Ss      select  0xfffff800c433e540  hostapd
94453 77075 94453     0  S+      ttyin   0xfffff8000a0008b0  csh
56999 45264 95380     0  S       nanslp  0xffffffff81bc47e0  sleep
45264 83743 95380     0  S       wait    0xfffffe008d9415a0  sh
83743 79848 95380     0  S       wait    0xfffffe008d924000  sh
79848 79617 95380     0  S       wait    0xfffffe008d94a5c0  sh
79617 77758 95380     0  S       wait    0xfffffe008d957000  lockf
77758 76263 95380     0  S       wait    0xfffffe008d94a060  sh
76263  8137 95380     0  S       wait    0xfffffe006ddb0000  sh
 8137  1763 95380     0  S       wait    0xfffffe008d909060  sh
 1763   986 95380     0  S       wait    0xfffffe008d925ae0  sh
  986 95380 95380     0  S       wait    0xfffffe008d948020  lockf
95380 93608 95380     0  Ss      wait    0xfffffe008d90aac0  sh
93608  6445  6445     0  S       piperd  0xfffffe006ddc1cc0  cron
77075 39332 39332     0  S+      wait    0xfffffe008d941040  sh
39332     1 39332     0  Ss+     wait    0xfffffe006ddac040  login
11406     1 11406     0  Ss      select  0xfffff8005a0335c0  ntpd
 6445     1  6445     0  Ss      nanslp  0xffffffff81bc47e0  cron
 2811 18873  2811     0  S       select  0xfffff8005afb5440  python3.11
99579 18873 99579     0  S       select  0xfffff8009ab76a40  python3.11
48196     1 48196     0  Ss      select  0xfffff8005aefb740  dhcp6c
45861     1 45861     0  Ss      select  0xfffff8009ac45440  rtsold
45526     1 45526     0  Ss      select  0xfffff8005aefb1c0  rtsold
45285     1 45285     0  Ss      select  0xfffff8000a06a6c0  rtsold
45147     1 45147     0  Ss      select  0xfffff8000a06a840  rtsold
44189     1 44189     0  Ss      kqread  0xfffff8005a7e5300  rtsold
42886     1 42886    65  Ss      select  0xfffff8000a06acc0  dhclient
31438     1 31438     0  Ss      select  0xfffff8005a033e40  dhclient
27784     1 27784     0  Ss      select  0xfffff8005aa04dc0  dhclient
18873 18776 18873     0  Ss      (threaded)                  syslog-ng
100168                   S       kqread  0xfffff8000aacfa00  syslog-ng
101285                   S       kqread  0xfffff8000ac55b00  syslog-ng
111013                   S       kqread  0xfffff80003916c00  syslog-ng
111087                   S       kqread  0xfffff8008cd30e00  syslog-ng
18776     1 18510     0  S       wait    0xfffffe0008d8bac0  syslog-ng
  680     1   680     0  Ss      select  0xfffff8000a7eaa40  devd
  257   253   253     0  S       (threaded)                  python3.11
100100                   S       accept  0xfffff8000ad52a10  python3.11
  253     1   253     0  Ss      wait    0xfffffe0008d8d5a0  python3.11
   19     0     0     0  DL      syncer  0xffffffff81bfe6a8  [syncer]
   18     0     0     0  DL      vlruwt  0xfffffe0008dd4020  [vnlru]
   17     0     0     0  DL      (threaded)                  [bufdaemon]
100093                   D       psleep  0xffffffff81bfd6a8  [bufdaemon]
100094                   D       -       0xffffffff81802100  [bufspacedaemon-0]
100095                   D       -       0xffffffff81802380  [bufspacedaemon-1]
100108                   D       sdflush 0xfffff8000ab1c8e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff81c32dd0  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100089                   D       psleep  0xffffffff81c1b238  [dom0]
100090                   D       launds  0xffffffff81c1b244  [laundry: dom0]
100092                   D       umarcl  0xffffffff80f4fe20  [uma]
    7     0     0     0  DL      -       0xffffffff819c9870  [rand_harvestq]
   16     0     0     0  DL      tzpoll  0xffffffff819c0478  [acpi_thermal]
    6     0     0     0  DL      pftm    0xffffffff821c19d0  [pf purge]
   15     0     0     0  DL      (threaded)                  [usb]
100063                   D       -       0xfffffe006a1ec440  [usbus0]
100064                   D       -       0xfffffe006a1ec498  [usbus0]
100065                   D       -       0xfffffe006a1ec4f0  [usbus0]
100066                   D       -       0xfffffe006a1ec548  [usbus0]
100067                   D       -       0xfffffe006a1ec5a0  [usbus0]
100070                   D       -       0xfffffe006a050cf0  [usbus1]
100071                   D       -       0xfffffe006a050d48  [usbus1]
100072                   D       -       0xfffffe006a050da0  [usbus1]
100073                   D       -       0xfffffe006a050df8  [usbus1]
100074                   D       -       0xfffffe006a050e50  [usbus1]
    5     0     0     0  DL      -       0xffffffff81c3d358  [busdma]
    4     0     0     0  DL      (threaded)                  [cam]
100056                   D       -       0xffffffff8199b240  [doneq0]
100057                   D       -       0xffffffff8199b1c0  [async]
100088                   D       -       0xffffffff8199b090  [scanner]
    3     0     0     0  DL      (threaded)                  [crypto]
100051                   D       crypto_ 0xffffffff81c186f0  [crypto]
100052                   D       crypto_ 0xfffff80003769c30  [crypto returns 0]
100053                   D       crypto_ 0xfffff80003769c80  [crypto returns 1]
100054                   D       crypto_ 0xfffff80003769cd0  [crypto returns 2]
100055                   D       crypto_ 0xfffff80003769d20  [crypto returns 3]
   14     0     0     0  DL      seqstat 0xfffff80003763088  [sequencer 00]
   13     0     0     0  DL      (threaded)                  [geom]
100043                   D       -       0xffffffff81b80228  [g_event]
100044                   D       -       0xffffffff81b80230  [g_up]
100045                   D       -       0xffffffff81b80238  [g_down]
    2     0     0     0  RL      (threaded)                  [clock]
100037                   Run     CPU 1                       [clock (0)]
100038                   I                                   [clock (1)]
100039                   I                                   [clock (2)]
100040                   I                                   [clock (3)]
   12     0     0     0  WL      (threaded)                  [intr]
100018                   I                                   [swi6: task queue]
100019                   I                                   [swi6: Giant taskq]
100021                   I                                   [swi5: fast taskq]
100041                   I                                   [swi1: netisr 0]
100059                   I                                   [irq40: ath0]
100062                   I                                   [irq68: xhci0]
100068                   I                                   [irq19: ahci0]
100069                   I                                   [irq18: ehci0]
100075                   I                                   [irq16: sdhci_pci0]
100076                   I                                   [swi0: uart uart]
100079                   I                                   [swi1: pf send]
100080                   I                                   [swi1: pfsync]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   Run     CPU 0                       [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
100005                   Run     CPU 2                       [idle: cpu2]
100006                   CanRun                              [idle: cpu3]
    1     0     1     0  SLs     wait    0xfffffe0008ca3040  [init]
   10     0     0     0  DL      audit_w 0xffffffff81c18be0  [audit]
    0     0     0     0  RLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff81b807b8  [swapper]
100007                   D       -       0xfffff8000358db00  [softirq_0]
100008                   D       -       0xfffff8000358d900  [softirq_1]
100009                   D       -       0xfffff8000358d700  [softirq_2]
100010                   D       -       0xfffff8000358d500  [softirq_3]
100011                   D       -       0xfffff8000358d300  [if_io_tqg_0]
100012                   D       -       0xfffff8000358d100  [if_io_tqg_1]
100013                   D       -       0xfffff8000358ce00  [if_io_tqg_2]
100014                   D       -       0xfffff8000358cc00  [if_io_tqg_3]
100015                   D       -       0xfffff8000358ca00  [if_config_tqg_0]
100016                   D       -       0xfffff8000358c800  [pci_hp taskq]
100017                   D       -       0xfffff8000358c600  [kqueue_ctx taskq]
100020                   D       -       0xfffff80003186d00  [thread taskq]
100022                   D       -       0xfffff80003186800  [aiod_kick taskq]
100023                   D       -       0xfffff80003186600  [deferred_unmount ta]
100024                   D       -       0xfffff80003186400  [inm_free taskq]
100025                   D       -       0xfffff80003186200  [in6m_free taskq]
100026                   D       -       0xfffff8000359f400  [linuxkpi_irq_wq]
100027                   D       -       0xfffff8000359f200  [linuxkpi_short_wq_0]
100028                   D       -       0xfffff8000359f200  [linuxkpi_short_wq_1]
100029                   D       -       0xfffff8000359f200  [linuxkpi_short_wq_2]
100030                   D       -       0xfffff8000359f200  [linuxkpi_short_wq_3]
100031                   D       -       0xfffff8000359f200  [linuxkpi_short_wq_4]
100032                   D       -       0xfffff8000359eb00  [linuxkpi_long_wq_0]
100033                   D       -       0xfffff8000359eb00  [linuxkpi_long_wq_1]
100034                   D       -       0xfffff8000359eb00  [linuxkpi_long_wq_2]
100035                   D       -       0xfffff8000359eb00  [linuxkpi_long_wq_3]
100036                   D       -       0xfffff8000359eb00  [linuxkpi_long_wq_4]
100042                   D       -       0xfffff8000359dc00  [firmware taskq]
100047                   D       -       0xfffff8000359c400  [crypto_0]
100048                   D       -       0xfffff8000359c400  [crypto_1]
100049                   D       -       0xfffff8000359c400  [crypto_2]
100050                   D       -       0xfffff8000359c400  [crypto_3]
100060                   D       -       0xfffff80003918600  [ath0 taskq]
100061                   Run     CPU 3                       [ath0 net80211 taskq]
100077                   D       -       0xfffff8000368c600  [ip_mroute_tskq task]
100081                   D       -       0xfffff8000a7f0400  [acpi_task_0]
100082                   D       -       0xfffff8000a7f0400  [acpi_task_1]
100083                   D       -       0xfffff8000a7f0400  [acpi_task_2]
100086                   D       -       0xfffff80003184c00  [mca taskq]
100087                   D       -       0xfffff80003839600  [CAM taskq]
100098                   D       -       0xfffff80003659c00  [/ trim]
11647 93608 11647     0  Z                                   cron
db:0:kdb.enter.default>  alltrace

Tracing command kernel pid 0 tid 100000 td 0xffffffff81b80d20
sched_switch() at sched_switch+0x88a/frame 0xffffffff824dfec0
mi_switch() at mi_switch+0xbb/frame 0xffffffff824dfee0
sleepq_timedwait() at sleepq_timedwait+0x2f/frame 0xffffffff824dff20
_sleep() at _sleep+0x1c8/frame 0xffffffff824dffa0
swapper() at swapper+0x69/frame 0xffffffff824dfff0
...


Best,
KiwiEater

Hi there,

yes, I saw the broken filesystem issue, and I'm about to fix it now.

But this was not the cuase, but the effect of the above problem. The root cause is an issue with the WLAN card kernel module/driver. There's a bug that causes OPNsense to crash when configuring a wle200nx card...

The corrupted FS is the result of countless crashes and subsequent reboots.

Best,
Raimund

Hi there,

just for completeness' sake: the box booted the regular 25.1 kernel without issues after the wireless card had been removed.

Best,
KiwiEater

Hi again,

as a last resort, I tried booting with the older kernel. Unfortunately that also doesn;t let me boot the box. Keels over here:

...
Trying to mount root from ufs:/dev/ada0p2 [rw]...
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <AMD EHCI root HUB> at usbus1
uhub1 on usbus1
uhub1: <AMD EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SATA SSD SBFM01.3> ACS-4 ATA SATA 3.x device
ada0: Serial Number 02AF0701082500349862
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 28626MB (58626288 512 byte sectors)
uhub0: 4 ports with 4 removable, self powered
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: usbus1
ugen1.2: <vendor 0x0438 product 0x7900> at usbus1
uhub2 on uhub1
uhub2: <vendor 0x0438 product 0x7900, class 9/0, rev 2.00/0.18, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered
WARNING: / was not properly dismounted
WARNING: /: mount pending error: blocks 176 files 11
Dual Console: Video Primary, Serial Secondary

(nothing happening at this stage)





I guess I'll just give uop on this matter. Ill tell my remote hands person to yank out the Wireless card altogether to see if the box will boot then. If that also fails I'll reinstall the box tomorrow. Lucky I pulled the config before trying to set up wireless interface...

Best,
KiwiEater

Hi there,

just tried single user mode, that does not crash, but the boot just stops and nothing happens anymore after this point:

...
uhub1 on usbus1
uhub1: <AMD EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
Dual Console: Video Primary, Serial Secondary
uhub0: 4 ports with 4 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen1.2: <vendor 0x0438 product 0x7900> at usbus1
uhub2 on uhub1
uhub2: <vendor 0x0438 product 0x7900, class 9/0, rev 2.00/0.18, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered


Best,
KiwiEater

Hi there,

I just set up two APU4 boxes with OpnSense 25.1. Both have been running previous versions of OPNsense for years without problems.

One runs smoothly (has no wireless card (wle200nx) in it.

The other one has a wle200nx. This one crashes immediately when I enable WPA and then set "Both" for WPA and WPA2 and then click "Apply". Repeated this about three times, but the last time it seems to have written something to the config, now it does not boot at all anymore (appears to start and then runs into a crash). Will further investigate when a serial console cable has been connected (device is remote)...

Is this a known issue? Any changes in the kernel module in the underlying FreeBSD perhaps?

Best,
KiwiEater



Here are the gory details:



   ______               ____   _____ _____
  |  ____|             |  _ \ / ____|  __ \
  | |___ _ __ ___  ___ | |_) | (___ | |  | |
  |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |
  | |   | | |  __/  __/| |_) |____) | |__| |
  | |   | | |    |    ||     |      |      |
  |_|   |_|  \___|\___||____/|_____/|_____/      ```                        `
                                                s` `.....---.......--.```   -/
 ╔══════════ Welcome to FreeBSD  ══════════     +o   .--`         /y:`      +.
 ║                                         ║     yo`:.            :o      `+-
 ║  1. Boot Multi user [Enter]             ║      y/               -/`   -o/
 ║  2. Boot Single user                    ║     .-                  ::/sy+:.
 H║ 3. Escape to loader prompt             ║     /                     `--  /
 ║  4. Reboot                              ║    `:                          :`
 ║  5. Cons: Serial                        ║    `:                          :`
 ║                                         ║   48H  /                          /
 ║  Options:                               ║     .-                        -.
 ║  6. Kernel: default/kernel (1 of 2)     ║      --                      -.
 ║  7. Boot Options                        ║       `:`                  `:`
 ║                                         ║         .--             `--.
 ║                                         ║            .---.....----.
 ╚═════════════════════════════════════════


 oading kernel...     0x8+0x1a1c90+0x8+0x1c6c3f  ext=0x45e00c data=0x180+0xe80 d
 oading configured modules... ce8 -
 etc/hostid size=0x25
 boot/entropy size=0x1000
KDB: debugger backends: ddb
KDB: current backend: ddb
---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.2-RELEASE stable/25.1-n269614-36155813721 SMP amd64
FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)
VT(vga): resolution 640x480
CPU: AMD GX-412TC SOC                                (998.17-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x730f01  Family=0x16  Model=0x30  Stepping=1
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x3ed8220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD Features2=0x1d4037ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,Topology,PNXC,DBE,PTSC,PL2I>
  Structured Extended Features=0x8<BMI1>
  XSAVE Features=0x1<XSAVEOPT>
  SVM: NP,NRIP,AFlush,DAssist,NAsids=8
  TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 4099764224 (3909 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <COREv4 COREBOOT>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: unblocking device.
ioapic1: MADT APIC ID 5 != hw id 0
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 2 1 3
random: entropy device external interface
wlan: mac acl policy registered
kbd0 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0xf3b20-0xf3b3e
smbios0: Version: 2.8
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS>
acpi0: <COREv4 COREBOOT>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
apei0: <ACPI Platform Error Interface> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x818-0x81b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> irq 24 at device 2.1 on pci0
pcib1: failed to allocate initial I/O port window: 0x1000-0x1fff
pci1: <ACPI PCI bus> on pcib1
igb0: <Intel(R) I211 (Copper)> port 0x2000-0x201f mem 0xf7800000-0xf781ffff,0xf7820000-0xf7823fff irq 24 at device 0.0 on pci1
igb0: NVM V0.6 imgtype1
igb0: Using 1024 TX descriptors and 1024 RX descriptors
igb0: Using 2 RX queues 2 TX queues
igb0: Using MSI-X interrupts with 3 vectors
igb0: Ethernet address: 00:0d:b9:55:b6:cc
igb0: netmap queues/slots: TX 2/1024, RX 2/1024
pcib2: <ACPI PCI-PCI bridge> irq 25 at device 2.2 on pci0
pcib2: failed to allocate initial I/O port window: 0x2000-0x2fff
pci2: <ACPI PCI bus> on pcib2
igb1: <Intel(R) I211 (Copper)> port 0x3000-0x301f mem 0xf7900000-0xf791ffff,0xf7920000-0xf7923fff irq 28 at device 0.0 on pci2
igb1: NVM V0.6 imgtype1
igb1: Using 1024 TX descriptors and 1024 RX descriptors
igb1: Using 2 RX queues 2 TX queues
igb1: Using MSI-X interrupts with 3 vectors
igb1: Ethernet address: 00:0d:b9:55:b6:cd
igb1: netmap queues/slots: TX 2/1024, RX 2/1024
pcib3: <ACPI PCI-PCI bridge> irq 26 at device 2.3 on pci0
pcib3: failed to allocate initial I/O port window: 0x3000-0x3fff
pci3: <ACPI PCI bus> on pcib3
igb2: <Intel(R) I211 (Copper)> port 0x4000-0x401f mem 0xf7a00000-0xf7a1ffff,0xf7a20000-0xf7a23fff irq 32 at device 0.0 on pci3
igb2: NVM V0.6 imgtype1
igb2: Using 1024 TX descriptors and 1024 RX descriptors
igb2: Using 2 RX queues 2 TX queues
igb2: Using MSI-X interrupts with 3 vectors
igb2: Ethernet address: 00:0d:b9:55:b6:ce
igb2: netmap queues/slots: TX 2/1024, RX 2/1024
pcib4: <ACPI PCI-PCI bridge> irq 27 at device 2.4 on pci0
pcib4: failed to allocate initial I/O port window: 0x4000-0x4fff
pci4: <ACPI PCI bus> on pcib4
igb3: <Intel(R) I211 (Copper)> port 0x6000-0x601f mem 0xf7b00000-0xf7b1ffff,0xf7b20000-0xf7b23fff irq 36 at device 0.0 on pci4
igb3: NVM V0.6 imgtype1
igb3: Using 1024 TX descriptors and 1024 RX descriptors
igb3: Using 2 RX queues 2 TX queues
igb3: Using MSI-X interrupts with 3 vectors
igb3: Ethernet address: 00:0d:b9:55:b6:cf
igb3: netmap queues/slots: TX 2/1024, RX 2/1024
pcib5: <ACPI PCI-PCI bridge> irq 24 at device 2.5 on pci0
pci5: <ACPI PCI bus> on pcib5
ath0: <Atheros 9280> mem 0xf7c00000-0xf7c0ffff irq 40 at device 0.0 on pci5
[ath] enabling AN_TOP2_FIXUP
ath0: [HT] enabling HT modes
ath0: [HT] 1 stream STBC receive enabled
ath0: [HT] 1 stream STBC transmit enabled
ath0: [HT] 2 RX streams; 2 TX streams
ath0: AR9280 mac 128.2 RF5133 phy 13.0
ath0: 2GHz radio: 0x0000; 5GHz radio: 0x00c0
pci0: <encrypt/decrypt> at device 8.0 (no driver attached)
xhci0: <AMD FCH USB 3.0 controller> mem 0xf7f22000-0xf7f23fff irq 18 at device 16.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ahci0: <AMD Hudson-2 AHCI SATA controller> port 0x5010-0x5017,0x5020-0x5023,0x5018-0x501f,0x5024-0x5027,0x5000-0x500f mem 0xf7f25000-0xf7f2530
ahci0: AHCI v1.30 with 2 6Gbps ports, Port Multiplier supported with FBS
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ehci0: <AMD FCH USB 2.0 controller> mem 0xf7f26000-0xf7f260ff irq 18 at device 19.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
sdhci_pci0: <Generic SD HCI> mem 0xf7f27000-0xf7f270ff at device 20.7 on pci0
sdhci_pci0: 1 slot(s) allocated
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROM> at iomem 0xee800-0xeffff pnpid ORM0000 on isa0
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC" frequency 998128628 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <AMD XHCI root HUB> at usbus0
ugen1.1: <AMD EHCI root HUB> at usbus1
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
Trying to mount root from ufs:/dev/ada0p2 [rw]...
uhub1 on usbus1
uhub1: <AMD EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <SATA SSD SBFM01.3> ACS-4 ATA SATA 3.x device
ada0: Serial Number 02AF0701082500349862
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 28626MB (58626288 512 byte sectors)
uhub0: 4 ports with 4 removable, self powered
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: usbus1
ugen1.2: <vendor 0x0438 product 0x7900> at usbus1
uhub2 on uhub1
uhub2: <vendor 0x0438 product 0x7900, class 9/0, rev 2.00/0.18, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered
WARNING: / was not properly dismounted
WARNING: /: mount pending error: blocks 176 files 71
Dual Console: Video Primary, Serial Secondary
igb0: link state changed to UP
igb3: link state changed to UP
intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci0
smbus0: <System Management Bus> on intsmb0
lo0: link state changed to UP


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0xffff
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff80d5faed
stack pointer           = 0x28:0xfffffe00627a5cd0
frame pointer           = 0x28:0xfffffe00627a5d00
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 0 (ath0 net80211 taskq)
rdi: 0000000000040000 rsi: 0000000000000001 rdx: 000000000000ffff
rcx: 00000000400c2408  r8: 0000000000000000  r9: 0000000000000000
rax: fffff8005dc20942 rbx: fffff80008732000 rbp: fffffe00627a5d00
r10: 0000000000000000 r11: 000007fffffff000 r12: fffffe00087b2000
r13: fffff8005dc20938 r14: fffff80008732000 r15: fffffe0088671000
trap number             = 12
panic: page fault
cpuid = 0
time = 1738747561
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00627a59c0
vpanic() at vpanic+0x131/frame 0xfffffe00627a5af0
panic() at panic+0x43/frame 0xfffffe00627a5b50
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe00627a5bb0
trap_pfault() at trap_pfault+0x46/frame 0xfffffe00627a5c00
calltrap() at calltrap+0x8/frame 0xfffffe00627a5c00
--- trap 0xc, rip = 0xffffffff80d5faed, rsp = 0xfffffe00627a5cd0, rbp = 0xfffffe00627a5d00 ---
ieee80211_beacon_construct() at ieee80211_beacon_construct+0x7d/frame 0xfffffe00627a5d00
ieee80211_beacon_alloc() at ieee80211_beacon_alloc+0xb3/frame 0xfffffe00627a5d40
ath_beacon_alloc() at ath_beacon_alloc+0x84/frame 0xfffffe00627a5d80
ath_newstate() at ath_newstate+0x3f2/frame 0xfffffe00627a5df0
ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1fc/frame 0xfffffe00627a5e40
taskqueue_run_locked() at taskqueue_run_locked+0x182/frame 0xfffffe00627a5ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00627a5ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00627a5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00627a5f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 0 tid 100061 ]
Stopped at      kdb_enter+0x33: movq    $0,0xfd08d2(%rip)
db:0:kdb.enter.default> textdump set
...

 :) Thanks, that did the trick!

Hi there,

I'm facing a weird VLAN issue. Perhaps someone here would be able to shed some light on this?:

My hardware is a PCengines APU4 with 4 NICS where igb0 is used for WAN (working fine). igb1-3 are meant to be used as LAN resp. VLAN ports. To keep things simple, I'm only looking at a single VLAN (ID 120) for now.

I've set up VLAN interfaces for ibg1-3:

igb1_vlan120: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
   options=4000000<NOMAP>
   ether 00:0d:b9:55:b6:cd
   groups: vlan
   vlan: 120 vlanproto: 802.1q vlanpcp: 0 parent interface: igb1
   media: Ethernet autoselect
   status: no carrier
   nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
igb2_vlan120: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
   options=4000000<NOMAP>
   ether 00:0d:b9:55:b6:ce
   groups: vlan
   vlan: 120 vlanproto: 802.1q vlanpcp: 0 parent interface: igb2
   media: Ethernet autoselect (1000baseT <full-duplex>)
   status: active
   nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
igb3_vlan120: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
   options=4000000<NOMAP>
   ether 00:0d:b9:55:b6:cf
   groups: vlan
   vlan: 120 vlanproto: 802.1q vlanpcp: 0 parent interface: igb3
   media: Ethernet autoselect
   status: no carrier
   nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

Only one cable is currently plugged into port igb2 ("status: active").

Furthermore, I bridged those VLAN interfaces and configured a static IP 172.19.26.254 on that bridge:

bridge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
   ether 58:9c:fc:10:bc:0d
   inet 172.19.26.254 netmask 0xffffff00 broadcast 172.19.26.255
   id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
   maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
   root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
   member: ath0_wlan2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 10 priority 128 path cost 33333
   member: igb3_vlan120 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 17 priority 128 path cost 2000000
   member: igb2_vlan120 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 16 priority 128 path cost 20000
   member: igb1_vlan120 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 15 priority 128 path cost 2000000
   groups: bridge
   nd6 options=9<PERFORMNUD,IFDISABLED>

To configure a guest LAN, I did made another bridge with the 'naked' (non VLAN) interfaces igb1-3, with a different IP, 172.20.26.254:

bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
   ether 58:9c:fc:10:ff:cc
   inet 172.20.26.254 netmask 0xffffff00 broadcast 172.20.26.255
   id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
   maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
   root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
   member: ath0_wlan1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 9 priority 128 path cost 33333
   member: igb3 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 4 priority 128 path cost 2000000
   member: igb2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 3 priority 128 path cost 20000
   member: igb1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 2 priority 128 path cost 2000000
   groups: bridge
   nd6 options=9<PERFORMNUD,IFDISABLED>

There's a DHCP server running on both bridges.

At the other end of that single Ethernet wire, a Linux machine is connected. That machine has two configurations for the NIC, one with VLAN 120, the other without:

3: enp1s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 9c:8e:99:2a:e9:a6 brd ff:ff:ff:ff:ff:ff
    inet 172.20.26.199/24 brd 172.20.26.255 scope global dynamic noprefixroute enp1s0f1
       valid_lft 3993sec preferred_lft 3993sec
    inet6 fe80::9e8e:99ff:fe2a:e9a6/64 scope link
       valid_lft forever preferred_lft forever
5: enp1s0f1.120@enp1s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 9c:8e:99:2a:e9:a6 brd ff:ff:ff:ff:ff:ff
    inet 172.19.26.199/24 brd 172.19.26.255 scope global dynamic noprefixroute enp1s0f1.120
       valid_lft 3993sec preferred_lft 3993sec
    inet6 fe80::9e8e:99ff:fe2a:e9a6/64 scope link
       valid_lft forever preferred_lft forever

Both interfaces receive the assigned IP 199 from the DCHP servers.

The Linux computer can only ping the non-VLAN bridge, however:

# ping 172.20.26.254
PING 172.20.26.254 (172.20.26.254) 56(84) bytes of data.
64 bytes from 172.20.26.254: icmp_seq=1 ttl=64 time=0.493 ms
64 bytes from 172.20.26.254: icmp_seq=2 ttl=64 time=0.418 ms
...

# ping 172.19.26.254
PING 172.19.26.254 (172.19.26.254) 56(84) bytes of data.
^C
--- 172.19.26.254 ping statistics ---
4 packets transmitted, 0 received, 100% packet loss, time 3070ms

So I started drilling a bit deeper using tcpdump. I kept running the second ping above from the computer to the firewall's bridged VLAN interface (i.e., 172.19.26.254) and observed what I get to see on the VLAN,Non-VLAN interfaces on both the computer and the firewall. I'll start with the computer side:

# tcpdump -XXnni enp1s0f1 icmp
21:49:57.915044 IP 172.19.26.199 > 172.19.26.254: ICMP echo request, id 2843, seq 3203, length 64
        0x0000:  589c fc10 bc0d 9c8e 992a e9a6 8100 0078  X........*.....x
        0x0010:  0800 4500 0054 b12f 4000 4001 fb8d ac13  ..E..T./@.@.....
        0x0020:  1ac7 ac13 1afe 0800 dbbf 0b1b 0c83 b576  ...............v
        0x0030:  4162 0000 0000 41f6 0d00 0000 0000 1011  Ab....A.........
        0x0040:  1213 1415 1617 1819 1a1b 1c1d 1e1f 2021  ...............!
        0x0050:  2223 2425 2627 2829 2a2b 2c2d 2e2f 3031  "#$%&'()*+,-./01
        0x0060:  3233 3435 3637                           234567

This looks ok to me: I was expecting to see the "8100 0078" bit: 8100 indicating this is a VLAN frame and 0078 being the hexadecimal version of VLAN ID 120. So far so good.

Here's the same tcpdump, this time on the computer's VLAN interface:

# tcpdump -XXnni enp1s0f1.120 icmp
21:52:46.875030 IP 172.19.26.199 > 172.19.26.254: ICMP echo request, id 2843, seq 3368, length 64
        0x0000:  589c fc10 bc0d 9c8e 992a e9a6 0800 4500  X........*....E.
        0x0010:  0054 f4d8 4000 4001 b7e4 ac13 1ac7 ac13  .T..@.@.........
        0x0020:  1afe 0800 77b6 0b1b 0d28 5e77 4162 0000  ....w....(^wAb..
        0x0030:  0000 fc59 0d00 0000 0000 1011 1213 1415  ...Y............
        0x0040:  1617 1819 1a1b 1c1d 1e1f 2021 2223 2425  ...........!"#$%
        0x0050:  2627 2829 2a2b 2c2d 2e2f 3031 3233 3435  &'()*+,-./012345
        0x0060:  3637                                     67

This is also what I would expect to see: The OS has stripped away the VLAN information "8100 0078" from the previous dump, just leaving "0800 4500", the normal Ethertype followed by the beginning of the IP header.



Now here's the OPNSense side of things, same tcpdump again, first on the non-VLAN interface igb2:

# tcpdump -XXnni igb2
21:56:06.554127 IP 172.19.26.199 > 172.19.26.254: ICMP echo request, id 2843, seq 3563, length 64
   0x0000:  589c fc10 bc0d 9c8e 992a e9a6 8100 0078  X........*.....x
   0x0010:  0800 4500 0054 6680 4000 4001 463d ac13  ..E..Tf.@.@.F=..
   0x0020:  1ac7 ac13 1afe 0800 a8d4 0b1b 0deb 2678  ..............&x
   0x0030:  4162 0000 0000 0778 0800 0000 0000 1011  Ab.....x........
   0x0040:  1213 1415 1617 1819 1a1b 1c1d 1e1f 2021  ...............!
   0x0050:  2223 2425 2627 2829 2a2b 2c2d 2e2f 3031  "#$%&'()*+,-./01
   0x0060:  3233 3435 3637                           234567

Again, looks good, the packets from 172.19.26.199 arrive apparently. However, the VLAN stripping observed on the Linux side does not seem to happen on the OPNSense side, as the ICMP packes do not appear on igb2's VLAN 120 sub-interface, only occasionally some ARP traffic appears there:

# tcpdump -XXnni igb2_vlan120
21:58:57.562510 ARP, Request who-has 172.19.26.254 tell 172.19.26.199, length 42
   0x0000:  ffff ffff ffff 9c8e 992a e9a6 0806 0001  .........*......
   0x0010:  0800 0604 0001 9c8e 992a e9a6 ac13 1ac7  .........*......
   0x0020:  0000 0000 0000 ac13 1afe 0000 0000 0000  ................
   0x0030:  0000 0000 0000 0000                      ........
21:58:57.562604 ARP, Reply 172.19.26.254 is-at 58:9c:fc:10:bc:0d, length 28
   0x0000:  9c8e 992a e9a6 589c fc10 bc0d 0806 0001  ...*..X.........
   0x0010:  0800 0604 0002 589c fc10 bc0d ac13 1afe  ......X.........
   0x0020:  9c8e 992a e9a6 ac13 1ac7                 ...*......

The firewall is completely open on igb2, igb2_vlan120 and bridge1, so I do not suspect it to interfere here. I even tried disabling the packet filter completly using pfctl -d to be 100% sure the filter is not getting me here...

So my questions would be:

  * Am I doing something obviously wrong here?
  * Why do I not get to see any ICMP traffic on the firewall's igb2_vlan120 interface?
  * While ICMP traffic does not appear to work, the Linux machine still gets its DHCP configuration successfully on both interface, so DHCP at least seems fine.

Best,
Kiwieater

Thanks! That did the trick.

Did not dare this before, as the statement "The root user login behaviour will be restored to its defaults" could mean that any present authorized_keys would also be wiped away and my access would then be completely lost.

However: The SSH key survived   :)

All good.

Best,
KiwiEater

Hi there again,

I added another temporary user with adduser. Again, with a simple password. No luck: this user also can't login via Web UI.

Best
KiwiEater

Hi there,

I did not set up any other users on that device so far. Anyway, will try. And yes, the Web-GUI ist listening (Login page appears at leat).

Best,
KiwiEater

Hi there,

I'm facing a weird login problem on one of my OPNsense installations, running on a PCengines APU:

  - As user root, I can no longer log into the device using the web GUI. Each time I try, all I get is a red warning saying "Wrong username or password."
  - When I was still able to use the Web GUI a while ago, I placed my SSH Pubkey on the box for root, so I can log in very comfortably as root using SSH.

Using menu option 8 (Shell) I reset root's password usign 'passwd' to something super simple and restarted the box. Yet still I can't log into the box. Is there a way to fix this from the root shell?

BTW: I'm on the 21.7.5 release, which I think is the latest:

# opnsense-version
OPNsense 21.7.5 (amd64/OpenSSL)

Best,
KiwiEater

Thanks!

"opnsense-patch 7ef730ac"

taken from the discussion inthe github link above did the trick  :)

Best,
KiwiEater

[really suffering]

Hi there,

yesterday evening I upgraded from 21.1.5 to 21.1.6. After the upgrade the DNS registration (using unbound) of DHCP static maps no longer works. I only get NXDOMAIN responses when directly querying OPNSense's unbound using "dig @<opensense-fw> <DHCP-static-map hostname>.<DHCP-static-map domainname>". This always worked just fine before.

In the changelog for 21.1.6 I see that something was changed with the registration of DHCP leases:

  "unbound: use dhcpd_staticmap() for lease registration"

If anyone here happens to be able to provide either

  * information on how to forward-fix this (preferred), or
  * information on which package(s) to downgrade (unbound? dhcpd? both?) as a temporary fix

that help would be greatly appreciated: I am really suffering from this: For instance, I had to hard-code the DB IP into my webmail-config, as DNS resolution of the DB host no longer worked. I use DNS all over the place and expect issues to pop up all over the place  :-\

Best,
KiwiEater

Hi there,

is there any solution for OPNsense to run one's own custom DynDNS service?

Consider this scenario:
  - A central OPNsense box running as a VPN concentrator with a static IP address, in Europe, for instance
  - A bunch of satellite sites using dynamic WAN addresses
  - If a user from remote satellite site A from New Zealand's South Island (for instance) wants to access another remote satellite site B on New Zealand's North Island, this would usually require connecting via the central VPN box, creating a HUGE latency.
  - If the central box would constantly be aware of all the client site's dynamic IP addresses, then client site A could ask for this information using DNS and then access site B directly.

Is it possible to achieve this using standard OPNsense?

Best,
Kiwieater