Fatal trap 12 and Fatal trap 9 since some weeks

[Patrick M. Hausen]

I was merely pointing out connections to an annoying bug which is open since years and 272319 gave the impression that it was finally fixed upstream.

Yes, and it's been finally committed to upstream in September 2024, part of releng/14.1. The commit to head was from November 2023, and cherry picked by OPNsense in that very same month:

https://github.com/opnsense/src/commit/09f4b840bd7cb6427af2a28a10bd839da6dd76d5

(just one of the three or so commits in question)

So that particular upstream fix has been part of OPNsense definitely for the entire life of 24.1 and 24.7. Any problem you might still experience is not related to that particular upstream issue.

HTH,
Patrick

[franco]

> Kind reminder: this goes way back to 2019 and is happening almost daily for me.

Yes, I'm ok with that reminder.  I'm also not hopeful your issue will mature in this forum.

Working on upstream issues with FreeBSD is improving, but I get the feeling some issues just aren't very appealing to the developers to spend their free time on.


Cheers,
Franco

[XJGR]

Hi, going to piggyback off of this post since I've been running into intermittent crash/reboot issues with these same two faults for a little now. I'm a newer user (few weeks) of OPNsense so some of this is still alien to me, but i've searched forums/posts/reddit and i've done all of the suggested fixes, with little to no positive result.

So far i've:
- Checked hardware (memtest86, monitored temps, physical and visual inspection), no issues. Temps under load remain under 50C most of the time.
- Uninstalled all unecessary packages, re-installed everything one-by-one.
- Disabled IPS/IDS, enabled IPS/IDS, no change.
- Checked power supply, seems fine; unit also doesn't lose power at any point.
- Full reformat and reinstallation of OPNsense
- Installed the suggested Intel microcode update package, even though I'm currently on a Celeron J1900 platform.

Current hardware used is a Qotom Q190G4N using the Celeron J1900 processor, with 8GB RAM loaded with OPNsense 24.7.11_2, ZFS installation.

The system crashes basically daily, with most runtimes lasting anywhere between 12 to slightly over 24 hours.

Crash log as follows:

Code Select Expand

---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.1-RELEASE-p6 stable/24.7-n267979-0d692990122 SMP amd64
FreeBSD clang version 18.1.5 (https://github.com/llvm/llvm-project.git llvmorg-18.1.5-0-g617a15a9eac9)
VT(efifb): resolution 800x600
CPU: Intel(R) Celeron(R) CPU  J1900  @ 1.99GHz (2000.08-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x30678  Family=0x6  Model=0x37  Stepping=8
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x41d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
  Structured Extended Features3=0xc000000<IBPB,STIBP>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 8088752128 (7714 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
WARNING: L1 data cache covers fewer APIC IDs than a core (0 < 1)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/32 (20221020/tbfadt-748)
ioapic0 <Version 2.0> irqs 0-86
Launching APs: 2 3 1
random: entropy device external interface
wlan: mac acl policy registered
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
smbios0: <System Management BIOS> at iomem 0xf05b0-0xf05ce
smbios0: Version: 3.0, BCD Revision: 3.0
aesni0: No AES or SHA support.
acpi0: <ALASKA A M I >
acpi0: Power Button (fixed)
unknown: I/O range not supported
cpu0: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x77 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xf080-0xf087 mem 0xd0000000-0xd03fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
ahci0: <AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xd0a16000-0xd0a167ff irq 19 at device 19.0 on pci0
ahci0: AHCI v1.30 with 2 3Gbps ports, Port Multiplier not supported
ahcich1: <AHCI channel> at channel 1 on ahci0
xhci0: <Intel BayTrail USB 3.0 controller> mem 0xd0a00000-0xd0a0ffff irq 20 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <encrypt/decrypt> at device 26.0 (no driver attached)
hdac0: <Intel BayTrail HDA Controller> mem 0xd0a10000-0xd0a13fff irq 22 at device 27.0 on pci0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
igb0: <Intel(R) I211 (Copper)> port 0xe000-0xe01f mem 0xd0900000-0xd091ffff,0xd0920000-0xd0923fff irq 16 at device 0.0 on pci1
igb0: NVM V0.6 imgtype1
igb0: Using 1024 TX descriptors and 1024 RX descriptors
igb0: Using 2 RX queues 2 TX queues
igb0: Using MSI-X interrupts with 3 vectors
igb0: Ethernet address: 40:62:31:03:3e:70
igb0: netmap queues/slots: TX 2/1024, RX 2/1024
pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.1 on pci0
pci2: <ACPI PCI bus> on pcib2
igb1: <Intel(R) I211 (Copper)> port 0xd000-0xd01f mem 0xd0800000-0xd081ffff,0xd0820000-0xd0823fff irq 17 at device 0.0 on pci2
igb1: NVM V0.6 imgtype1
igb1: Using 1024 TX descriptors and 1024 RX descriptors
igb1: Using 2 RX queues 2 TX queues
igb1: Using MSI-X interrupts with 3 vectors
igb1: Ethernet address: 40:62:31:03:3e:71
igb1: netmap queues/slots: TX 2/1024, RX 2/1024
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci3: <ACPI PCI bus> on pcib3
igb2: <Intel(R) I211 (Copper)> port 0xc000-0xc01f mem 0xd0700000-0xd071ffff,0xd0720000-0xd0723fff irq 16 at device 0.0 on pci3
igb2: NVM V0.6 imgtype1
igb2: Using 1024 TX descriptors and 1024 RX descriptors
igb2: Using 2 RX queues 2 TX queues
igb2: Using MSI-X interrupts with 3 vectors
igb2: Ethernet address: 40:62:31:03:3e:72
igb2: netmap queues/slots: TX 2/1024, RX 2/1024
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci4: <ACPI PCI bus> on pcib4
igb3: <Intel(R) I211 (Copper)> port 0xb000-0xb01f mem 0xd0600000-0xd061ffff,0xd0620000-0xd0623fff irq 19 at device 0.0 on pci4
igb3: NVM V0.6 imgtype1
igb3: Using 1024 TX descriptors and 1024 RX descriptors
igb3: Using 2 RX queues 2 TX queues
igb3: Using MSI-X interrupts with 3 vectors
igb3: Ethernet address: 40:62:31:03:3e:73
igb3: netmap queues/slots: TX 2/1024, RX 2/1024
ehci0: <Intel BayTrail USB 2.0 controller> mem 0xd0a15000-0xd0a153ff irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
acpi_button1: <Sleep Button> on acpi0
ns8250: UART FCR is broken
ns8250: UART FCR is broken
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 4 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
Timecounter "TSC" frequency 1999998814 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <Intel XHCI root HUB> at usbus0
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub0 on usbus0
uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub1 on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
hdacc0: <Intel Valleyview2 HDA CODEC> at cad 2 on hdac0
hdaa0: <Intel Valleyview2 Audio Function Group> at nid 1 on hdacc0
pcm0: <Intel Valleyview2 (HDMI/DP 8ch)> at nid 4 on hdaa0
ada0 at ahcich1 bus 0 scbus0 target 0 lun 0
ada0: <Hoodisk SSD SBFMBB.3> ACS-4 ATA SATA 3.x device
ada0: Serial Number L7MLCCC21204441
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 61057MB (125045424 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 7 ports with 7 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub1: 8 ports with 8 removable, self powered
Root mount waiting for: usbus1
ugen1.2: <vendor 0x8087 product 0x07e6> at usbus1
uhub2 on uhub1
uhub2: <vendor 0x8087 product 0x07e6, class 9/0, rev 2.00/0.14, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered
Root mount waiting for: usbus1
ugen1.3: <vendor 0x05e3 USB2.0 Hub> at usbus1
uhub3 on uhub2
uhub3: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/88.32, addr 3> on usbus1
uhub3: 4 ports with 4 removable, self powered
igb0: link state changed to UP
igb1: link state changed to UP
ichsmb0: <Intel Baytrail SMBus controller> port 0xf000-0xf01f mem 0xd0a14000-0xd0a1401f irq 18 at device 31.3 on pci0
smbus0: <System Management Bus> on ichsmb0
lo0: link state changed to UP
pflog0: permanently promiscuous mode enabled
igb0: link state changed to DOWN
igb1: link state changed to DOWN
igb0: link state changed to UP
igb1: link state changed to UP
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
arp: 10.84.92.10 moved from 04:d4:c4:48:23:be to 3c:7c:3f:2c:3c:43 on igb0
arp: 10.84.92.10 moved from 3c:7c:3f:2c:3c:43 to 04:d4:c4:48:23:be on igb0
igb0: promiscuous mode enabled
igb1: promiscuous mode enabled
lo0: promiscuous mode enabled
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
cannot forward src fe80:1::fa0f:f9ff:fe80:8551, dst 2001:4860:4860::8888, nxt 17, rcvif igb0, outif igb1
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded


Fatal trap 12: page fault while in kernel mode
cpuid = 3; apic id = 06
fault virtual address = 0x0
fault code = supervisor write data, page not present
instruction pointer = 0x20:0xffffffff82185d9c
stack pointer         = 0x28:0xfffffe008fc50e00
frame pointer         = 0x28:0xfffffe008fc50e30
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 7 (pf purge)
rdi: fffff80195307580 rsi: fffff80195307580 rdx: 00000000d655388b
rcx: 0000000000000000  r8: 0000000063335c3b  r9: 0000000000000000
rax: 0000000000000000 rbx: fffff8015252b420 rbp: fffffe008fc50e30
r10: 0000000000000000 r11: 00000000809b3429 r12: fffffe0090062000
r13: 000000000000c81e r14: fffff80195307580 r15: fffff80002892000
trap number = 12
panic: page fault
cpuid = 3
time = 1734599113
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008fc50af0
vpanic() at vpanic+0x131/frame 0xfffffe008fc50c20
panic() at panic+0x43/frame 0xfffffe008fc50c80
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe008fc50ce0
trap_pfault() at trap_pfault+0x46/frame 0xfffffe008fc50d30
calltrap() at calltrap+0x8/frame 0xfffffe008fc50d30
--- trap 0xc, rip = 0xffffffff82185d9c, rsp = 0xfffffe008fc50e00, rbp = 0xfffffe008fc50e30 ---
pf_detach_state() at pf_detach_state+0x5fc/frame 0xfffffe008fc50e30
pf_unlink_state() at pf_unlink_state+0x290/frame 0xfffffe008fc50e70
pf_purge_expired_states() at pf_purge_expired_states+0x188/frame 0xfffffe008fc50ec0
pf_purge_thread() at pf_purge_thread+0x13b/frame 0xfffffe008fc50ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe008fc50f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008fc50f30
--- trap 0x5f802e0e, rip = 0x8b9b863804e798c1, rsp = 0xf1ae7253ec31496c, rbp = 0xfa00650ec28a141b ---
KDB: enter: panic
---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.1-RELEASE-p6 stable/24.7-n267979-0d692990122 SMP amd64
FreeBSD clang version 18.1.5 (https://github.com/llvm/llvm-project.git llvmorg-18.1.5-0-g617a15a9eac9)
VT(efifb): resolution 800x600
CPU: Intel(R) Celeron(R) CPU  J1900  @ 1.99GHz (2000.08-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x30678  Family=0x6  Model=0x37  Stepping=8
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x41d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
  Structured Extended Features3=0xc000000<IBPB,STIBP>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 8088735744 (7714 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
WARNING: L1 data cache covers fewer APIC IDs than a core (0 < 1)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Gpe0Block: 128/32 (20221020/tbfadt-748)
ioapic0 <Version 2.0> irqs 0-86
Launching APs: 3 2 1
random: entropy device external interface
wlan: mac acl policy registered
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
smbios0: <System Management BIOS> at iomem 0xf05b0-0xf05ce
smbios0: Version: 3.0, BCD Revision: 3.0
aesni0: No AES or SHA support.
acpi0: <ALASKA A M I >
acpi0: Power Button (fixed)
unknown: I/O range not supported
cpu0: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x77 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xf080-0xf087 mem 0xd0000000-0xd03fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
ahci0: <AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xd0a16000-0xd0a167ff irq 19 at device 19.0 on pci0
ahci0: AHCI v1.30 with 2 3Gbps ports, Port Multiplier not supported
ahcich1: <AHCI channel> at channel 1 on ahci0
xhci0: <Intel BayTrail USB 3.0 controller> mem 0xd0a00000-0xd0a0ffff irq 20 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <encrypt/decrypt> at device 26.0 (no driver attached)
hdac0: <Intel BayTrail HDA Controller> mem 0xd0a10000-0xd0a13fff irq 22 at device 27.0 on pci0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
igb0: <Intel(R) I211 (Copper)> port 0xe000-0xe01f mem 0xd0900000-0xd091ffff,0xd0920000-0xd0923fff irq 16 at device 0.0 on pci1
igb0: NVM V0.6 imgtype1
igb0: Using 1024 TX descriptors and 1024 RX descriptors
igb0: Using 2 RX queues 2 TX queues
igb0: Using MSI-X interrupts with 3 vectors
igb0: Ethernet address: 40:62:31:03:3e:70
igb0: netmap queues/slots: TX 2/1024, RX 2/1024
pcib2: <ACPI PCI-PCI bridge> irq 17 at device 28.1 on pci0
pci2: <ACPI PCI bus> on pcib2
igb1: <Intel(R) I211 (Copper)> port 0xd000-0xd01f mem 0xd0800000-0xd081ffff,0xd0820000-0xd0823fff irq 17 at device 0.0 on pci2
igb1: NVM V0.6 imgtype1
igb1: Using 1024 TX descriptors and 1024 RX descriptors
igb1: Using 2 RX queues 2 TX queues
igb1: Using MSI-X interrupts with 3 vectors
igb1: Ethernet address: 40:62:31:03:3e:71
igb1: netmap queues/slots: TX 2/1024, RX 2/1024
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci3: <ACPI PCI bus> on pcib3
igb2: <Intel(R) I211 (Copper)> port 0xc000-0xc01f mem 0xd0700000-0xd071ffff,0xd0720000-0xd0723fff irq 16 at device 0.0 on pci3
igb2: NVM V0.6 imgtype1
igb2: Using 1024 TX descriptors and 1024 RX descriptors
igb2: Using 2 RX queues 2 TX queues
igb2: Using MSI-X interrupts with 3 vectors
igb2: Ethernet address: 40:62:31:03:3e:72
igb2: netmap queues/slots: TX 2/1024, RX 2/1024
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci4: <ACPI PCI bus> on pcib4
igb3: <Intel(R) I211 (Copper)> port 0xb000-0xb01f mem 0xd0600000-0xd061ffff,0xd0620000-0xd0623fff irq 19 at device 0.0 on pci4
igb3: NVM V0.6 imgtype1
igb3: Using 1024 TX descriptors and 1024 RX descriptors
igb3: Using 2 RX queues 2 TX queues
igb3: Using MSI-X interrupts with 3 vectors
igb3: Ethernet address: 40:62:31:03:3e:73
igb3: netmap queues/slots: TX 2/1024, RX 2/1024
ehci0: <Intel BayTrail USB 2.0 controller> mem 0xd0a15000-0xd0a153ff irq 23 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
acpi_button0: <Power Button> on acpi0
acpi_button1: <Sleep Button> on acpi0
ns8250: UART FCR is broken
ns8250: UART FCR is broken
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 4 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
Timecounter "TSC" frequency 1999999368 Hz quality 1000
Timecounters tick every 1.000 msec
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen0.1: <Intel XHCI root HUB> at usbus0
uhub0 on usbus1
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1 on usbus0
uhub1: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
hdacc0: <Intel Valleyview2 HDA CODEC> at cad 2 on hdac0
hdaa0: <Intel Valleyview2 Audio Function Group> at nid 1 on hdacc0
pcm0: <Intel Valleyview2 (HDMI/DP 8ch)> at nid 4 on hdaa0
ada0 at ahcich1 bus 0 scbus0 target 0 lun 0
ada0: <Hoodisk SSD SBFMBB.3> ACS-4 ATA SATA 3.x device
ada0: Serial Number L7MLCCC21204441
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 61057MB (125045424 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub1: 7 ports with 7 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub0: 8 ports with 8 removable, self powered
Root mount waiting for: usbus1
ugen1.2: <vendor 0x8087 product 0x07e6> at usbus1
uhub2 on uhub0
uhub2: <vendor 0x8087 product 0x07e6, class 9/0, rev 2.00/0.14, addr 2> on usbus1
uhub2: 4 ports with 4 removable, self powered
Root mount waiting for: usbus1
ugen1.3: <vendor 0x05e3 USB2.0 Hub> at usbus1
uhub3 on uhub2
uhub3: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/88.32, addr 3> on usbus1
uhub3: 4 ports with 4 removable, self powered
igb0: link state changed to UP
igb1: link state changed to UP
ichsmb0: <Intel Baytrail SMBus controller> port 0xf000-0xf01f mem 0xd0a14000-0xd0a1401f irq 18 at device 31.3 on pci0
smbus0: <System Management Bus> on ichsmb0
lo0: link state changed to UP
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
pflog0: permanently promiscuous mode enabled
igb0: link state changed to DOWN
igb1: link state changed to DOWN
igb0: link state changed to UP
igb1: link state changed to UP
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
igb0: promiscuous mode enabled
igb1: promiscuous mode enabled
lo0: promiscuous mode enabled


Fatal trap 9: general protection fault while in kernel mode
cpuid = 0; apic id = 00
instruction pointer = 0x20:0xffffffff8109fa60
stack pointer         = 0x0:0xfffffe000edce660
frame pointer         = 0x0:0xfffffe000edce660
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 0 (if_io_tqg_0)
rdi: 80000001746d6c67 rsi: fffffe000edce6c0 rdx: 0000000000000028
rcx: 000000000009a5d8  r8: 000000000000000a  r9: 000000000d5c540a
rax: 0000000000000000 rbx: fffff8000169e740 rbp: fffffe000edce660
r10: 00000000d32b8b8b r11: 000000000000eb20 r12: fffffe000edce6c0
r13: 80000001746d6c67 r14: fffff8000278bc00 r15: fffffe0090060000
trap number = 9
panic: general protection fault
cpuid = 0
time = 1734617040
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000edce3a0
vpanic() at vpanic+0x131/frame 0xfffffe000edce4d0
panic() at panic+0x43/frame 0xfffffe000edce530
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe000edce590
calltrap() at calltrap+0x8/frame 0xfffffe000edce590
--- trap 0x9, rip = 0xffffffff8109fa60, rsp = 0xfffffe000edce660, rbp = 0xfffffe000edce660 ---
memcmp() at memcmp+0x110/frame 0xfffffe000edce660
pf_find_state() at pf_find_state+0xc0/frame 0xfffffe000edce6b0
pf_test_state_udp() at pf_test_state_udp+0x139/frame 0xfffffe000edce710
pf_test() at pf_test+0x107d/frame 0xfffffe000edce8c0
pf_check_in() at pf_check_in+0x27/frame 0xfffffe000edce8e0
pfil_mbuf_in() at pfil_mbuf_in+0x38/frame 0xfffffe000edce910
ip_input() at ip_input+0x5d5/frame 0xfffffe000edce970
netisr_dispatch_src() at netisr_dispatch_src+0x9e/frame 0xfffffe000edce9c0
ether_demux() at ether_demux+0x149/frame 0xfffffe000edce9f0
ng_ether_rcv_upper() at ng_ether_rcv_upper+0x8c/frame 0xfffffe000edcea10
ng_apply_item() at ng_apply_item+0x13e/frame 0xfffffe000edceab0
ng_snd_item() at ng_snd_item+0x274/frame 0xfffffe000edceaf0
ng_apply_item() at ng_apply_item+0x13e/frame 0xfffffe000edceb90
ng_snd_item() at ng_snd_item+0x274/frame 0xfffffe000edcebd0
ng_ether_input() at ng_ether_input+0x4c/frame 0xfffffe000edcec00
ether_nh_input() at ether_nh_input+0x1dc/frame 0xfffffe000edcec60
netisr_dispatch_src() at netisr_dispatch_src+0x9e/frame 0xfffffe000edcecb0
ether_input() at ether_input+0x56/frame 0xfffffe000edced00
iflib_rxeof() at iflib_rxeof+0xc0e/frame 0xfffffe000edcee00
_task_fn_rx() at _task_fn_rx+0x72/frame 0xfffffe000edcee40
gtaskqueue_run_locked() at gtaskqueue_run_locked+0x14e/frame 0xfffffe000edceec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xc2/frame 0xfffffe000edceef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe000edcef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000edcef30
--- trap 0x38b4800, rip = 0x85480000008b840f, rsp = 0xc13c8b481874d285, rbp = 0xd28548f1f748c08b ---
KDB: enter: panic
Afterwards it seems to run through the boot sequence again in the log an additional 7 times, with more or less of the same. I know a general protection fault in kernel *usually* points to a hardware issue, but I'd like to have the benefit of the doubt since i checked over everything but I could also still be wrong on that front. Regardless, hopefully something i've posted will be a clue to what's going on.

Thank you for your help in advance!

[newsense]

You need to change your kernel

https://forum.opnsense.org/index.php?topic=44430.msg222309#msg222309

[brot1337]

Yes, please install os-microcode-intel and reboot. It should be fine after.

The issues are gone, I have not noticed any more reboots. Thank you very much for the quick support! :)

[franco]

Yay, nice!  :)