OPNsense VM crashing (OPNsense 23.1)

[Random999]

I'm running OPNsense on a ESXi VM, i have tried ESX 6.7, 7.0 (multiple updates) and now I'm on ESX 8.0. I have reinstalled OPNsense completely and restored the config backup to get it up and running again.

Nothing seems to help, occasionally it's simply crashing and it's driving me crazy because I'm coming from PfSense and never had this issue. Also I'm running 4 or 5 other VM's on that same ESXi host without any issues (CPU is doing 20% on average on the host, I have 32gb memory, assigned 4 CPU's (1 socket) and 6 GB mem to the OPNsense VM.

Can you guys identify something in my logs?

dmesg.boot:

Code Select Expand

Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.1-RELEASE-p7 stable/23.1-n250403-22166c9a507 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: Intel(R) Pentium(R) Silver N6005 @ 2.00GHz (1996.80-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906c0  Family=0x6  Model=0x9c  Stepping=0
  Features=0x1f83fbff
  Features2=0xcff82203
  AMD Features=0x28100800
  AMD Features2=0x101
  Structured Extended Features=0x219422c3
  Structured Extended Features2=0x18400104
  Structured Extended Features3=0xbc000400
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x2b
  TSC: P-state invariant
Hypervisor: Origin = "VMwareVMware"
real memory  = 6442450944 (6144 MB)
avail memory = 6181916672 (5895 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0  irqs 0-23
Launching APs: 2 1 3
random: entropy device external interface
wlan: mac acl policy registered
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
smbios0:  at iomem 0xf69b0-0xf69ce
smbios0: Version: 2.7
aesni0:
acpi0:
acpi0: Power Button (fixed)
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
cpu0:  numa-domain 0 on acpi0
attimer0:  port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0:  port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
pcib1:  at device 1.0 on pci0
pci1:  on pcib1
isab0:  at device 7.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
pci0:  at device 7.3 (no driver attached)
vgapci0:  port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0
vgapci0: Boot video device
pcib2:  at device 17.0 on pci0
pci2:  on pcib2
uhci0:  port 0x2000-0x201f irq 18 at device 0.0 on pci2
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
ehci0:  mem 0xfd5ff000-0xfd5fffff irq 19 at device 1.0 on pci2
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
ahci0:  mem 0xfd5fe000-0xfd5fefff irq 16 at device 2.0 on pci2
ahci0: AHCI v1.30 with 30 6Gbps ports, Port Multiplier not supported
ahcich0:  at channel 0 on ahci0
ahcich1:  at channel 1 on ahci0
ahcich2:  at channel 2 on ahci0
ahcich3:  at channel 3 on ahci0
ahcich4:  at channel 4 on ahci0
ahcich5:  at channel 5 on ahci0
ahcich6:  at channel 6 on ahci0
ahcich7:  at channel 7 on ahci0
ahcich8:  at channel 8 on ahci0
ahcich9:  at channel 9 on ahci0
ahcich10:  at channel 10 on ahci0
ahcich11:  at channel 11 on ahci0
ahcich12:  at channel 12 on ahci0
ahcich13:  at channel 13 on ahci0
ahcich14:  at channel 14 on ahci0
ahcich15:  at channel 15 on ahci0
ahcich16:  at channel 16 on ahci0
ahcich17:  at channel 17 on ahci0
ahcich18:  at channel 18 on ahci0
ahcich19:  at channel 19 on ahci0
ahcich20:  at channel 20 on ahci0
ahcich21:  at channel 21 on ahci0
ahcich22:  at channel 22 on ahci0
ahcich23:  at channel 23 on ahci0
ahcich24:  at channel 24 on ahci0
ahcich25:  at channel 25 on ahci0
ahcich26:  at channel 26 on ahci0
ahcich27:  at channel 27 on ahci0
ahcich28:  at channel 28 on ahci0
ahcich29:  at channel 29 on ahci0
pcib3:  at device 21.0 on pci0
pci3:  on pcib3
vmx0:  port 0x4000-0x400f mem 0xfd4fc000-0xfd4fcfff,0xfd4fd000-0xfd4fdfff,0xfd4fe000-0xfd4fffff irq 18 at device 0.0 on pci3
vmx0: Using 512 TX descriptors and 512 RX descriptors
vmx0: Using 4 RX queues 4 TX queues
vmx0: Using MSI-X interrupts with 5 vectors
vmx0: Ethernet address: d4:3d:f3:e2:bf:70
vmx0: netmap queues/slots: TX 4/512, RX 4/512
pcib4:  at device 21.1 on pci0
pcib5:  at device 21.2 on pci0
pcib6:  at device 21.3 on pci0
pcib7:  at device 21.4 on pci0
pcib8:  at device 21.5 on pci0
pcib9:  at device 21.6 on pci0
pcib10:  at device 21.7 on pci0
pcib11:  at device 22.0 on pci0
pci4:  on pcib11
vmx1:  port 0x5000-0x500f mem 0xfd3fc000-0xfd3fcfff,0xfd3fd000-0xfd3fdfff,0xfd3fe000-0xfd3fffff irq 19 at device 0.0 on pci4
vmx1: Using 512 TX descriptors and 512 RX descriptors
vmx1: Using 4 RX queues 4 TX queues
vmx1: Using MSI-X interrupts with 5 vectors
vmx1: Ethernet address: 00:0c:29:4d:c2:c3
vmx1: netmap queues/slots: TX 4/512, RX 4/512
pcib12:  at device 22.1 on pci0
pcib13:  at device 22.2 on pci0
pcib14:  at device 22.3 on pci0
pcib15:  at device 22.4 on pci0
pcib16:  at device 22.5 on pci0
pcib17:  at device 22.6 on pci0
pcib18:  at device 22.7 on pci0
pcib19:  at device 23.0 on pci0
pcib20:  at device 23.1 on pci0
pcib21:  at device 23.2 on pci0
pcib22:  at device 23.3 on pci0
pcib23:  at device 23.4 on pci0
pcib24:  at device 23.5 on pci0
pcib25:  at device 23.6 on pci0
pcib26:  at device 23.7 on pci0
pcib27:  at device 24.0 on pci0
pcib28:  at device 24.1 on pci0
pcib29:  at device 24.2 on pci0
pcib30:  at device 24.3 on pci0
pcib31:  at device 24.4 on pci0
pcib32:  at device 24.5 on pci0
pcib33:  at device 24.6 on pci0
pcib34:  at device 24.7 on pci0
acpi_acad0:  on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse, device ID 3
acpi_syscontainer0:  on acpi0
orm0:  at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe7fff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
Timecounter "TSC" frequency 1996800000 Hz quality 1000
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ugen1.1: <(0x15ad) EHCI root HUB> at usbus1
uhub0 on usbus1
uhub0: <(0x15ad) EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen0.1: <(0x15ad) UHCI root HUB> at usbus0
uhub1 on usbus0
uhub1: <(0x15ad) UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
Trying to mount root from zfs:zroot/ROOT/default []...
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: CAM usbus0 usbus1
ugen0.2:  at usbus0
ugen0.3:  at usbus0
uhub2 on uhub1
uhub2:  on usbus0
Root mount waiting for: CAM usbus0 usbus1
ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
ada0:  ATA-6 SATA 2.x device
ada0: Serial Number 00000000000000000001
ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 51200MB (104857600 512 byte sectors)
cd0 at ahcich1 bus 0 scbus3 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number 01000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 1562MB (800149 2048 byte sectors)
uhub0: 6 ports with 6 removable, self powered
uhub2: 7 ports with 7 removable, self powered
VMware memory control driver initialized
intsmb0:  port 0x1040-0x104f at device 7.3 on pci0
intsmb0: intr SMI disabled revision 0
smbus0:  on intsmb0
vmci0:  port 0x1080-0x10bf mem 0xfebfe000-0xfebfffff irq 16 at device 7.7 on pci0
uhid0 on uhub1
uhid0:  on usbus0
uhid1 on uhub1
uhid1:  on usbus0
lo0: link state changed to UP
pflog0: permanently promiscuous mode enabled
vmx1: link state changed to UP
vlan0: changing name to 'vlan01'
vlan1: changing name to 'vlan02'
vlan2: changing name to 'vlan03'
vlan3: changing name to 'vlan04'
vmx0: link state changed to UP
tun1: changing name to 'ovpns1'
ovpns1: link state changed to UP
WARNING: attempt to domain_add(netgraph) after domainfinalize()
ovpns1: link state changed to DOWN
ovpns1: link state changed to UP
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
vlan4: changing name to 'vlan0.300'
config_aqm Unable to configure flowset, flowset busy!
arprequest_internal: cannot find matching address
arprequest_internal: cannot find matching address
arprequest_internal: cannot find matching address
arprequest_internal: cannot find matching address
arprequest_internal: cannot find matching address
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
arpresolve: can't allocate llinfo for <IP REMOVED> on vlan0.300
sonewconn: pcb 0xfffff80056871000 (IP REMOVED:443 (proto 6)): Listen queue overflow: 193 already in queue awaiting acceptance (1 occurrences)
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
pid 63574 (python3.9), jid 0, uid 0: exited on signal 11 (core dumped)
ovpns1: link state changed to DOWN
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 0 0 0 0 0 done
All buffers synced.
Uptime: 8d22h39m34s
uhub0: detached
uhid0: detached
uhid1: detached
uhub2: detached
uhub1: detached
---<>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.1-RELEASE-p7 stable/23.1-n250403-22166c9a507 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: Intel(R) Pentium(R) Silver N6005 @ 2.00GHz (1996.80-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906c0  Family=0x6  Model=0x9c  Stepping=0
  Features=0x1f83fbff
  Features2=0xcff82203
  AMD Features=0x28100800
  AMD Features2=0x101
  Structured Extended Features=0x219422c3
  Structured Extended Features2=0x18400104
  Structured Extended Features3=0xbc000400
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x2b
  TSC: P-state invariant
Hypervisor: Origin = "VMwareVMware"
real memory  = 6442450944 (6144 MB)
avail memory = 6181920768 (5895 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0  irqs 0-23
Launching APs: 2 1 3
random: entropy device external interface
wlan: mac acl policy registered
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
smbios0:  at iomem 0xf69b0-0xf69ce
smbios0: Version: 2.7
aesni0:
acpi0:
acpi0: Power Button (fixed)
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
cpu0:  numa-domain 0 on acpi0
attimer0:  port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0:  port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
pcib1:  at device 1.0 on pci0
pci1:  on pcib1
isab0:  at device 7.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
pci0:  at device 7.3 (no driver attached)
vgapci0:  port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0
vgapci0: Boot video device
pcib2:  at device 17.0 on pci0
pci2:  on pcib2
uhci0:  port 0x2000-0x201f irq 18 at device 0.0 on pci2
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
ehci0:  mem 0xfd5ff000-0xfd5fffff irq 19 at device 1.0 on pci2
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
ahci0:  mem 0xfd5fe000-0xfd5fefff irq 16 at device 2.0 on pci2
ahci0: AHCI v1.30 with 30 6Gbps ports, Port Multiplier not supported
ahcich0:  at channel 0 on ahci0
ahcich1:  at channel 1 on ahci0
ahcich2:  at channel 2 on ahci0
ahcich3:  at channel 3 on ahci0
ahcich4:  at channel 4 on ahci0
ahcich5:  at channel 5 on ahci0
ahcich6:  at channel 6 on ahci0
ahcich7:  at channel 7 on ahci0
ahcich8:  at channel 8 on ahci0
ahcich9:  at channel 9 on ahci0
ahcich10:  at channel 10 on ahci0
ahcich11:  at channel 11 on ahci0
ahcich12:  at channel 12 on ahci0
ahcich13:  at channel 13 on ahci0
ahcich14:  at channel 14 on ahci0
ahcich15:  at channel 15 on ahci0
ahcich16:  at channel 16 on ahci0
ahcich17:  at channel 17 on ahci0
ahcich18:  at channel 18 on ahci0
ahcich19:  at channel 19 on ahci0
ahcich20:  at channel 20 on ahci0
ahcich21:  at channel 21 on ahci0
ahcich22:  at channel 22 on ahci0
ahcich23:  at channel 23 on ahci0
ahcich24:  at channel 24 on ahci0
ahcich25:  at channel 25 on ahci0
ahcich26:  at channel 26 on ahci0
ahcich27:  at channel 27 on ahci0
ahcich28:  at channel 28 on ahci0
ahcich29:  at channel 29 on ahci0
pcib3:  at device 21.0 on pci0
pci3:  on pcib3
vmx0:  port 0x4000-0x400f mem 0xfd4fc000-0xfd4fcfff,0xfd4fd000-0xfd4fdfff,0xfd4fe000-0xfd4fffff irq 18 at device 0.0 on pci3
vmx0: Using 512 TX descriptors and 512 RX descriptors
vmx0: Using 4 RX queues 4 TX queues
vmx0: Using MSI-X interrupts with 5 vectors
vmx0: Ethernet address: d4:3d:f3:e2:bf:70
vmx0: netmap queues/slots: TX 4/512, RX 4/512
pcib4:  at device 21.1 on pci0
pcib5:  at device 21.2 on pci0
pcib6:  at device 21.3 on pci0
pcib7:  at device 21.4 on pci0
pcib8:  at device 21.5 on pci0
pcib9:  at device 21.6 on pci0
pcib10:  at device 21.7 on pci0
pcib11:  at device 22.0 on pci0
pci4:  on pcib11
vmx1:  port 0x5000-0x500f mem 0xfd3fc000-0xfd3fcfff,0xfd3fd000-0xfd3fdfff,0xfd3fe000-0xfd3fffff irq 19 at device 0.0 on pci4
vmx1: Using 512 TX descriptors and 512 RX descriptors
vmx1: Using 4 RX queues 4 TX queues
vmx1: Using MSI-X interrupts with 5 vectors
vmx1: Ethernet address: 00:0c:29:4d:c2:c3
vmx1: netmap queues/slots: TX 4/512, RX 4/512
pcib12:  at device 22.1 on pci0
pcib13:  at device 22.2 on pci0
pcib14:  at device 22.3 on pci0
pcib15:  at device 22.4 on pci0
pcib16:  at device 22.5 on pci0
pcib17:  at device 22.6 on pci0
pcib18:  at device 22.7 on pci0
pcib19:  at device 23.0 on pci0
pcib20:  at device 23.1 on pci0
pcib21:  at device 23.2 on pci0
pcib22:  at device 23.3 on pci0
pcib23:  at device 23.4 on pci0
pcib24:  at device 23.5 on pci0
pcib25:  at device 23.6 on pci0
pcib26:  at device 23.7 on pci0
pcib27:  at device 24.0 on pci0
pcib28:  at device 24.1 on pci0
pcib29:  at device 24.2 on pci0
pcib30:  at device 24.3 on pci0
pcib31:  at device 24.4 on pci0
pcib32:  at device 24.5 on pci0
pcib33:  at device 24.6 on pci0
pcib34:  at device 24.7 on pci0
acpi_acad0:  on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse, device ID 3
acpi_syscontainer0:  on acpi0
orm0:  at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe7fff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
Timecounter "TSC" frequency 1996800000 Hz quality 1000
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ugen1.1: <(0x15ad) EHCI root HUB> at usbus1
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0 on usbus1
uhub0: <(0x15ad) EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen0.1: <(0x15ad) UHCI root HUB> at usbus0
uhub1 on usbus0
uhub1: <(0x15ad) UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
uhub1: 2 ports with 2 removable, self powered
Root mount waiting for: CAM usbus0 usbus1
ugen0.2:  at usbus0
ugen0.3:  at usbus0
uhub2 on uhub1
uhub2:  on usbus0
Root mount waiting for: CAM usbus0 usbus1
ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
ada0:  ATA-6 SATA 2.x device
ada0: Serial Number 00000000000000000001
ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 51200MB (104857600 512 byte sectors)
cd0 at ahcich1 bus 0 scbus3 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number 01000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 1562MB (800149 2048 byte sectors)
uhub0: 6 ports with 6 removable, self powered
uhub2: 7 ports with 7 removable, self powered
VMware memory control driver initialized
intsmb0:  port 0x1040-0x104f at device 7.3 on pci0
intsmb0: intr SMI disabled revision 0
smbus0:  on intsmb0
vmci0:  port 0x1080-0x10bf mem 0xfebfe000-0xfebfffff irq 16 at device 7.7 on pci0
uhid0 on uhub1
uhid0:  on usbus0
uhid1 on uhub1
uhid1:  on usbus0
lo0: link state changed to UP
pflog0: permanently promiscuous mode enabled
vmx1: link state changed to UP
vlan0: changing name to 'vlan0.300'
vlan1: changing name to 'vlan01'
vlan2: changing name to 'vlan02'
vlan3: changing name to 'vlan03'
vlan4: changing name to 'vlan04'
vmx0: link state changed to UP
tun1: changing name to 'ovpns1'
ovpns1: link state changed to UP
ovpns1: link state changed to DOWN
WARNING: attempt to domain_add(netgraph) after domainfinalize()
ovpns1: link state changed to UP
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vlan02: promiscuous mode enabled
vmx1: promiscuous mode disabled
vlan02: promiscuous mode disabled
vmx1: promiscuous mode enabled
vlan02: promiscuous mode enabled
vmx1: promiscuous mode disabled
vlan02: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 02
fault virtual address = 0x158
fault code = supervisor write data, page not present
instruction pointer = 0x20:0xffffffff81125b4f
stack pointer         = 0x28:0xfffffe000b98cce0
frame pointer         = 0x28:0xfffffe000b98cd00
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = resume, IOPL = 0
current process = 11 (idle: cpu2)
trap number = 12
panic: page fault
cpuid = 2
time = 1679855225
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000b98caa0
vpanic() at vpanic+0x17f/frame 0xfffffe000b98caf0
panic() at panic+0x43/frame 0xfffffe000b98cb50
trap_fatal() at trap_fatal+0x385/frame 0xfffffe000b98cbb0
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe000b98cc10
calltrap() at calltrap+0x8/frame 0xfffffe000b98cc10
--- trap 0xc, rip = 0xffffffff81125b4f, rsp = 0xfffffe000b98cce0, rbp = 0xfffffe000b98cd00 ---
ipi_bitmap_handler() at ipi_bitmap_handler+0x3f/frame 0xfffffe000b98cd00
Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe000b98cd00
--- interrupt, rip = 0xffffffff8111b0a6, rsp = 0xfffffe000b98cdd0, rbp = 0xfffffe000b98cdd0 ---
acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe000b98cdd0
acpi_cpu_idle() at acpi_cpu_idle+0x2ef/frame 0xfffffe000b98ce10
cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe000b98ce30
cpu_idle() at cpu_idle+0x9f/frame 0xfffffe000b98ce50
sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe000b98cef0
fork_exit() at fork_exit+0x7e/frame 0xfffffe000b98cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000b98cf30
--- trap 0xba290b8, rip = 0xffffffff80c30e8f, rsp = 0, rbp = 0xffffffff8133a258 ---
mi_startup() at mi_startup+0xdf/frame 0xffffffff8133a258
KDB: enter: panic
---<>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.1-RELEASE-p7 stable/23.1-n250403-22166c9a507 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: Intel(R) Pentium(R) Silver N6005 @ 2.00GHz (1996.80-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906c0  Family=0x6  Model=0x9c  Stepping=0
  Features=0x1f83fbff
  Features2=0xcff82203
  AMD Features=0x28100800
  AMD Features2=0x101
  Structured Extended Features=0x219422c3
  Structured Extended Features2=0x18400104
  Structured Extended Features3=0xbc000400
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x2b
  TSC: P-state invariant
Hypervisor: Origin = "VMwareVMware"
real memory  = 6442450944 (6144 MB)
avail memory = 6181916672 (5895 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0  irqs 0-23
Launching APs: 3 1 2
random: entropy device external interface
wlan: mac acl policy registered
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
smbios0:  at iomem 0xf69b0-0xf69ce
smbios0: Version: 2.7
aesni0:
acpi0:
acpi0: Power Button (fixed)
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
cpu0:  numa-domain 0 on acpi0
attimer0:  port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0:  port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
pcib1:  at device 1.0 on pci0
pci1:  on pcib1
isab0:  at device 7.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
pci0:  at device 7.3 (no driver attached)
vgapci0:  port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0
vgapci0: Boot video device
pcib2:  at device 17.0 on pci0
pci2:  on pcib2
uhci0:  port 0x2000-0x201f irq 18 at device 0.0 on pci2
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
ehci0:  mem 0xfd5ff000-0xfd5fffff irq 19 at device 1.0 on pci2
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
ahci0:  mem 0xfd5fe000-0xfd5fefff irq 16 at device 2.0 on pci2
ahci0: AHCI v1.30 with 30 6Gbps ports, Port Multiplier not supported
ahcich0:  at channel 0 on ahci0
ahcich1:  at channel 1 on ahci0
ahcich2:  at channel 2 on ahci0
ahcich3:  at channel 3 on ahci0
ahcich4:  at channel 4 on ahci0
ahcich5:  at channel 5 on ahci0
ahcich6:  at channel 6 on ahci0
ahcich7:  at channel 7 on ahci0
ahcich8:  at channel 8 on ahci0
ahcich9:  at channel 9 on ahci0
ahcich10:  at channel 10 on ahci0
ahcich11:  at channel 11 on ahci0
ahcich12:  at channel 12 on ahci0
ahcich13:  at channel 13 on ahci0
ahcich14:  at channel 14 on ahci0
ahcich15:  at channel 15 on ahci0
ahcich16:  at channel 16 on ahci0
ahcich17:  at channel 17 on ahci0
ahcich18:  at channel 18 on ahci0
ahcich19:  at channel 19 on ahci0
ahcich20:  at channel 20 on ahci0
ahcich21:  at channel 21 on ahci0
ahcich22:  at channel 22 on ahci0
ahcich23:  at channel 23 on ahci0
ahcich24:  at channel 24 on ahci0
ahcich25:  at channel 25 on ahci0
ahcich26:  at channel 26 on ahci0
ahcich27:  at channel 27 on ahci0
ahcich28:  at channel 28 on ahci0
ahcich29:  at channel 29 on ahci0
pcib3:  at device 21.0 on pci0
pci3:  on pcib3
vmx0:  port 0x4000-0x400f mem 0xfd4fc000-0xfd4fcfff,0xfd4fd000-0xfd4fdfff,0xfd4fe000-0xfd4fffff irq 18 at device 0.0 on pci3
vmx0: Using 512 TX descriptors and 512 RX descriptors
vmx0: Using 4 RX queues 4 TX queues
vmx0: Using MSI-X interrupts with 5 vectors
vmx0: Ethernet address: d4:3d:f3:e2:bf:70
vmx0: netmap queues/slots: TX 4/512, RX 4/512
pcib4:  at device 21.1 on pci0
pcib5:  at device 21.2 on pci0
pcib6:  at device 21.3 on pci0
pcib7:  at device 21.4 on pci0
pcib8:  at device 21.5 on pci0
pcib9:  at device 21.6 on pci0
pcib10:  at device 21.7 on pci0
pcib11:  at device 22.0 on pci0
pci4:  on pcib11
vmx1:  port 0x5000-0x500f mem 0xfd3fc000-0xfd3fcfff,0xfd3fd000-0xfd3fdfff,0xfd3fe000-0xfd3fffff irq 19 at device 0.0 on pci4
vmx1: Using 512 TX descriptors and 512 RX descriptors
vmx1: Using 4 RX queues 4 TX queues
vmx1: Using MSI-X interrupts with 5 vectors
vmx1: Ethernet address: 00:0c:29:4d:c2:c3
vmx1: netmap queues/slots: TX 4/512, RX 4/512
pcib12:  at device 22.1 on pci0
pcib13:  at device 22.2 on pci0
pcib14:  at device 22.3 on pci0
pcib15:  at device 22.4 on pci0
pcib16:  at device 22.5 on pci0
pcib17:  at device 22.6 on pci0
pcib18:  at device 22.7 on pci0
pcib19:  at device 23.0 on pci0
pcib20:  at device 23.1 on pci0
pcib21:  at device 23.2 on pci0
pcib22:  at device 23.3 on pci0
pcib23:  at device 23.4 on pci0
pcib24:  at device 23.5 on pci0
pcib25:  at device 23.6 on pci0
pcib26:  at device 23.7 on pci0
pcib27:  at device 24.0 on pci0
pcib28:  at device 24.1 on pci0
pcib29:  at device 24.2 on pci0
pcib30:  at device 24.3 on pci0
pcib31:  at device 24.4 on pci0
pcib32:  at device 24.5 on pci0
pcib33:  at device 24.6 on pci0
pcib34:  at device 24.7 on pci0
acpi_acad0:  on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse, device ID 3
acpi_syscontainer0:  on acpi0
orm0:  at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe7fff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
Timecounter "TSC" frequency 1996800000 Hz quality 1000
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ugen0.1: <(0x15ad) UHCI root HUB> at usbus0
uhub0 on usbus0
uhub0: <(0x15ad) UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <(0x15ad) EHCI root HUB> at usbus1
Trying to mount root from zfs:zroot/ROOT/default []...
uhub1 on usbus1
uhub1: <(0x15ad) EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
Root mount waiting for: CAM usbus0 usbus1
ugen0.2:  at usbus0
ugen0.3:  at usbus0
uhub2 on uhub0
uhub2:  on usbus0
Root mount waiting for: CAM usbus0 usbus1
ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
ada0:  ATA-6 SATA 2.x device
ada0: Serial Number 00000000000000000001
ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 51200MB (104857600 512 byte sectors)
cd0 at ahcich1 bus 0 scbus3 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number 01000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 1562MB (800149 2048 byte sectors)
uhub1: 6 ports with 6 removable, self powered
uhub2: 7 ports with 7 removable, self powered

/var/crash/info.0:

Code Select Expand

Dump header from device: /dev/ada0p3
  Architecture: amd64
  Architecture Version: 4
  Dump Length: 111104
  Blocksize: 512
  Compression: none
  Dumptime: 2023-03-26 20:27:05 +0200
  Hostname: OPNsense.random.lan
  Magic: FreeBSD Text Dump
  Version String: FreeBSD 13.1-RELEASE-p7 stable/23.1-n250403-22166c9a507 SMP
  Panic String: page fault
  Dump Parity: 1138652227
  Bounds: 0
  Dump Status: good

/var/crash/textdump.tar.0:
attached


Could this be the cause?:

vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vlan02: promiscuous mode enabled
vmx1: promiscuous mode disabled
vlan02: promiscuous mode disabled
vmx1: promiscuous mode enabled
vlan02: promiscuous mode enabled
vmx1: promiscuous mode disabled
vlan02: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx1: promiscuous mode enabled
vmx1: promiscuous mode disabled
vmx0: promiscuous mode enabled
vmx0: promiscuous mode disabled
kernel trap 12 with interrupts disabled

[misery]

You need to update the Microcode of Intel CPU to at least 0x24000024.

https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/releases

See same problem on Proxmox.
https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/page-19

[Random999]

I'm running ESXi, current microcode there in bootbank is around 2 MB, should I copy the whole https://github.com/intel/Intel-Linux-Processor-Microcode-Data-Files/archive/refs/tags/microcode-20230214.tar.gz there (around 12 MB) or only the dat file for my specific CPU? 06-9c-00/01, which is the correct microcode for a Intel Pentium N6005.

[benyamin]

Perhaps try the newly released ESXi 8.0.1 update first...

A similar topic: https://forum.opnsense.org/index.php?topic=33382.0

The release notes for the microcode do show 06-9c-00/01 as being the Family-Model-Stepping/PlatformID for the N6005 (and for the N5105 in the other topic). That being said, I'm unsure if your technique of replacing the dat file would work. Worth a try I guess if you have a back out mechanism.

[Random999]

I had 8.0.1 running since yesterday, but to be honest, I had not much faith in it because I have seen instability on 6.7, 7.x and 8.0 already.

I don't know if the microcode is going to help but I just managed to update my cpu microcode under ESXi 8.0.1:

Steps on an ESXi host:

Download the correct microcode binary specific for your CPU (06-9c-00 binary for a Intel N6005 Pentium)

mv 06-9c-00 uc_intel
gzip uc_intel
cp uc_intel.gz /bootbank/uc_intel.b00
overwrite the file, reboot and:

Code Select Expand

[root@fanless-N6005:~] vsish -e cat /hardware/cpu/cpuList/0 | grep -i -E 'family|model|stepping|microcode|revision'
   Family:0x06
   Model:0x9c
   Stepping:0x00
   Number of microcode updates:1
   Original Revision:0x0000001d
   Current Revision:0x24000024

[Neuer_User]

I had 8.0.1 running since yesterday, but to be honest, I had not much faith in it because I have seen instability on 6.7, 7.x and 8.0 already.

I don't know if the microcode is going to help but I just managed to update my cpu microcode under ESXi 8.0.1:

Steps on an ESXi host:

Download the correct microcode binary specific for your CPU (06-9c-00 binary for a Intel N6005 Pentium)

mv 06-9c-00 uc_intel
gzip uc_intel
cp uc_intel.gz /bootbank/uc_intel.b00
overwrite the file, reboot and:

Code Select Expand

[root@fanless-N6005:~] vsish -e cat /hardware/cpu/cpuList/0 | grep -i -E 'family|model|stepping|microcode|revision'
   Family:0x06
   Model:0x9c
   Stepping:0x00
   Number of microcode updates:1
   Original Revision:0x0000001d
   Current Revision:0x24000024

I have the same problem. I will try the microcode update and see, if it helps! (Thanks for posting the steps!)

[benyamin]

If I'm not mistaken, the "Original Revision" is the microcode in the CPU + any updates supplied by the BIOS.

@Random999, that seems to be quite the gap between your original and current revisions. There could be several fixes in the current revision that might affect your problem.

@Neuer_User, I'm curious what your original revision might be...

If this does fix the problem, someone might want to consider lodging a bug report with VMware so the 06-9c-00 microcode can be included, otherwise you might need to do this manually every time they update uc_intel.b00.

[Neuer_User]

@Neuer_User, I'm curious what your original revision might be...

I have exactly the same revision (but a slightly different CPU, the N5105).

[Random999]

@Neuer_User, I'm curious what your original revision might be...

I have exactly the same revision (but a slightly different CPU, the N5105).

You can use the same microcode,  the 06-9c-00 binary is for Pentium N6000/N6005 and Celeron N4500/N4505/N5100/N5105

If I'm not mistaken, the "Original Revision" is the microcode in the CPU + any updates supplied by the BIOS.

If this does fix the problem, someone might want to consider lodging a bug report with VMware so the 06-9c-00 microcode can be included, otherwise you might need to do this manually every time they update uc_intel.b00.

You are not mistaken, the original microcode is loaded from BIOS and that's the best way to begin with.

Unfortunately, topton and/or changwang devices are not supported by vmware, better said, the CPU's in it isnt. So I really would like to see a BIOS update from the mini pc supplier, but I already know that's too much to ask for ;).

[misery]

So I really would like to see a BIOS update from the mini pc supplier, but I already know that's too much to ask for ;).

https://www.changwang.com/down/84.html  :)

[benyamin]

In similar vein to @misery's post, some noteworthy and recent additions to the Proxmox forum: https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/post-550684

@Neuer_User, AdriftAtlas' experience might inform you (unless you are AdriftAtlas ;))...

Per R1CH's post immediately below AdriftAtlas' post, it is certainly somewhat risky to flash the BIOS (especially if not available from the supplier), but I don't agree with R1CH's assertion that loading the microcode following POST, i.e. in the OS, is of no difference in this case. Per my last post here, it is a mechanism to be independent of, and unaffected by, OS updates that do not include the needed microcode. However, R1CH's comments do likely apply to Debian based distros like Proxmox which typically include the whole microcode release package.

Do pay attention to the ChangWang descriptions. I didn't download the ISO to have a look as I didn't want to unblock port 8888, but by the description it seems to be for V3, V4 and V5 mainboards... The link @misery supplied through Google Translate: https://www-changwang-com.translate.goog/down/84.html?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en-US&_x_tr_pto=wapp, reveals it is the "chicken blood version" and it is "still an open version with full blood and full power consumption (please pay attention to heat dissipation by yourself)", but that it does fix the "crash restart problem in the case of a virtual machine"... YMMV...!

[Random999]

So I really would like to see a BIOS update from the mini pc supplier, but I already know that's too much to ask for ;).

https://www.changwang.com/down/84.html  :)

Is that also an applicable  BIOS version for the Topton N6005 PC?

[Neuer_User]

In similar vein to @misery's post, some noteworthy and recent additions to the Proxmox forum: https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/post-550684

@Neuer_User, AdriftAtlas' experience might inform you (unless you are AdriftAtlas ;))...

Per R1CH's post immediately below AdriftAtlas' post, it is certainly somewhat risky to flash the BIOS (especially if not available from the supplier), but I don't agree with R1CH's assertion that loading the microcode following POST, i.e. in the OS, is of no difference in this case. Per my last post here, it is a mechanism to be independent of, and unaffected by, OS updates that do not include the needed microcode. However, R1CH's comments do likely apply to Debian based distros like Proxmox which typically include the whole microcode release package.

Do pay attention to the ChangWang descriptions. I didn't download the ISO to have a look as I didn't want to unblock port 8888, but by the description it seems to be for V3, V4 and V5 mainboards... The link @misery supplied through Google Translate: https://www-changwang-com.translate.goog/down/84.html?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en-US&_x_tr_pto=wapp, reveals it is the "chicken blood version" and it is "still an open version with full blood and full power consumption (please pay attention to heat dissipation by yourself)", but that it does fix the "crash restart problem in the case of a virtual machine"... YMMV...!

AdriftAtlas seems to have successfully updated his BIOS. That are good news. I am still testing, if the microcode update really solves the problem here. At the moment opnsense is running for about 3,5 days without reboot (and with tools installed). That is looking good, but to be sure the machine must run at least 10 days (better 20). If the problem is solved, I will probably try the BIOS update (but not before setting up a backup solution based on an older APU2 I have still laying around).

[Random999]

I want to report a current uptime of 8 days, a record for me after the microcode was updated to 0x24000024 in ESXi.

[Neuer_User]

I also reached an uptime of 16 days so far and still going, which clearly shows that the microcode update has either fixed or at least very much reduced the issue.