[SOLVED] HE.NET GIF tunnel never comes up.

[5SpeedFun]

Hey Thanks Franco!

I've upgraded 21.7.8 -> 22.1 -> 22.1.1 but it's still not coming up at boot.
(I waited for uptime of 3 minutes post boot - still not up).

In the past (21.7.x), I waited for system to boot, edit interfaces -> other types -> Gif -> edit -> save (came up)
in 22.1, that method didn't work, so I rolled back & reporterd the issue.

Now it won't come up at boot, but if I start the dpinger via the webui, it does come up.  HOwever my ipv6 connectivity is broken.  While I have an address it seems it is not routed correctly.  Test-ipv6 returns no working ipv6 and ping ipv6.google.com doesn't work either.

[franco]

Hi,

Well just to make sure this wasn't missed: you changed to the development flavour after upgrading to 22.1.1 and checked and installed updates again and then did the reboot to confirm?


Cheers,
Franco

[5SpeedFun]

WHoops, I missed that.  I'll give that a shot tonight.  I did not do that part.  Apologies for missing that.

[5SpeedFun]

After switching to development branch & upgrading after 22.1.1, the he.net tunnel did come up on boot!  Great job! However in system->firmware->reporter:

Code: [Select]

An issue was detected.

Would you like to submit this crash report to the developers?
System Information:

Code: [Select]

User-Agent Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.80 Safari/537.36
FreeBSD 13.0-STABLE stable/22.1-n248057-239b52c9023 SMP amd64
OPNsense 22.7.a_83 789b777d4
Plugins os-bind-1.21 os-frr-1.27 os-realtek-re-1.0 os-upnp-1.4_2 os-wireguard-1.10
Time Fri, 18 Feb 2022 00:42:37 -0600
OpenSSL 1.1.1m  14 Dec 2021
PHP 7.4.27
PHP Errors:

Code: [Select]

[18-Feb-2022 00:41:29 America/Chicago] PHP Warning:  Illegal string offset 'function' in /usr/local/etc/inc/interfaces.inc on line 769
[18-Feb-2022 00:41:29 America/Chicago] PHP Warning:  call_user_func_array() expects parameter 1 to be a valid callback, function 'i' not found or invalid function name in /usr/local/etc/inc/interfaces.inc on line 769
[18-Feb-2022 00:41:29 America/Chicago] PHP Warning:  Illegal string offset 'name' in /usr/local/etc/inc/interfaces.inc on line 769
dmesg.boot

Code: [Select]

Event timer "RTC" frequency 32768 Hz quality 0
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 100000000 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
isab0:  at device 1.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe320-0xe32f at device 1.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
uhci0:  port 0xe300-0xe31f irq 11 at device 1.2 on pci0
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
pci0:  at device 1.3 (no driver attached)
vgapci0:  mem 0xfd000000-0xfdffffff,0xfc510000-0xfc510fff at device 2.0 on pci0
vgapci0: Boot video device
virtio_pci0:  port 0xe280-0xe2bf mem 0xfe400000-0xfe403fff irq 11 at device 3.0 on pci0
vtballoon0:  on virtio_pci0
virtio_pci1:  port 0xe200-0xe27f mem 0xfc511000-0xfc511fff,0xfe404000-0xfe407fff irq 10 at device 10.0 on pci0
vtblk0:  on virtio_pci1
vtblk0: 122880MB (251658240 512 byte sectors)
sfxge0:  port 0xe000-0xe0ff mem 0xfa000000-0xfaffffff,0xfc4f0000-0xfc4fffff irq 10 at device 17.0 on pci0
sfxge0: Using MSI-X interrupts
sfxge0: Ethernet address: 00:0f:53:0e:20:d0
sfxge0: Solarstorm SFN5162F SFP+ Server Adapter
sfxge1:  port 0xe100-0xe1ff mem 0xfb000000-0xfbffffff,0xfc500000-0xfc50ffff irq 10 at device 17.1 on pci0
sfxge1: Using MSI-X interrupts
sfxge1: Ethernet address: 00:0f:53:0e:20:d1
sfxge1: Solarstorm SFN5162F SFP+ Server Adapter
em0:  port 0xe2c0-0xe2ff mem 0xfc4c0000-0xfc4dffff irq 10 at device 18.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: e2:34:ac:9e:35:68
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcib1:  mem 0xfc512000-0xfc5120ff irq 10 at device 30.0 on pci0
pci1:  on pcib1
pcib2:  mem 0xfc513000-0xfc5130ff irq 11 at device 31.0 on pci0
pci2:  on pcib2
acpi_syscontainer0:  on acpi0
vmgenc0:  on acpi0
acpi_syscontainer1:  port 0xaf00-0xaf0b on acpi0
acpi_syscontainer2:  port 0xafe0-0xafe3 on acpi0
acpi_syscontainer3:  port 0xae00-0xae17 on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse Explorer, device ID 4
fdc0:  port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: does not respond
device_attach: fdc0 attach returned 6
orm0:  at iomem 0xea000-0xeffff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
attimer0:  at port 0x40 on isa0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
fdc0: No FDOUT register!
Timecounters tick every 10.000 msec
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
ugen0.1:  at usbus0
uhub0 on usbus0
uhub0:  on usbus0
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number QM00003
cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
uhub0: 2 ports with 2 removable, self powered
ugen0.2:  at usbus0
em0: link state changed to UP
debugnet_any_ifnet_update: Bad dn_init result from em0 (ifp 0xfffff80003d52000), ignoring.
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 0 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-2' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-3' to stop... done
All buffers synced.
Uptime: 36s
uhub0: detached
Rebooting...
cpu_reset: Stopping other CPUs
---<>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-STABLE hyperv-n248055-e91d90c0ac0 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: AMD Ryzen 9 3900X 12-Core Processor             (3800.14-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x870f10  Family=0x17  Model=0x71  Stepping=0
  Features=0x1783fbff
  Features2=0xfff83203
  AMD Features=0x2e500800
  AMD Features2=0x8003f7
  Structured Extended Features=0x219c01ab
  Structured Extended Features2=0x400004
  Structured Extended Features3=0xa8000000
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x69
  AMD Extended Feature Extensions ID EBX=0x3009205
  SVM: NP,NRIP,NAsids=16
Hypervisor: Origin = "KVMKVMKVM"
real memory  = 8589934592 (8192 MB)
avail memory = 8272318464 (7889 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0  irqs 0-23
Launching APs: 1 2 3
wlan: mac acl policy registered
random: entropy device external interface
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
kvmclock0:
Timecounter "kvmclock" frequency 1000000000 Hz quality 975
kvmclock0: registered as a time-of-day clock, resolution 0.000001s
aesni0:
acpi0:
acpi0: Power Button (fixed)
cpu0:  on acpi0
atrtc0:  port 0x70-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 100000000 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
isab0:  at device 1.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe320-0xe32f at device 1.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
uhci0:  port 0xe300-0xe31f irq 11 at device 1.2 on pci0
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
pci0:  at device 1.3 (no driver attached)
vgapci0:  mem 0xfd000000-0xfdffffff,0xfc510000-0xfc510fff at device 2.0 on pci0
vgapci0: Boot video device
virtio_pci0:  port 0xe280-0xe2bf mem 0xfe400000-0xfe403fff irq 11 at device 3.0 on pci0
vtballoon0:  on virtio_pci0
virtio_pci1:  port 0xe200-0xe27f mem 0xfc511000-0xfc511fff,0xfe404000-0xfe407fff irq 10 at device 10.0 on pci0
vtblk0:  on virtio_pci1
vtblk0: 122880MB (251658240 512 byte sectors)
sfxge0:  port 0xe000-0xe0ff mem 0xfa000000-0xfaffffff,0xfc4f0000-0xfc4fffff irq 10 at device 17.0 on pci0
sfxge0: Using MSI-X interrupts
sfxge0: Ethernet address: 00:0f:53:0e:20:d0
sfxge0: Solarstorm SFN5162F SFP+ Server Adapter
sfxge1:  port 0xe100-0xe1ff mem 0xfb000000-0xfbffffff,0xfc500000-0xfc50ffff irq 10 at device 17.1 on pci0
sfxge1: Using MSI-X interrupts
sfxge1: Ethernet address: 00:0f:53:0e:20:d1
sfxge1: Solarstorm SFN5162F SFP+ Server Adapter
em0:  port 0xe2c0-0xe2ff mem 0xfc4c0000-0xfc4dffff irq 10 at device 18.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: e2:34:ac:9e:35:68
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcib1:  mem 0xfc512000-0xfc5120ff irq 10 at device 30.0 on pci0
pci1:  on pcib1
pcib2:  mem 0xfc513000-0xfc5130ff irq 11 at device 31.0 on pci0
pci2:  on pcib2
acpi_syscontainer0:  on acpi0
vmgenc0:  on acpi0
acpi_syscontainer1:  port 0xaf00-0xaf0b on acpi0
acpi_syscontainer2:  port 0xafe0-0xafe3 on acpi0
acpi_syscontainer3:  port 0xae00-0xae17 on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse Explorer, device ID 4
fdc0:  port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: does not respond
device_attach: fdc0 attach returned 6
orm0:  at iomem 0xea000-0xeffff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
attimer0:  at port 0x40 on isa0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
fdc0: No FDOUT register!
Timecounters tick every 10.000 msec
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
ugen0.1:  at usbus0
uhub0 on usbus0
uhub0:  on usbus0
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number QM00003
cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
uhub0: 2 ports with 2 removable, self powered
ugen0.2:  at usbus0
em0: link state changed to UP
debugnet_any_ifnet_update: Bad dn_init result from em0 (ifp 0xfffff80003cd9000), ignoring.
intsmb0:  irq 9 at device 1.3 on pci0
intsmb0: intr IRQ 9 enabled revision 0
smbus0:  on intsmb0
uhid0 on uhub0
uhid0:  on usbus0
lo0: link state changed to UP
sfxge0: link state changed to UP
vlan0: changing name to 'sfxge0_vlan100'
vlan1: changing name to 'sfxge0_vlan99'
vlan2: changing name to 'sfxge0_vlan90'
vlan3: changing name to 'sfxge0_vlan10'
vlan4: changing name to 'sfxge0_vlan120'
vlan5: changing name to 'sfxge0_vlan11'
vlan6: changing name to 'sfxge0_vlan12'
vlan7: changing name to 'sfxge0_vlan13'
vlan8: changing name to 'sfxge0_vlan14'
vlan9: changing name to 'sfxge0_vlan101'
vlan10: changing name to 'sfxge0_vlan15'
lo1: link state changed to UP
lo2: link state changed to UP
lo3: link state changed to UP
gif0: link state changed to DOWN
WARNING: attempt to domain_add(netgraph) after domainfinalize()
tun0: link state changed to UP
tun0: changing name to 'wg0'
tun1: link state changed to UP
tun1: changing name to 'wg1'
tun2: link state changed to UP
tun2: changing name to 'wg2'
wg0: link state changed to DOWN
wg1: link state changed to DOWN
wg2: link state changed to DOWN
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 51 0 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-2' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-3' to stop... done
All buffers synced.
Uptime: 3m48s
uhid0: detached
uhub0: detached
Rebooting...
cpu_reset: Stopping other CPUs
---<>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-STABLE stable/22.1-n248057-239b52c9023 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: AMD Ryzen 9 3900X 12-Core Processor             (3800.09-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x870f10  Family=0x17  Model=0x71  Stepping=0
  Features=0x1783fbff
  Features2=0xfff83203
  AMD Features=0x2e500800
  AMD Features2=0x8003f7
  Structured Extended Features=0x219c01ab
  Structured Extended Features2=0x400004
  Structured Extended Features3=0xa8000000
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x69
  AMD Extended Feature Extensions ID EBX=0x3009205
  SVM: NP,NRIP,NAsids=16
Hypervisor: Origin = "KVMKVMKVM"
real memory  = 8589934592 (8192 MB)
avail memory = 8272314368 (7889 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0  irqs 0-23
Launching APs: 3 1 2
wlan: mac acl policy registered
random: entropy device external interface
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
kvmclock0:
Timecounter "kvmclock" frequency 1000000000 Hz quality 975
kvmclock0: registered as a time-of-day clock, resolution 0.000001s
aesni0:
acpi0:
acpi0: Power Button (fixed)
cpu0:  on acpi0
atrtc0:  port 0x70-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 100000000 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
isab0:  at device 1.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe320-0xe32f at device 1.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
uhci0:  port 0xe300-0xe31f irq 11 at device 1.2 on pci0
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
pci0:  at device 1.3 (no driver attached)
vgapci0:  mem 0xfd000000-0xfdffffff,0xfc510000-0xfc510fff at device 2.0 on pci0
vgapci0: Boot video device
virtio_pci0:  port 0xe280-0xe2bf mem 0xfe400000-0xfe403fff irq 11 at device 3.0 on pci0
vtballoon0:  on virtio_pci0
virtio_pci1:  port 0xe200-0xe27f mem 0xfc511000-0xfc511fff,0xfe404000-0xfe407fff irq 10 at device 10.0 on pci0
vtblk0:  on virtio_pci1
vtblk0: 122880MB (251658240 512 byte sectors)
sfxge0:  port 0xe000-0xe0ff mem 0xfa000000-0xfaffffff,0xfc4f0000-0xfc4fffff irq 10 at device 17.0 on pci0
sfxge0: Using MSI-X interrupts
sfxge0: Ethernet address: 00:0f:53:0e:20:d0
sfxge0: Solarstorm SFN5162F SFP+ Server Adapter
sfxge1:  port 0xe100-0xe1ff mem 0xfb000000-0xfbffffff,0xfc500000-0xfc50ffff irq 10 at device 17.1 on pci0
sfxge1: Using MSI-X interrupts
sfxge1: Ethernet address: 00:0f:53:0e:20:d1
sfxge1: Solarstorm SFN5162F SFP+ Server Adapter
em0:  port 0xe2c0-0xe2ff mem 0xfc4c0000-0xfc4dffff irq 10 at device 18.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: e2:34:ac:9e:35:68
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcib1:  mem 0xfc512000-0xfc5120ff irq 10 at device 30.0 on pci0
pci1:  on pcib1
pcib2:  mem 0xfc513000-0xfc5130ff irq 11 at device 31.0 on pci0
pci2:  on pcib2
acpi_syscontainer0:  on acpi0
vmgenc0:  on acpi0
acpi_syscontainer1:  port 0xaf00-0xaf0b on acpi0
acpi_syscontainer2:  port 0xafe0-0xafe3 on acpi0
acpi_syscontainer3:  port 0xae00-0xae17 on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse Explorer, device ID 4
fdc0:  port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: does not respond
device_attach: fdc0 attach returned 6
orm0:  at iomem 0xea000-0xeffff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
attimer0:  at port 0x40 on isa0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
fdc0: No FDOUT register!
Timecounters tick every 10.000 msec
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
ugen0.1:  at usbus0
uhub0 on usbus0
uhub0:  on usbus0
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0:  Removable CD-ROM SCSI device
cd0: Serial Number QM00003
cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
uhub0: 2 ports with 2 removable, self powered
ugen0.2:  at usbus0
em0: link state changed to UP
debugnet_any_ifnet_update: Bad dn_init result from em0 (ifp 0xfffff80003cdd000), ignoring.
intsmb0:  irq 9 at device 1.3 on pci0
intsmb0: intr IRQ 9 enabled revision 0
smbus0:  on intsmb0
uhid0 on uhub0
uhid0:  on usbus0
lo0: link state changed to UP
sfxge0: link state changed to UP
vlan0: changing name to 'sfxge0_vlan100'
vlan1: changing name to 'sfxge0_vlan99'
vlan2: changing name to 'sfxge0_vlan90'
vlan3: changing name to 'sfxge0_vlan10'
vlan4: changing name to 'sfxge0_vlan120'
vlan5: changing name to 'sfxge0_vlan11'
vlan6: changing name to 'sfxge0_vlan12'
vlan7: changing name to 'sfxge0_vlan13'
vlan8: changing name to 'sfxge0_vlan14'
vlan9: changing name to 'sfxge0_vlan101'
vlan10: changing name to 'sfxge0_vlan15'
lo1: link state changed to UP
lo2: link state changed to UP
lo3: link state changed to UP
gif0: link state changed to DOWN
pflog0: permanently promiscuous mode enabled
WARNING: attempt to domain_add(netgraph) after domainfinalize()
tun0: link state changed to UP
tun0: changing name to 'wg0'
tun1: link state changed to UP
tun1: changing name to 'wg1'
tun2: link state changed to UP
tun2: changing name to 'wg2'
wg0: link state changed to DOWN
wg1: link state changed to DOWN
wg2: link state changed to DOWN
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 6 0 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-2' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-3' to stop... done
All buffers synced.
Uptime: 3m10s
uhid0: detached
uhub0: detached
Rebooting...
cpu_reset: Stopping other CPUs
---<>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-STABLE stable/22.1-n248057-239b52c9023 SMP amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): text 80x25
CPU: AMD Ryzen 9 3900X 12-Core Processor             (3800.09-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x870f10  Family=0x17  Model=0x71  Stepping=0
  Features=0x1783fbff
  Features2=0xfff83203
  AMD Features=0x2e500800
  AMD Features2=0x8003f7
  Structured Extended Features=0x219c01ab
  Structured Extended Features2=0x400004
  Structured Extended Features3=0xa8000000
  XSAVE Features=0xf
  IA32_ARCH_CAPS=0x69
  AMD Extended Feature Extensions ID EBX=0x3009205
  SVM: NP,NRIP,NAsids=16
Hypervisor: Origin = "KVMKVMKVM"
real memory  = 8589934592 (8192 MB)
avail memory = 8272314368 (7889 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table:
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0  irqs 0-23
Launching APs: 1 2 3
wlan: mac acl policy registered
random: entropy device external interface
kbd1 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
vtvga0:
kvmclock0:
Timecounter "kvmclock" frequency 1000000000 Hz quality 975
kvmclock0: registered as a time-of-day clock, resolution 0.000001s
aesni0:
acpi0:
acpi0: Power Button (fixed)
cpu0:  on acpi0
atrtc0:  port 0x70-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0:  iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 100000000 Hz quality 950
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
pcib0:  port 0xcf8-0xcff on acpi0
pci0:  on pcib0
isab0:  at device 1.0 on pci0
isa0:  on isab0
atapci0:  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe320-0xe32f at device 1.1 on pci0
ata0:  at channel 0 on atapci0
ata1:  at channel 1 on atapci0
uhci0:  port 0xe300-0xe31f irq 11 at device 1.2 on pci0
usbus0 on uhci0
usbus0: 12Mbps Full Speed USB v1.0
pci0:  at device 1.3 (no driver attached)
vgapci0:  mem 0xfd000000-0xfdffffff,0xfc510000-0xfc510fff at device 2.0 on pci0
vgapci0: Boot video device
virtio_pci0:  port 0xe280-0xe2bf mem 0xfe400000-0xfe403fff irq 11 at device 3.0 on pci0
vtballoon0:  on virtio_pci0
virtio_pci1:  port 0xe200-0xe27f mem 0xfc511000-0xfc511fff,0xfe404000-0xfe407fff irq 10 at device 10.0 on pci0
vtblk0:  on virtio_pci1
vtblk0: 122880MB (251658240 512 byte sectors)
sfxge0:  port 0xe000-0xe0ff mem 0xfa000000-0xfaffffff,0xfc4f0000-0xfc4fffff irq 10 at device 17.0 on pci0
sfxge0: Using MSI-X interrupts
sfxge0: Ethernet address: 00:0f:53:0e:20:d0
sfxge0: Solarstorm SFN5162F SFP+ Server Adapter
sfxge1:  port 0xe100-0xe1ff mem 0xfb000000-0xfbffffff,0xfc500000-0xfc50ffff irq 10 at device 17.1 on pci0
sfxge1: Using MSI-X interrupts
sfxge1: Ethernet address: 00:0f:53:0e:20:d1
sfxge1: Solarstorm SFN5162F SFP+ Server Adapter
em0:  port 0xe2c0-0xe2ff mem 0xfc4c0000-0xfc4dffff irq 10 at device 18.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: e2:34:ac:9e:35:68
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcib1:  mem 0xfc512000-0xfc5120ff irq 10 at device 30.0 on pci0
pci1:  on pcib1
pcib2:  mem 0xfc513000-0xfc5130ff irq 11 at device 31.0 on pci0
pci2:  on pcib2
acpi_syscontainer0:  on acpi0
vmgenc0:  on acpi0
acpi_syscontainer1:  port 0xaf00-0xaf0b on acpi0
acpi_syscontainer2:  port 0xafe0-0xafe3 on acpi0
acpi_syscontainer3:  port 0xae00-0xae17 on acpi0
atkbdc0:  port 0x60,0x64 irq 1 on acpi0
atkbd0:  irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0:  irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
psm0: model IntelliMouse Explorer, device ID 4
fdc0:  port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: does not respond
device_attach: fdc0 attach returned 6
orm0:  at iomem 0xea000-0xeffff pnpid ORM0000 on isa0
vga0:  at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
attimer0:  at port 0x40 on isa0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
fdc0: No FDOUT register!
Timecounters tick every 10.000 msec
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
ugen0.1:  at usbus0
uhub0 on usbus0
uhub0:  on usbus0

[5SpeedFun]

I did report this issue via opnsense as well with links to both github ticket# and this thread. 

Thanks & let me know what you need me to test next.  My version is now listed as : 22.7.a_83   

[franco]

Nice catch, this should do the trick https://github.com/opnsense/core/commit/2b21a8838a7

# opnsense-patch 2b21a8838a7

If you could confirm this doesn't happen after reboot again that would be great.

Also I'd like to see the output of the following just to make sure it all goes well under the hood:

# opnsense-log | grep Device


Thanks,
Franco

[5SpeedFun]

Still seeing the same issue after doing the following upgrade sequence:

21.7.8 -> 22.1 -> 22.1.1 -> devel branch -> 22.7.a_94 ->  opnsense-patch 2b21a8838a7 -> reboot

Output as requested:

Code: [Select]

root@edge01:~ # opnsense-log | grep Device
<11>1 2022-02-18T20:13:21-06:00 edge01.*****net opnsense-devel 537 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-18T20:16:28-06:00 edge01.*****.net opnsense-devel 538 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-18T20:21:13-06:00 edge01.*****.net opnsense-devel 537 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now

Code: [Select]

root@edge01:~ # opnsense-patch -l
2b21a8838a7 interfaces: $devices already filtered #5540

Edit: Modified hostname in output log for priacy reasons.  Replaced <domain> with ****

I clicked the report error in opnsense webgui & referenched this thread & the github issue #.  I hope this helps!

[franco]

Oh so the thing about opnsense-patch is that it will apply or reverse the patch based on the system state. 22.7.a_94 already includes the patch (I updated this for the hotfix on the release yesterday as well) so you do not actually have to run opnsense-patch anymore.

Sorry for the trouble.


Cheers,
Franco

[5SpeedFun]

So I shut down & destroyed that vm, re-cloned from my 21.7.8

Upgraded as usual 21.7.8 -> 22.1 -> 22.1.1_3 -> devel 22.7.a_94.

No errors @ startup, although first reboot after 22.7.a_94 I had no connectivity at all (no v4 or v6).  I had to reboot a 2nd time, then I had ipv4 only.

While the he.net tunnel shows "up" I have no (ipv6) connectivity from behind opnsense.

I tried restarting the RA service (for my "lan" subnet which is what i'm testing behind) & also trying to edit -> resave the tunnel to see if that would kick something dependant on it, but still no go.

I am going to test-ipv6.com for my testing, and I also use ipvfoo in chrome to show if I'm hitting v4/v6.

[5SpeedFun]

I did some testing from a desktop and rebooted the firewall again.

Upon reboot I had no connectivity (v4 or v6) past the firewall.  I was still able to access OPNSense gui via ipv4 and that worked ok.  What is weird is connectivity from the OPNsense box itself was ok!  I could ping 8.8.8.8  for example, but not "through" the firewall from my "lan" interface (not even on v4).

I started up wireshark & was able to see no RA's coming in on my lan interface whicgh is static (for he.net tunnel).  I edit->saved the interface & that kicked something so at least RA's came out & I got an address immediately.  Still no connectivity through the firewall.

Code: [Select]

root@edge01:~ # opnsense-log | grep Device
<11>1 2022-02-19T16:12:44-06:00 edge01.*.net opnsense-devel 537 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-19T16:18:18-06:00 edge01.*.net opnsense-devel 537 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-19T16:26:35-06:00 edge01.*.net opnsense-devel 538 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-19T16:44:18-06:00 edge01.*.net opnsense-devel 538 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
<11>1 2022-02-19T16:55:30-06:00 edge01.*.net opnsense-devel 537 - [meta sequenceId="11"] /usr/local/etc/rc.bootup: Device gif0 required for opt6, configuring now
Edit:  Added this output as we've used this for troubleshooting earlier in the thread:

Code: [Select]

root@edge01:~ # /usr/local/etc/rc.reload_all
Writing firmware setting...done.
Writing trust files...done.
Configuring login behaviour...done.
Configuring CRON...done.
Setting timezone...done.
Setting hostname: edge01.*.net
Generating /etc/hosts...done.
Generating /etc/resolv.conf...done.
Configuring loopback interface...done.
Creating wireless clone interfaces...done.
Configuring VLAN interfaces...done.
Configuring Loopback interfaces...Creating OpenVPN instances...done.
Configuring DMZ_Zimbra interface...done.
Configuring DMZ_mail interface...done.
Configuring DMZ_pihole interface...done.
Configuring DMZ_plex interface...done.
Configuring DMZ_www interface...done.
Configuring LAN interface...done.
Configuring LAN_NET_MGMT interface...done.
Configuring Lo1 interface...done.
Configuring Lo2 interface...done.
Configuring Lo3 interface...done.
Configuring TRANSIT interface...done.
Configuring WG_* interface...done.
Configuring WG_Josh interface...done.
Configuring WG_RobsParents interface...done.
Configuring HE_Chicago interface...done.
Configuring LAN_Xbox interface...done.
Configuring InternetBiz interface...done.
Creating IPsec VTI instances...done.
Setting up routes...done.
Configuring firewall.....failed.
Starting DHCPv4 service...done.
Starting router advertisement service...done.
Starting NTP service...done.
Configuring OpenSSH...done.
Starting Unbound DNS...done.
Starting web GUI...done.
Syncing OpenVPN settings...done.
Generating RRD graphs...done.
Stopping named.
Waiting for PIDS: 58875.
Stopping zebra.
Waiting for PIDS: 9690.
[#] rm -f /var/run/wireguard/wg0.sock
[#] rm -f /var/run/wireguard/wg1.sock
[#] rm -f /var/run/wireguard/wg2.sock
Stopping php_fpm.
Waiting for PIDS: 96900.
Performing sanity check on php-fpm configuration:
[19-Feb-2022 17:11:56] NOTICE: configuration file /usr/local/etc/php-fpm.conf test is successful

Starting php_fpm.
setup sfxge0_vlan10 [egress only]
setup sfxge0_vlan100
setup sfxge0_vlan99
setup sfxge0_vlan120
setup lo1
ngctl: send msg: No such file or directory
error lo1: cannot create netflow node for lo1
error : interface wg0 not found
[#] ifconfig wg create name wg0
[!] Missing WireGuard kernel support (ifconfig: SIOCIFCREATE2: Invalid argument). Falling back to slow userspace implementation.
[#] wireguard-go wg0
┌──────────────────────────────────────────────────────┐
│                                                      │
│   Running wireguard-go is not required because this  │
│   kernel has first class support for WireGuard. For  │
│   information on installing the kernel module,       │
│   please visit:                                      │
│         https://www.wireguard.com/install/           │
│                                                      │
└──────────────────────────────────────────────────────┘
[#] wg setconf wg0 /dev/stdin
[#] ifconfig wg0 inet 192.168.30.1/27 alias
[#] ifconfig wg0 inet6 2001:470:c1a3:f1c9::1/64 alias
[#] ifconfig wg0 mtu 1420
[#] ifconfig wg0 up
[#] route -q -n add -inet 192.168.30.7/32 -interface wg0
[#] route -q -n add -inet 192.168.30.6/32 -interface wg0
[#] route -q -n add -inet 192.168.30.5/32 -interface wg0
[#] route -q -n add -inet 192.168.30.4/32 -interface wg0
[#] route -q -n add -inet 192.168.30.3/32 -interface wg0
[#] route -q -n add -inet 192.168.30.2/32 -interface wg0
[+] Backgrounding route monitor
[#] ifconfig wg create name wg1
[!] Missing WireGuard kernel support (ifconfig: SIOCIFCREATE2: Invalid argument). Falling back to slow userspace implementation.
[#] wireguard-go wg1
┌──────────────────────────────────────────────────────┐
│                                                      │
│   Running wireguard-go is not required because this  │
│   kernel has first class support for WireGuard. For  │
│   information on installing the kernel module,       │
│   please visit:                                      │
│         https://www.wireguard.com/install/           │
│                                                      │
└──────────────────────────────────────────────────────┘
[#] wg setconf wg1 /dev/stdin
[#] ifconfig wg1 inet 192.168.30.33/29 alias
[#] ifconfig wg1 inet6 2001:470:c1a3:ac09::1/64 alias
[#] ifconfig wg1 mtu 1420
[#] ifconfig wg1 up
[#] route -q -n add -inet6 2603:300a:1758:c01a::35/128 -interface wg1
[#] route -q -n add -inet 192.168.30.35/32 -interface wg1
[#] route -q -n add -inet 192.168.30.34/32 -interface wg1
[+] Backgrounding route monitor
[#] ifconfig wg create name wg2
[!] Missing WireGuard kernel support (ifconfig: SIOCIFCREATE2: Invalid argument). Falling back to slow userspace implementation.
[#] wireguard-go wg2
┌──────────────────────────────────────────────────────┐
│                                                      │
│   Running wireguard-go is not required because this  │
│   kernel has first class support for WireGuard. For  │
│   information on installing the kernel module,       │
│   please visit:                                      │
│         https://www.wireguard.com/install/           │
│                                                      │
└──────────────────────────────────────────────────────┘
[#] wg setconf wg2 /dev/stdin
[#] ifconfig wg2 inet 192.168.30.41/29 alias
[#] ifconfig wg2 inet6 2001:470:c1a3:ee10::1/64 alias
[#] ifconfig wg2 mtu 1420
[#] ifconfig wg2 up
[#] route -q -n add -inet 192.168.30.42/32 -interface wg2
[+] Backgrounding route monitor
Checking zebra.conf
2022/02/19 17:11:56 ZEBRA: [EC 4043309111] Disabling MPLS support (no kernel support)
OK
Starting zebra.
2022/02/19 17:11:56 ZEBRA: [EC 4043309111] Disabling MPLS support (no kernel support)
Starting named.

I wonder if "Configuring firewall.....failed." is a symptom to why I don't have any connectivity...?

[5SpeedFun]

Hi all,

After thinking about this a bit, I realized my base sfxge0 interface wasn't assigned anywhere, and I believe this is required for OPNSense > 21.7.8.  I assigned the base sfxge0 to an interface I'm not using, and now everything appears to be working.  My he.net tunnel is now also working at start without me doing anything else.

This is what my base interface looks like now:


Thank you @Franco!!!!

Now that I'm on 21.7.a_94, will I be able to merge back to stable sometime soon ? 

[5SpeedFun]

Although I did find one more problem.....all my unbound overrides (mostly for things on my lan/domain that are static ip) are all gone in the dev version.   They've just disapeared.

[franco]

Hi,

Sorry for not responding earlier... Indeed "Configuring firewall.....failed." would point to an issue. I scanned your previous report but it seemed rather erratic outside of what this patch would/could change.

Nice you figured out the issue about sfxge0 and getting it up and running. I'm somewhat doubting the approach that is currently necessary for assignment but there's no better proposal at the moment.

About Unbound this is an issue of the rework of the overrides into MVC framework. Are they not displaying at all anymore in the new GUI pages for it and/or are they not working? The system will migrate them to a new config.xml location where it can still use them. But there may be 1-2 issues left to iron out. Apologies this got in the way during testing.


Cheers,
Franco

[5SpeedFun]

Hey Franco,

No problem at all on delayed response.  I realize you guys have a ton of tickets to look at and you are volunteers.  I think everyone here appreciates all the work you & the developers put into this.

The sfxge should have been obvious.  Sorry I missed that.  I don't mind assigning the base interface and then not using it.  It's really no issue.  If that is a FreeBSD limitation, so be it.  There are more important things to worry about than something with an easy workaround.

In the (gui) at least the entire overrides is completely blank like they don't exist.  I was thinking a good way to troubleshoot would be to actually download the 21.7.8 config & the new (dev) config & compare.  Even if they aren't directly comparable due to version changes, I can see at least if the overrides exist which might point to a parser failure or something. 

No apologies necessary.  I know I'm on a testing devel branch that you added specific interface re-work that I needed & fixed my problem.   I still go back & turn off my "production" (for my house) 21.7.8 config & start up the devel config to continue troubleshooting when I have time.

To be honest, this is one of the most responsive open source projects I've ever worked with & am very thankful for that.

Keep up the good work!

[franco]

Thanks, very nice to hear.

So yes you can compare the resulting config.xml (just export) where the new overrides should be stored under OPNsense/unboundplus tag. On your 21.7.8 system it is stored under "unbound".

If you don't mind you can also send me the old "unbound" portion to examine via mail franco@opnsense.org so I can see what's going on quickly.


Cheers,
Franco