Messages

I want to add I been running a N100 CWWK with opnsense baremetal for over a year now without stability issues. I did NOT have any microcode updates installed during that time.

However, before deploying as a firewall, I did stability testing for the CPU. I maxed the PL1/2 settings to allow maximum power draw a then allowed stress-ng to run on all cores for some time.

There is a lot of talk about the varying quality of PSUs on these units. My PSU does not appear to have any issues supplying enough power to the system. It maybe worth installing stress-ng and run an all core test to see if it causes the system to reboot. It is a fast way to determine if you are having stability issues due to the PSU limitations. Just keep in mind, you might want to increase the PL1/2 to 20000 in the bios to allow constant max stress on the PSU while doing this test.

It may also good idea to retest once a year or so to ensure the PSU is still performing well.

Want to add I was experiencing this issue due the to 24.1.9 update as well. It broke unbound resolving at first because I use the WAN interface IPv6 to perform my upstream lookups.

I was losing my IPv6 on the wan interface in a matter of minutes every time I reapplied the WAN interface configuration. Since applying this patch, it appears to be working correctly now. I will update if that changes.

Did you try the fix here? https://forum.opnsense.org/index.php?topic=41160.0

Notice the thread the same time you replied. I applied the patch and restarted. Will report back in a few hours.

Following up my previous post about unbound not working due to IPv6 wan address not working. It turns out that since the 24.1.9 update, my WAN interface keeps losing it's IPv6 address.

If I reapply the WAN interface configuration, it will get back it's IPv6 address for about 5 minutes then it will be lost again. The other interfaces and devices maintain their IPv6 addresses and connectivity just fine. Only the WAN interface, which address is outside the prefix range is having this problem for me.

Once the IPv6 address is lost, it will not auto renew. I have to manually reapply the interface configuration, which it then repeats the issue.

Here is the log file from the time I refresh the WAN interface upto the point it lost it's IPv6 address.

Code Select Expand

2024-06-25T05:37:21-04:00 Notice dhcp6c dhcp6c_script: RENEW on igc0 executing
2024-06-25T05:37:21-04:00 Notice dhcp6c Received REPLY for RENEW
2024-06-25T05:37:20-04:00 Notice dhcp6c Sending Renew
2024-06-25T05:37:20-04:00 Notice dhcp6c dhcp6c_script: RENEW on igc0 executing
2024-06-25T05:37:20-04:00 Notice dhcp6c Received REPLY for RENEW
2024-06-25T05:37:20-04:00 Notice dhcp6c Sending Renew
2024-06-25T05:32:20-04:00 Notice dhcp6c dhcp6c_script: RENEW on igc0 executing
2024-06-25T05:32:20-04:00 Notice dhcp6c Received REPLY for RENEW
2024-06-25T05:32:20-04:00 Notice dhcp6c dhcp6c_script: RENEW on igc0 executing
2024-06-25T05:32:20-04:00 Notice dhcp6c Received REPLY for RENEW
2024-06-25T05:32:20-04:00 Notice dhcp6c Sending Renew
2024-06-25T05:32:20-04:00 Notice dhcp6c Sending Renew
2024-06-25T05:28:12-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : wireguard_sync(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : webgui_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : vxlan_configure_do())
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : unbound_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : openssh_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : opendns_configure_do())
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : ntpd_configure_do())
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : dnsmasq_configure_do())
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (,lan)
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : wireguard_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: Resyncing OpenVPN instances for interface LAN.
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : openvpn_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : ipsec_configure_do(,lan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (,lan)
2024-06-25T05:28:09-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : wireguard_sync(,wan))
2024-06-25T05:28:09-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : webgui_configure_do(,wan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : wireguard_sync(,wan))
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : webgui_configure_do(,wan))
2024-06-25T05:28:09-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : vxlan_configure_do())
2024-06-25T05:28:09-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : vxlan_configure_do())
2024-06-25T05:28:08-04:00 Error opnsense /interfaces.php: The command '/sbin/mount -r -t nullfs '/lib' '/var/unbound/lib'' returned exit code '1', the output was 'mount_nullfs: /var/unbound/lib: Resource deadlock avoided'
2024-06-25T05:28:08-04:00 Error opnsense /interfaces.php: The command '/sbin/mount -r -t nullfs '/usr/local/lib/python3.11' '/var/unbound/usr/local/lib/python3.11'' returned exit code '1', the output was 'mount_nullfs: /var/unbound/usr/local/lib/python3.11: Resource deadlock avoided'
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : unbound_configure_do(,wan))
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : openssh_configure_do(,wan))
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : opendns_configure_do())
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : ntpd_configure_do())
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (execute task : dnsmasq_configure_do())
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure newwanip (,wan)
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : wireguard_configure_do(,wan))
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: Resyncing OpenVPN instances for interface WAN.
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : openvpn_configure_do(,wan))
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (execute task : ipsec_configure_do(,wan))
2024-06-25T05:28:08-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure vpn (,wan)
2024-06-25T05:28:07-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : unbound_configure_do(,wan))
2024-06-25T05:28:07-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : openssh_configure_do(,wan))
2024-06-25T05:28:07-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : opendns_configure_do())
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: ROUTING: entering configure using 'lan'
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure monitor (,WAN_DHCP6)
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: ROUTING: keeping inet6 default route to fe80::[redacted]%igc0
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: ROUTING: configuring inet6 default gateway on wan
2024-06-25T05:28:07-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: ROUTING: entering configure using 'wan'
2024-06-25T05:28:07-04:00 Warning radvd exiting, 1 sigterm(s) received
2024-06-25T05:28:06-04:00 Error opnsense /usr/local/etc/rc.newwanipv6: The command '/bin/kill -'TERM' '55211''(pid:/var/dhcpd/var/run/dhcpdv6.pid) returned exit code '1', the output was 'kill: 55211: No such process'
2024-06-25T05:28:06-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure dhcp (execute task : dhcpd_dhcp_configure(,inet6))
2024-06-25T05:28:06-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: plugins_configure dhcp (,inet6)
2024-06-25T05:28:06-04:00 Notice opnsense /usr/local/etc/rc.newwanipv6: IP renewal starting (address: 2607:[redacted], interface: wan, device: igc0)
2024-06-25T05:28:05-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : ntpd_configure_do())
2024-06-25T05:28:05-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (execute task : dnsmasq_configure_do())
2024-06-25T05:28:05-04:00 Notice opnsense /interfaces.php: plugins_configure newwanip (,wan)
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: plugins_configure monitor (execute task : dpinger_configure_do())
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: plugins_configure monitor ()
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: ROUTING: keeping inet6 default route to fe80::[redacted]%igc0
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: ROUTING: configuring inet6 default gateway on wan
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: ROUTING: keeping inet default route to 173.[redacted]
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: ROUTING: configuring inet default gateway on wan
2024-06-25T05:28:04-04:00 Notice opnsense /interfaces.php: ROUTING: entering configure using defaults
2024-06-25T05:28:03-04:00 Notice dhcp6c dhcp6c_script: REQUEST on igc0 renewal
2024-06-25T05:28:03-04:00 Notice dhcp6c dhcp6c_script: REQUEST on igc0 executing
2024-06-25T05:28:03-04:00 Notice dhcp6c add an address 2607:[redacted]/128 on igc0
2024-06-25T05:28:03-04:00 Notice dhcp6c add an address 2607:[redacted]/64 on bridge0
2024-06-25T05:28:03-04:00 Notice dhcp6c Received REPLY for REQUEST
2024-06-25T05:28:03-04:00 Notice dhcp6c Sending Request
2024-06-25T05:28:03-04:00 Notice opnsense /interfaces.php: plugins_configure dns (execute task : unbound_configure_do())
2024-06-25T05:28:03-04:00 Notice opnsense /interfaces.php: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-06-25T05:28:03-04:00 Notice opnsense /interfaces.php: plugins_configure dns ()
2024-06-25T05:28:03-04:00 Warning radvd exiting, 1 sigterm(s) received
2024-06-25T05:28:03-04:00 Warning opnsense /interfaces.php: dhcpd_radvd_configure(auto) found no suitable IPv6 address on lan(bridge0)
2024-06-25T05:28:03-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : wireguard_sync(,wan))
2024-06-25T05:28:03-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : webgui_configure_do(,wan))
2024-06-25T05:28:02-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : vxlan_configure_do())
2024-06-25T05:28:02-04:00 Notice dhcp6c Sending Solicit
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : unbound_configure_do(,wan))
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : openssh_configure_do(,wan))
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : opendns_configure_do())
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : ntpd_configure_do())
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : dnsmasq_configure_do())
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (,wan)
2024-06-25T05:28:01-04:00 Notice dhcp6c duplicated interface: igc0
2024-06-25T05:28:01-04:00 Notice dhcp6c restarting
2024-06-25T05:28:01-04:00 Notice dhcp6c RTSOLD script - Sending SIGHUP to dhcp6c
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure vpn (execute task : wireguard_configure_do(,wan))
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure vpn (execute task : openvpn_configure_do(,wan))
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure vpn (execute task : ipsec_configure_do(,wan))
2024-06-25T05:28:01-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure vpn (,wan)
2024-06-25T05:28:01-04:00 Notice dhcp6c Sending Solicit
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure monitor (,WAN_DHCP)
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: ROUTING: keeping inet default route to 173.[redacted]
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: ROUTING: configuring inet default gateway on wan
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'
2024-06-25T05:28:00-04:00 Notice opnsense /usr/local/etc/rc.newwanip: IP renewal starting (new: 173.[redacted], old: 173.[redacted], interface: wan, device: igc0, force: yes)
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure dhcp ()
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure ipsec (execute task : ipsec_configure_do(,wan))
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure ipsec (,wan)
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure monitor (,WAN_DHCP)
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: plugins_configure monitor (,WAN_DHCP6)
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: ROUTING: setting inet default route to 173.[redacted]
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: ROUTING: configuring inet default gateway on wan
2024-06-25T05:28:00-04:00 Notice opnsense /interfaces.php: ROUTING: entering configure using 'wan'
2024-06-25T05:28:00-04:00 Notice dhcp6c duplicated interface: igc0
2024-06-25T05:28:00-04:00 Notice dhcp6c restarting
2024-06-25T05:28:00-04:00 Notice dhcp6c RTSOLD script - Sending SIGHUP to dhcp6c
2024-06-25T05:28:00-04:00 Warning rtsold <autoifprobe> probing vlan06
2024-06-25T05:28:00-04:00 Warning rtsold <autoifprobe> probing igc0
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: Creating resolv.conf
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: New Routers (igc0): 173.[redacted]
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: New Broadcast Address (igc0): 173.[redacted]
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: New Subnet Mask (igc0): 255.255.254.0
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: New IP Address (igc0): 173.[redacted]
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: New Hostname (igc0): OPN100
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: Reason BOUND on igc0 executing
2024-06-25T05:28:00-04:00 Notice dhclient dhclient-script: Reason ARPCHECK on igc0 executing
2024-06-25T05:27:58-04:00 Notice dhclient dhclient-script: Reason ARPSEND on igc0 executing
2024-06-25T05:27:44-04:00 Notice dhcp6c status code: unspec failure
2024-06-25T05:27:44-04:00 Notice dhcp6c Received REPLY for REQUEST
2024-06-25T05:27:44-04:00 Notice dhcp6c Sending Request
2024-06-25T05:27:43-04:00 Notice dhcp6c Sending Solicit
2024-06-25T05:27:43-04:00 Notice dhclient dhclient-script: Reason PREINIT on igc0 executing
2024-06-25T05:27:42-04:00 Critical dhclient exiting.
2024-06-25T05:27:42-04:00 Error dhclient connection closed
2024-06-25T05:27:42-04:00 Notice dhcp6c remove an address 2607:[redacted]/64 on bridge0
2024-06-25T05:27:42-04:00 Notice dhcp6c Bypassing address release because of -n flag
2024-06-25T05:27:42-04:00 Notice dhcp6c failed to remove an address on igc0: Can't assign requested address
2024-06-25T05:27:42-04:00 Notice dhcp6c Bypassing address release because of -n flag
2024-06-25T05:27:42-04:00 Notice dhcp6c restarting

False alarm. I didn't realize my WAN interface, which unbound is set to use as the outgoing interface, lost it's IPV6 address. Probably something to do with the recent IPv6 changes in the changelog? I didn't even notice because the WAN ipv6 is outside the prefix range, so all devices still had routeable IPv6 service.

Simply reapplying the WAN interface IP settings got it's IPv6 address back and now it is working again.

I used to use DNS over TLS with exclusively IPv6 addresses for my unbound upstream. But since about 24.1.9 update, it is not resolving anything when the upstream is IPv6. It keeps giving servfail when the upstream DoT servers are IPv6. My IPv6 connectivity is working.

I had to switch to IPv4 addresses to get resolving working again. Here is a sample of my logs.

2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: cache memory msg=134875 rrset=132184 infra=10768 val=132400   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] reply: ::1 google.com. AAAA IN SERVFAIL 0.000000 0 39   
2024-06-25T01:25:26-04:00   Error   unbound   [96887:3] error: SERVFAIL <google.com. AAAA IN>: all the configured stub or forward servers failed, at zone . no server to query nameserver addresses not usable have no nameserver names   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] info: validator operate: query google.com. AAAA IN   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: validator[module 1] operate: extstate:module_wait_module event:module_event_moddone   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: return error response SERVFAIL   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: configured stub or forward servers failed -- returning SERVFAIL   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] info: processQueryTargets: google.com. AAAA IN   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] info: resolving google.com. AAAA IN   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: iterator[module 2] operate: extstate:module_state_initial event:module_event_pass   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] info: validator operate: query google.com. AAAA IN   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: validator[module 1] operate: extstate:module_state_initial event:module_event_pass   
2024-06-25T01:25:26-04:00   Debug   unbound   [96887:3] debug: worker request: max UDP reply size modified (4096 to max-udp-size)   
2024-06-25T01:25:26-04:00   Informational   unbound   [96887:3] query: ::1 google.com. AAAA IN