Losing WAN Access Every Couple of Hours or Less

[wetware]

Hello Everyone,

I hope you are having a wonderful day! I setup a Single NIC laptop with OPNsense a couple of weeks ago, and since the beginning I have had an issue where the firewall becomes unreachable and we lose WAN access. Usually I press the power button on the laptop, and what is weird is during the shutdown process the network will get WAN access again (until it fully shuts off). It never self corrects either, so if it goes down, and I do not restart it, it will never give WAN access, and the firewall is unreachable via ping/webui.

The setup is:
Modem -> ISP Router in Bridged Mode (Spectrum Business forced the router or we couldn't have a static) -> Managed Switch port 2 -> port 1 tagged vlan99 (WAN) -> OPNsense

I have tried to take a peek at the logs, for example I'll put the logs just from this morning (we lost connection overnight and again around 8:52AM) below the post, and it seems to have this same pattern, but I am far from a firewall expert and not sure how to interpret the information.

I am sure there is more data needed to even figure out what could be causing this, but I'm not sure what that would be! Any help is really appreciated as shutting down the firewall several times a day is really not a pleasing process!

Some things worth noting:

• Originally I assumed it had something to do with getting new WAN ip's, so we purchased a static IP, still happens.
  
• I have completely wiped the firewall from scratch, and reconfigured from scratch, only to have the same issue.
• IPv6 is completely disabled (it seems to happen more frequently when it is enabled)

Warm regards,
nrk allen

(I censored IP's in the log to 1.....9 or something similar)

Date Severity Process Line
Date
Severity
Process
Line
2022-11-24T08:53:08-05:00   Notice   opnsense   plugins_configure newwanip (execute task : webgui_configure_do(,lan))   
2022-11-24T08:53:08-05:00   Notice   opnsense   plugins_configure newwanip (execute task : vxlan_configure_do())   
2022-11-24T08:53:07-05:00   Notice   opnsense   plugins_configure newwanip (execute task : unbound_configure_do(,lan))   
2022-11-24T08:53:07-05:00   Notice   opnsense   plugins_configure newwanip (execute task : openssh_configure_do(,lan))   
2022-11-24T08:53:07-05:00   Notice   opnsense   plugins_configure newwanip (execute task : opendns_configure_do())   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure newwanip (execute task : ntpd_configure_do())   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure newwanip (execute task : dnsmasq_configure_do())   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure newwanip (,lan)   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(,lan))   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(,lan))   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure vpn (,lan)   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(,))   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure monitor (,)   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: skipping IPv4 default route   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'lan'   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: On (IP address: 192.168.1.1) (interface: LAN[lan]) (real interface: re0_vlan10).   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 're0_vlan10'   
2022-11-24T08:53:02-05:00   Error   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for static lan(re0_vlan10)   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure newwanip (execute task : webgui_configure_do(,wan))   
2022-11-24T08:53:02-05:00   Notice   opnsense   plugins_configure newwanip (execute task : vxlan_configure_do())   
2022-11-24T08:53:01-05:00   Notice   opnsense   plugins_configure newwanip (execute task : unbound_configure_do(,wan))   
2022-11-24T08:53:01-05:00   Notice   opnsense   plugins_configure newwanip (execute task : openssh_configure_do(,wan))   
2022-11-24T08:53:01-05:00   Notice   opnsense   plugins_configure newwanip (execute task : opendns_configure_do())   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure newwanip (execute task : ntpd_configure_do())   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure newwanip (execute task : dnsmasq_configure_do())   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure newwanip (,wan)   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(,wan))   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(,wan))   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure vpn (,wan)   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(,WAN_GWv4))   
2022-11-24T08:52:59-05:00   Notice   opnsense   plugins_configure monitor (,WAN_GWv4)   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: keeping current default gateway ‘1….9’   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: setting IPv4 default route to 1..…..9   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: On (IP address: 1....0) (interface: WAN[wan]) (real interface: re0_vlan99).   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 're0_vlan99'   
2022-11-24T08:52:59-05:00   Error   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for static wan(re0_vlan99)   
2022-11-24T08:52:59-05:00   Notice   syslog-ng   Configuration reload finished;   
2022-11-24T08:52:59-05:00   Notice   syslog-ng   Configuration reload request received, reloading configuration;   
2022-11-24T08:52:58-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(1,))   
2022-11-24T08:52:58-05:00   Notice   opnsense   plugins_configure monitor (1,)   
2022-11-24T08:52:58-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: keeping current default gateway ‘1…..9’   
2022-11-24T08:52:58-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: setting IPv4 default route to 1……9   
2022-11-24T08:52:58-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: IPv4 default gateway set to wan   
2022-11-24T08:52:58-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: entering configure using defaults   
2022-11-24T08:52:57-05:00   Notice   opnsense   plugins_configure bootup (execute task : unbound_configure_do(1))   
2022-11-24T08:52:57-05:00   Notice   opnsense   plugins_configure bootup (execute task : opendns_configure_do(1))   
2022-11-24T08:52:57-05:00   Notice   opnsense   plugins_configure bootup (execute task : ntpd_configure_do(1))   
2022-11-24T08:52:57-05:00   Notice   opnsense   plugins_configure bootup (1)   
2022-11-24T08:52:57-05:00   Error   opnsense   /usr/local/etc/rc.bootup: Resyncing OpenVPN instances.   
2022-11-24T08:52:57-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure vpn (1)   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(1,,1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure monitor (1,,1)   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dns (execute task : unbound_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dns (execute task : dnsmasq_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dns (1)   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dhcrelay (execute task : dhcpd_dhcrelay_configure(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dhcrelay (1)   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dhcp (execute task : dhcpd_dhcp_configure(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure dhcp (1)   
2022-11-24T08:52:55-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: creating /tmp/re0_vlan99_defaultgw using '1.......9'   
2022-11-24T08:52:55-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: setting IPv4 default route to 1......9   
2022-11-24T08:52:55-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: IPv4 default gateway set to wan   
2022-11-24T08:52:55-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: entering configure using defaults   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure early (execute task : webgui_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure early (execute task : unbound_cache_flush(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure early (execute task : openssh_configure_do(1))   
2022-11-24T08:52:55-05:00   Notice   opnsense   plugins_configure early (1)   
2022-11-24T08:52:55-05:00   Notice   syslog-ng   syslog-ng starting up; version='3.38.1'   
2022-11-24T08:52:07-05:00   Notice   syslog-ng   syslog-ng shutting down; version='3.38.1'   
2022-11-24T07:36:25-05:00   Notice   opnsense   plugins_configure newwanip (execute task : webgui_configure_do(,lan))   
2022-11-24T07:36:25-05:00   Notice   opnsense   plugins_configure newwanip (execute task : vxlan_configure_do())   
2022-11-24T07:36:24-05:00   Notice   opnsense   plugins_configure newwanip (execute task : unbound_configure_do(,lan))   
2022-11-24T07:36:24-05:00   Notice   opnsense   plugins_configure newwanip (execute task : openssh_configure_do(,lan))   
2022-11-24T07:36:24-05:00   Notice   opnsense   plugins_configure newwanip (execute task : opendns_configure_do())   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure newwanip (execute task : ntpd_configure_do())   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure newwanip (execute task : dnsmasq_configure_do())   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure newwanip (,lan)   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(,lan))   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(,lan))   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure vpn (,lan)   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(,))   
2022-11-24T07:36:19-05:00   Notice   opnsense   plugins_configure monitor (,)   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: skipping IPv4 default route   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'lan'   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: On (IP address: 192.168.1.1) (interface: LAN[lan]) (real interface: re0_vlan10).   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 're0_vlan10'   
2022-11-24T07:36:19-05:00   Error   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for static lan(re0_vlan10)   
2022-11-24T07:36:18-05:00   Notice   opnsense   plugins_configure newwanip (execute task : webgui_configure_do(,wan))   
2022-11-24T07:36:18-05:00   Notice   opnsense   plugins_configure newwanip (execute task : vxlan_configure_do())   
2022-11-24T07:36:18-05:00   Notice   opnsense   plugins_configure newwanip (execute task : unbound_configure_do(,wan))   
2022-11-24T07:36:18-05:00   Notice   opnsense   plugins_configure newwanip (execute task : openssh_configure_do(,wan))   
2022-11-24T07:36:18-05:00   Notice   opnsense   plugins_configure newwanip (execute task : opendns_configure_do())   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure newwanip (execute task : ntpd_configure_do())   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure newwanip (execute task : dnsmasq_configure_do())   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure newwanip (,wan)   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(,wan))   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(,wan))   
2022-11-24T07:36:17-05:00   Notice   opnsense   plugins_configure vpn (,wan)   
2022-11-24T07:36:16-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(,WAN_GWv4))   
2022-11-24T07:36:16-05:00   Notice   opnsense   plugins_configure monitor (,WAN_GWv4)   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: keeping current default gateway ‘1……9’   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: setting IPv4 default route to 1.....9   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: On (IP address: 1......0) (interface: WAN[wan]) (real interface: re0_vlan99).   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 're0_vlan99'   
2022-11-24T07:36:16-05:00   Error   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for static wan(re0_vlan99)   
2022-11-24T07:36:16-05:00   Notice   syslog-ng   Configuration reload finished;   
2022-11-24T07:36:16-05:00   Notice   syslog-ng   Configuration reload request received, reloading configuration;   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(1,))   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure monitor (1,)   
2022-11-24T07:36:15-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: keeping current default gateway ‘1……9’   
2022-11-24T07:36:15-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: setting IPv4 default route to 1….9   
2022-11-24T07:36:15-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: IPv4 default gateway set to wan   
2022-11-24T07:36:15-05:00   Error   opnsense   /usr/local/etc/rc.routing_configure: ROUTING: entering configure using defaults   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure bootup (execute task : unbound_configure_do(1))   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure bootup (execute task : opendns_configure_do(1))   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure bootup (execute task : ntpd_configure_do(1))   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure bootup (1)   
2022-11-24T07:36:15-05:00   Error   opnsense   /usr/local/etc/rc.bootup: Resyncing OpenVPN instances.   
2022-11-24T07:36:15-05:00   Notice   opnsense   plugins_configure vpn (execute task : openvpn_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure vpn (execute task : ipsec_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure vpn (1)   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure monitor (execute task : dpinger_configure_do(1,,1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure monitor (1,,1)   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dns (execute task : unbound_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dns (execute task : dnsmasq_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dns (1)   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dhcrelay (execute task : dhcpd_dhcrelay_configure(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dhcrelay (1)   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dhcp (execute task : dhcpd_dhcp_configure(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure dhcp (1)   
2022-11-24T07:36:12-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: creating /tmp/re0_vlan99_defaultgw using '1......9'   
2022-11-24T07:36:12-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: setting IPv4 default route to 1.......9   
2022-11-24T07:36:12-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: IPv4 default gateway set to wan   
2022-11-24T07:36:12-05:00   Error   opnsense   /usr/local/etc/rc.bootup: ROUTING: entering configure using defaults   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure early (execute task : webgui_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure early (execute task : unbound_cache_flush(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure early (execute task : openssh_configure_do(1))   
2022-11-24T07:36:12-05:00   Notice   opnsense   plugins_configure early (1)   
2022-11-24T07:36:12-05:00   Notice   syslog-ng   syslog-ng starting up; version='3.38.1'   
2022-11-24T07:35:22-05:00   Notice   syslog-ng   syslog-ng shutting down; version='3.38.1'   
2022-11-24T01:04:06-05:00   Notice   configctl   event @ 1669269845.85 exec: system event config_changed   
2022-11-24T01:04:06-05:00   Notice   configctl   event @ 1669269845.85 msg: Nov 24 01:04:05 KA-FW.k......n config[39049]: [2022-11-24T01:04:05-05:00][INFO] config-event: new_config /conf/backup/config-1669269845.8515.xml

[cookiemonster]

In general if you can, avoid use of realtek network interfaces, but if you don't have a choice, be prepared it could be a painful process to diagnose, even if it is to confirm a problem with the card/interface.

[wetware]

Hm! Interesting, it had not even occurred to me that it could be caused by that, I have some other hardware I can try installing OPNsense on, I'll find one that isn't Realtek and give it a go. Thanks for the tip!