OPNSense drops wan connection when internet is push to its limits

[phanos]

Hi I am running latest OPNSense (OPNsense 23.7.12-amd64) on Fujitsu Futro S920 (2.2 GHz cpu, 8GB rams enough disk space).

Although OPNSense seems to be running smooth I notice that when I push my internet connection to its limits by using an accelerator program like axel (linux) the connection is lost for a few moments and then it connected again. All active connections are lost (VPN, downloading etc) and I have to reconnect - reestablished them

In the system log I see the following

<13>1 2024-01-24T10:50:22+02:00 homerouter.phanosp.com kernel - - [meta sequenceId="1"] <6>re0: watchdog timeout                                                                                            [11/2030]
<13>1 2024-01-24T10:50:22+02:00 homerouter.phanosp.com kernel - - [meta sequenceId="2"] <6>re0: link state changed to DOWN                                                                                           
<13>1 2024-01-24T10:50:23+02:00 homerouter.phanosp.com opnsense 43721 - [meta sequenceId="3"] /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for wan(re0)                                                   
<27>1 2024-01-24T10:50:23+02:00 homerouter.phanosp.com dhclient 42195 - [meta sequenceId="4"] connection closed                                                                                                      
<26>1 2024-01-24T10:50:23+02:00 homerouter.phanosp.com dhclient 42195 - [meta sequenceId="5"] exiting.                                                                                                               
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com kernel - - [meta sequenceId="6"] <6>re0: link state changed to UP                                                                                             
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="7"] /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for wan(re0)                                                   
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com dhclient 54160 - [meta sequenceId="8"] New IP Address (re0): 192.168.0.20                                                                                     
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com dhclient 55125 - [meta sequenceId="9"] New Subnet Mask (re0): 255.255.255.0                                                                                   
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com dhclient 56353 - [meta sequenceId="10"] New Broadcast Address (re0): 192.168.0.255                                                                            
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com dhclient 57306 - [meta sequenceId="11"] New Routers (re0): 192.168.0.1                                                                                        
<13>1 2024-01-24T10:50:27+02:00 homerouter.phanosp.com dhclient 58836 - [meta sequenceId="12"] Creating resolv.conf                                                                                                  
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="13"] /usr/local/etc/rc.linkup: ROUTING: entering configure using 'wan'                                                     
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="14"] /usr/local/etc/rc.linkup: ROUTING: configuring inet default gateway on wan                                            
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="15"] /usr/local/etc/rc.linkup: ROUTING: setting inet default route to 192.168.0.1                                          
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="16"] /usr/local/etc/rc.linkup: plugins_configure monitor (,WAN_DHCP)                                                       
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="17"] /usr/local/etc/rc.linkup: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))                  
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="18"] /usr/local/etc/rc.linkup: plugins_configure monitor (,WAN_DHCP6)                                                      
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="19"] /usr/local/etc/rc.linkup: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))                 
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="20"] /usr/local/etc/rc.linkup: plugins_configure ipsec (,wan)                                                              
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="21"] /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,wan))                           
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="22"] /usr/local/etc/rc.linkup: plugins_configure dhcp ()                                                                   
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="23"] /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())                              
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="24"] /usr/local/etc/rc.newwanip: IP renewal starting (new: 192.168.0.20, old: 192.168.0.20, interface: wan, device: re0, fo
rce: yes)                                                                                                                                                                                                            
<13>1 2024-01-24T10:50:28+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="25"] /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'                                                   
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="26"] /usr/local/etc/rc.newwanip: ROUTING: configuring inet default gateway on wan                                          
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="27"] /usr/local/etc/rc.newwanip: ROUTING: keeping inet default route to 192.168.0.1                                        
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="28"] /usr/local/etc/rc.newwanip: plugins_configure monitor (,WAN_DHCP)                                                     <13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="29"] /usr/local/etc/rc.newwanip: plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))                
<12>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="30"] /usr/local/etc/rc.linkup: dhcpd_radvd_configure(auto) found no suitable IPv6 address on lan(bridge0)                  
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="31"] /usr/local/etc/rc.linkup: plugins_configure dns ()
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="32"] /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
<13>1 2024-01-24T10:50:29+02:00 homerouter.phanosp.com opnsense 49458 - [meta sequenceId="33"] /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
<13>1 2024-01-24T10:50:31+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="34"] /usr/local/etc/rc.newwanip: plugins_configure vpn (,wan)
<13>1 2024-01-24T10:50:31+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="35"] /usr/local/etc/rc.newwanip: plugins_configure vpn (execute task : ipsec_configure_do(,wan))
<13>1 2024-01-24T10:50:31+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="36"] /usr/local/etc/rc.newwanip: plugins_configure vpn (execute task : openvpn_configure_do(,wan))
<13>1 2024-01-24T10:50:31+02:00 homerouter.phanosp.com opnsense 59987 - [meta sequenceId="37"] /usr/local/etc/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
<13>1 2024-01-24T10:50:31+02:00 homerouter.phanosp.com kernel - - [meta sequenceId="38"] <6>ovpns1: link state changed to DOWN

Can someone help me pinpoint the issue and perhaps how to resolved it? Could it a hardware problem or a software issue on the OPNSense side?

[cookiemonster]

Code Select Expand

<13>1 2024-01-24T10:50:22+02:00 homerouter.phanosp.com kernel - - [meta sequenceId="1"] <6>re0: watchdog timeout   
Realtek NICs suffer from this. They can't keep up with traffic. You could try if you haven't yet, using the vendor's driver.

[phanos]

Thanks but how do I use the vendor's driver? Can you see it from the logs which one I am using?

[cookiemonster]

if you haven't done it then you are using default, which is not the vendor's one.
If I remember correctly you can get this one easy from the plugins, packages, etc pages. Look for something like os-realtek or similar. Will need reboot I imagine.

[phanos]

Thanks just installed it and reboot the router. Will test and report back.

Phanos

[phanos]

After

1) Installing the os-realtek-re package, and
2) Rebooting the router I did not notice the issue again

Of course it has only been one day but the connection seems stable for now. If something happens I will report back to let you know.