Missing ip upon WAN DHCP renewal

[kaninfrans]

Hi,

I've recently noticed random "internet outages" for 1-5 minutes random during the day. After some troubleshooting it seems to be related to DHCP renewals. The lease time from the ISP is 10800 seconds, and it sure matches with the outages every 3 hours.

I've been reviewing logs, tcpdump etc. and can't find anything really useful, so I hope that you guys can point me in the right direction.

I've verified that igb1 is missing its IP and that netstat -rn shows no default gateway, when the problem occurs.

The only related logs I can find are the following, which happens every 3 hour:

Code Select Expand

Jul 17 03:51:20  opnsense: plugins_configure vpn (,wan)
Jul 17 03:51:20  opnsense: plugins_configure vpn (execute task : ipsec_configure_do(,wan))
Jul 17 03:51:20  opnsense: plugins_configure vpn (execute task : openvpn_configure_do(,wan))
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
Jul 17 03:51:20  opnsense: plugins_configure newwanip (,wan)
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : dyndns_configure_do(,wan))
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : ntpd_configure_defer())
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : opendns_configure_do())
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : openssh_configure_do(,wan))
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : unbound_configure_do(,wan))
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : vxlan_configure_interface())
Jul 17 03:51:20  opnsense: plugins_configure newwanip (execute task : webgui_configure_do(,wan))
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: Accept router advertisements on interface igb1
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: entering configure using 'wan'
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: IPv4 default gateway set to wan
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: setting IPv4 default route to x.y.z.1
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: keeping current default gateway 'x.y.z.1'
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: IPv6 default gateway set to wan
Jul 17 03:51:20  opnsense: /usr/local/etc/rc.linkup: ROUTING: skipping IPv6 default route
Jul 17 03:51:20  opnsense: plugins_configure ipsec (,wan)
Jul 17 03:51:20  opnsense: plugins_configure ipsec (execute task : ipsec_configure_do(,wan))
Jul 17 03:51:20  opnsense: plugins_configure dhcp ()
Jul 17 03:51:20  opnsense: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
Jul 17 03:51:21  opnsense: plugins_configure dns ()
Jul 17 03:51:21  opnsense: plugins_configure dns (execute task : dnsmasq_configure_do())
Jul 17 03:51:21  opnsense: plugins_configure dns (execute task : unbound_configure_do())


OPNsense 20.1.8_1-amd64
FreeBSD 11.2-RELEASE-p20-HBSD
OpenSSL 1.1.1g 21 Apr 2020
Hardware: PC Engine APU2C4

[kaninfrans]

Upgraded BIOS, and now I got the following in the log:

Code Select Expand

Jul 20 21:12:13 kernel: igb1: link state changed to DOWN
Jul 20 21:12:13 opnsense: /usr/local/etc/rc.linkup: DEVD Ethernet detached event for wan
Jul 20 21:12:13 dhclient[29881]: connection closed
Jul 20 21:12:13 dhclient[29881]: exiting.
Jul 20 21:12:13 opnsense: /usr/local/etc/rc.linkup: Clearing states for stale wan route on igb1
Jul 20 21:12:18 kernel: pflog0: promiscuous mode disabled
Jul 20 21:12:18 kernel: pflog0: promiscuous mode enabled
Jul 20 21:12:28 kernel: pflog0: promiscuous mode disabled
Jul 20 21:12:28 kernel: pflog0: promiscuous mode enabled
Jul 20 21:13:06 kernel: igb1: link state changed to UP

I guess bad drivers or defect hardware?

It seems like there's a newer version of the driver, I'm currently running 2.5.3, and Intel have 2.5.9 released. Anyone with experience about upgrading drivers?

[kaninfrans]

Changed interface to igb2, same issue. Inserted an old cisco switch inbetween Opnsense and ISP modem, wolla. No more interface errors, but still internet loss. Cisco log shows interface to ISP down..
Guess I have to start a new discussion with them :)