[SOLVED] Loss of connectivity after reboot of modem

[mg85]

Hi!

I used the search function to find possible related topics, but was not able to find any.
I’m noticing quite a strange behaviour after updating to 22.7. Maybe others can guide me in the right direction of solving this.
Whenever I reboot my cable modem (in bridge mode), the firewall loses connectivity once the modem comes up again.
This wasn’t a problem before, so I am expecting this to possibly be software related. No cables are changed, neither the public WAN IP or the configuration.

The interfaces (WAN) and gateways are showing as ‘online’ and ‘green’.
After rebooting the firewall as well, everything is fine again.

I am looking for pointers on where to start troubleshooting to fix this (our cable modem is quirky every now and then and requires a reboot to be revived

[axsdenied]

I'm wonder if your issue is related to another problem I've seen.  When it happens again, go into SYSTEM:GATEWAYS:SINGLE.

Press Edit on your WAN, make NO changes, and then press save.

[mg85]

I'm wonder if your issue is related to another problem I've seen.  When it happens again, go into SYSTEM:GATEWAYS:SINGLE.

Press Edit on your WAN, make NO changes, and then press save.

Thank you for the tip. I’ve just tried that, and this does not work (this fixed an issue I had while running pfSense before though and restoring from scratch using the xml approach).

When pulling the cable from the WAN interface I can replay the situation.
- After reconnecting, the gateway shows as online again.
- Restarting Unbound does not have any positive effect.
- I do reject leases from 192.168.100.1 on the wan interface to prevent the cable modem from temporarily handing out an own dhcp lease.
- I have also disabled gateway monitoring

Here’s the log from System > Log Files > General (if that is of help):

2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.routing_configure: The WAN_DHCP monitor address is empty   skipping.
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.routing_configure: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.routing_configure: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.routing_configure: ROUTING: IPv4 default gateway set to wan   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.routing_configure: ROUTING: entering configure using defaults   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.newwanip: The WAN_DHCP monitor address is empty   skipping.
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.newwanip: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.newwanip: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan   
2022-08-27T09:05:07    Error    opnsense     /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'   
2022-08-27T09:05:06    Error    opnsense     /usr/local/etc/rc.newwanip: On (IP address: x.x.x.x) (interface: WAN[wan]) (real interface: igb1).   
2022-08-27T09:05:06    Error    opnsense     /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 'igb1'   
2022-08-27T09:05:04    Error    php     /usr/local/etc/rc.bootup: Resyncing OpenVPN instances.   
2022-08-27T09:05:01    Error    php     /usr/local/etc/rc.bootup: The WAN_DHCP monitor address is empty   skipping.
2022-08-27T09:04:58    Error    php     /usr/local/etc/rc.bootup: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T09:04:58    Error    php     /usr/local/etc/rc.bootup: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T09:04:58    Error    php     /usr/local/etc/rc.bootup: ROUTING: IPv4 default gateway set to wan   
2022-08-27T09:04:58    Error    php     /usr/local/etc/rc.bootup: ROUTING: entering configure using defaults   
2022-08-27T09:04:57    Error    opnsense     /usr/local/etc/rc.newwanip: IP renewal deferred during boot on 'igb1'   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.newwanip: On (IP address: x.x.x.x) (interface: WAN[wan]) (real interface: igb1).   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 'igb1'   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.configure_interface: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.configure_interface: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.configure_interface: ROUTING: IPv4 default gateway set to wan   
2022-08-27T09:03:16    Error    opnsense     /usr/local/etc/rc.configure_interface: ROUTING: entering configure using 'wan'   
2022-08-27T09:03:09    Error    opnsense     /status_interfaces.php: Clearing states for stale wan route on igb1   
2022-08-27T09:03:08    Critical    dhclient     exiting.   
2022-08-27T09:03:08    Error    dhclient     connection closed   
2022-08-27T09:00:16    Error    opnsense     /system_gateways.php: The WAN_DHCP monitor address is empty   skipping.
2022-08-27T09:00:16    Error    opnsense     /system_gateways.php: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T09:00:16    Error    opnsense     /system_gateways.php: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T09:00:16    Error    opnsense     /system_gateways.php: ROUTING: IPv4 default gateway set to wan   
2022-08-27T09:00:16    Error    opnsense     /system_gateways.php: ROUTING: entering configure using defaults   
2022-08-27T08:59:31    Error    opnsense     /usr/local/etc/rc.newwanip: On (IP address: x.x.x.x) (interface: WAN[wan]) (real interface: igb1).   
2022-08-27T08:59:31    Error    opnsense     /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 'igb1'   
2022-08-27T08:59:30    Error    opnsense     /usr/local/etc/rc.linkup: ROUTING: keeping current default gateway 'x.x.x.x'   
2022-08-27T08:59:30    Error    opnsense     /usr/local/etc/rc.linkup: ROUTING: setting IPv4 default route to x.x.x.x   
2022-08-27T08:59:30    Error    opnsense     /usr/local/etc/rc.linkup: ROUTING: IPv4 default gateway set to wan   
2022-08-27T08:59:30    Error    opnsense     /usr/local/etc/rc.linkup: ROUTING: entering configure using 'wan'   
2022-08-27T08:59:30    Error    opnsense     /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for dynamic wan(igb1)   
2022-08-27T08:58:54    Error    opnsense     /usr/local/etc/rc.linkup: Clearing states for stale wan route on igb1   
2022-08-27T08:58:54    Critical    dhclient     exiting.   
2022-08-27T08:58:54    Error    dhclient     connection closed   
2022-08-27T08:58:54    Error    opnsense     /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for dynamic wan(igb1)   

[axsdenied]

Are you spoofing your MAC address by chance?

[mg85]

No. It looks to be happening since the 22.7 update. Will have to test with 22.1 and a backup to confirm.

[mg85]

Ok, so I have found the solution after doing some tests.
I have installed 22.7 and restored my configuration. I was able to replicate the behavior.
This made me think, as this did not occur when I initially did a fresh 22.7 install with a restore of the configuration.
I compared an older 22.1 backup with this one, and what I found out, is that the “gateway” section was completely empty (I did not go into that section in the GUI after all, so quite strange?). I copied over the entry from the 22.1 backup, restored and tested. Now the problem is gone .

Perhaps this was just a coincidence, and not a bug as such.
Happy to report this as “solved” now.

Many thanks to the OPNsense team for their great and hard work

[mg85]

Spoke a little too soon. Issue still there.
I have installed 22.7 fresh and restored my backup. Rebooted the firewall, then the modem, gateway comes up as well as connectivity (Unbound is auto-restarting as well I see on the dashboard).

This would confirm a bug slipped into 22.7.1 or .2, causing what I notice.
In case anyone else has a setup with cable modem in bridge mode, serving DHCP WAN, would you mind giving this a try to see if you’re facing the same?

I will raise a bug on GitHub in the meantime. First have to set myself up there.

[axsdenied]

I'm in this exact configuration and I don't have this issue.

Maybe lets define what you mean by "loses connectivity".  Does this mean you lose DNS lookup or actually unable to route? i.e. ping an IP Address outside of your network, not a domain name.

[mg85]

Hi all,

I managed to fix this by upgrading to 22.7.3.