Messages

I am encountering the same problem and curious if there is an answer?  Trying to determine if I need to upgrade to 23.1x or not

So I've access to the BGW210 modem and had previously set the port to 1Gb full duplex.  The MTU setting is still in flight, as I'm also finding issue with other parts of my network.  The modem is set for MTU 1500, which is standard on many of the laptops, but my 10Gb Fiber connection from my C220 to my Aruba switch was set at MTU 9000 and it was causing havoc to Cloudflared Zero Trust tunnels.  I just set it to MTU 1400 and my tunnels are connecting.  Just a lot SysAdmin work that I did not want to learn and had hoped were more/less standardized.  But you are right, there is still a problem.

And did you add any parameters to Interfaces -> WAN --> DHCP client configuration (one of the tabs)? Is 'override MTU' ticked?

I had similar issues when I started with opnsense some years back and had to add this to the 'Option modifiers':

supersede interface-mtu 0

Which was for a specific ISP here in my country, but it might help in your case.

So I posted before reading scrensen suggestion.  My MTU override is checked.  What does the "supersede interface-mtu 0" do exactly?  I'll read up.

Update...[Solved? we'll see...]

So I've swapped cables, ports, power supplies, turned down services, disconnected Cisco C220 & Rpi servers, disconnected the LAN, disconnect Ruckus ZD1200 & AP's, etc...until there was nothing but the OPNSense N5105 and the AT&T BGW210-700 modem (and AT&T fiber ONT)...no joy.  Was still WAN Flapping.

So here's the crazy part, I'm about to pull the N5105 device out and reflash it when...In a Google search I found an obscure link to others having similar problems over on the pfSense forum, with much of the dialogue centered around the older i225 ports.  I have 4xIntel i226-V 2.5G ports on my Topton.  Some had indicated that the problem went away when they downgraded their link speed from 1000baseT to 100baseT.  Continuing the testing, they had "solved" it by putting a small unmanaged switch between the isp's modem (AT&T Arris BGW210-700 modem in my case) and the Topton N5105 WAN port. What the hell, I've got a small 6 port gigabit switch, let's try it...and what do you know...the WAN port stopped Flapping.  Gave it a few hours and reconnected the rest of the LAN elements slowly watching for the tell tale Critical Errors along the way, and it has not flapped in over 48hrs.  My calls on Friday (yesterday) on Microsoft Teams went smooth with no clipping.

So, later that Friday when I was finished in the work day (and when no one was home), I upgraded back to 22.7.10_2 for giggles.  No problems so far. As of now, all my LAN elements are back connected and my network appears stable.  If that changes, I'll report back.

I can't say I understand it and maybe one of you smart guys can, but all I can assume is there is something sensitive in the electrical aspects of the 1GbE & 2.5GbE ports.  Oh and the unmanaged switch is 1GbE ports for reference. 

Ok, my WAN flapping paused when I reverted to 22.7.7, but did not stop.  I swapped ethernet cables and reset ISP modems.  All my ports on my ISP have always been set to 1Gb Full Duplex instead of Auto. I have disconnected Pi-Hole, and other servers (SeaFile, PhotoPrism, etc..) as recommended.

Here is an excerpt from my Latest System Log (IP addresses redacted), in hopes it means something to someone...

Code Select Expand

<11>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan opnsense 95022 - [meta sequenceId="1"] /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for dynamic wan(igc0)
<13>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan opnsense 95022 - [meta sequenceId="2"] plugins_configure dhcp (,inet6,Array)
<13>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan opnsense 95022 - [meta sequenceId="3"] plugins_configure dhcp (execute task : dhcpd_dhcp_configure(,inet6,Array))
<27>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="4"] transmit failed: Network is down
<27>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="5"] transmit failed: Network is down
<27>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan dhclient 93272 - [meta sequenceId="6"] connection closed
<26>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan dhclient 93272 - [meta sequenceId="7"] exiting.
<11>1 2023-01-12T01:55:34-06:00 OPNsense.solarczar.lan opnsense 95022 - [meta sequenceId="8"] /usr/local/etc/rc.linkup: Clearing states for stale wan route on igc0
<27>1 2023-01-12T01:55:35-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="9"] transmit failed: Network is down
<27>1 2023-01-12T01:55:35-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="10"] transmit failed: Network is down
<27>1 2023-01-12T01:55:35-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="11"] transmit failed: Network is down
<27>1 2023-01-12T01:55:36-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="12"] transmit failed: Network is down
<27>1 2023-01-12T01:55:37-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="13"] transmit failed: Network is down
<27>1 2023-01-12T01:55:37-06:00 OPNsense.solarczar.lan dhcp6c 22215 - [meta sequenceId="14"] transmit failed: Network is down
<11>1 2023-01-12T01:55:38-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="15"] /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for dynamic wan(igc0)
<27>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 32968 - [meta sequenceId="16"] unknown dhcp option value 0x7d
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 38642 - [meta sequenceId="17"] New IP Address (igc0): 172.x.x.23
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 40307 - [meta sequenceId="18"] New Subnet Mask (igc0): 255.255.252.0
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 43247 - [meta sequenceId="19"] New Broadcast Address (igc0): 172.x.x.255
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 46066 - [meta sequenceId="20"] New Routers (igc0): 172.x.x.1
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 50625 - [meta sequenceId="21"] route add default 172.x.x.1
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhclient 52482 - [meta sequenceId="22"] Creating resolv.conf
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhcp6c 62857 - [meta sequenceId="23"] RTSOLD script - Sending SIGHUP to dhcp6c
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="24"] /usr/local/etc/rc.linkup: ROUTING: entering configure using 'wan'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="25"] /usr/local/etc/rc.linkup: ROUTING: IPv4 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="26"] /usr/local/etc/rc.linkup: ROUTING: setting IPv4 default route to 172.x.x.1
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="27"] /usr/local/etc/rc.linkup: ROUTING: keeping current default gateway '172.x.x.1'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="28"] /usr/local/etc/rc.linkup: ROUTING: IPv6 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="29"] /usr/local/etc/rc.linkup: ROUTING: skipping IPv6 default route
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="30"] plugins_configure monitor (,WAN_DHCP6)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="31"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="32"] /usr/local/etc/rc.linkup: The WAN_DHCP6 monitor address is empty, skipping.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="33"] plugins_configure monitor (,WAN_DHCP)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="34"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="35"] /usr/local/etc/rc.newwanip: IPv4 renewal is starting on 'igc0'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="36"] /usr/local/etc/rc.newwanip: On (IP address:  172.x.x.23) (interface: WAN[wan]) (real interface: igc0).
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="37"] /usr/local/etc/rc.linkup: The WAN_DHCP monitor address is empty, skipping.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="38"] plugins_configure ipsec (,wan)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="39"] plugins_configure ipsec (execute task : ipsec_configure_do(,wan))
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="40"] plugins_configure dhcp ()
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="41"] plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="42"] /usr/local/etc/rc.newwanip: ROUTING: entering configure using 'wan'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="43"] /usr/local/etc/rc.newwanip: ROUTING: IPv4 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="44"] /usr/local/etc/rc.newwanip: ROUTING: setting IPv4 default route to 172.x.x.1
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="45"] /usr/local/etc/rc.newwanip: ROUTING: keeping current default gateway '172.x.x.1'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="46"] /usr/local/etc/rc.newwanip: ROUTING: IPv6 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="47"] /usr/local/etc/rc.newwanip: ROUTING: skipping IPv6 default route
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="48"] plugins_configure monitor (,WAN_DHCP6)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="49"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="50"] /usr/local/etc/rc.newwanip: The WAN_DHCP6 monitor address is empty, skipping.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="51"] plugins_configure monitor (,WAN_DHCP)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="52"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 55410 - [meta sequenceId="53"] /usr/local/etc/rc.newwanip: The WAN_DHCP monitor address is empty, skipping.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="54"] plugins_configure dns ()
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="55"] plugins_configure dns (execute task : dnsmasq_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 29401 - [meta sequenceId="56"] plugins_configure dns (execute task : unbound_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="57"] plugins_configure vpn (,wan)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="58"] plugins_configure vpn (execute task : ipsec_configure_do(,wan))
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="59"] plugins_configure vpn (execute task : openvpn_configure_do(,wan))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="60"] /usr/local/etc/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="61"] plugins_configure newwanip (,wan)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="62"] plugins_configure newwanip (execute task : dnsmasq_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="63"] plugins_configure newwanip (execute task : ntpd_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="64"] plugins_configure newwanip (execute task : opendns_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="65"] plugins_configure newwanip (execute task : openssh_configure_do(,wan))
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="66"] plugins_configure newwanip (execute task : unbound_configure_do(,wan))
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="67"] plugins_configure newwanip (execute task : vxlan_configure_do())
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan php 55410 - [meta sequenceId="68"] plugins_configure newwanip (execute task : webgui_configure_do(,wan))
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan dhcp6c 16285 - [meta sequenceId="69"] dhcp6c REQUEST on igc0 - running newipv6
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="70"] /usr/local/etc/rc.newwanipv6: IPv6 renewal is starting on 'igc0'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="71"] /usr/local/etc/rc.newwanipv6: On (IP address: 2600:x:x:x:45) (interface: WAN[wan]) (real interface: igc0).
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="72"] plugins_configure dhcp (,inet6)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="73"] plugins_configure dhcp (execute task : dhcpd_dhcp_configure(,inet6))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="74"] /usr/local/etc/rc.newwanipv6: ROUTING: entering configure using 'wan'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="75"] /usr/local/etc/rc.newwanipv6: ROUTING: IPv4 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="76"] /usr/local/etc/rc.newwanipv6: ROUTING: setting IPv4 default route to 172.x.x.1
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="77"] /usr/local/etc/rc.newwanipv6: ROUTING: keeping current default gateway '172.x.x.1'
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="78"] /usr/local/etc/rc.newwanipv6: ROUTING: IPv6 default gateway set to wan
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="79"] /usr/local/etc/rc.newwanipv6: ROUTING: skipping IPv6 default route
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="80"] plugins_configure monitor (,WAN_DHCP6)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="81"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="82"] /usr/local/etc/rc.newwanipv6: The WAN_DHCP6 monitor address is empty, skipping.
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="83"] plugins_configure monitor (,WAN_DHCP)
<13>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="84"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
<11>1 2023-01-12T01:55:40-06:00 OPNsense.solarczar.lan opnsense 50187 - [meta sequenceId="85"] /usr/local/etc/rc.newwanipv6: The WAN_DHCP monitor address is empty, skipping.
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="86"] plugins_configure vpn (,wan)
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="87"] plugins_configure vpn (execute task : ipsec_configure_do(,wan))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="88"] plugins_configure vpn (execute task : openvpn_configure_do(,wan))
<11>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="89"] /usr/local/etc/rc.newwanipv6: Resyncing OpenVPN instances for interface WAN.
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="90"] plugins_configure newwanip (,wan)
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="91"] plugins_configure newwanip (execute task : dnsmasq_configure_do())
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="92"] plugins_configure newwanip (execute task : ntpd_configure_do())
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan dhcp6c 94912 - [meta sequenceId="93"] RTSOLD script - Sending SIGHUP to dhcp6c
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan dhcp6c 96848 - [meta sequenceId="94"] dhcp6c RELEASE on igc0 - running dns reload
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan dhcp6c 4141 - [meta sequenceId="95"] dhcp6c RELEASE on igc0 - running dns reload
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 2063 - [meta sequenceId="96"] plugins_configure dns_reload (1)
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 2063 - [meta sequenceId="97"] plugins_configure dns_reload (execute task : system_resolvconf_generate(1))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 2063 - [meta sequenceId="98"] plugins_configure dns_reload (execute task : system_hosts_generate(1))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 12184 - [meta sequenceId="99"] plugins_configure dns_reload (1)
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 12184 - [meta sequenceId="100"] plugins_configure dns_reload (execute task : system_resolvconf_generate(1))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="101"] plugins_configure newwanip (execute task : opendns_configure_do())
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="102"] plugins_configure newwanip (execute task : openssh_configure_do(,wan))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="103"] plugins_configure newwanip (execute task : unbound_configure_do(,wan))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="104"] plugins_configure newwanip (execute task : vxlan_configure_do())
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan php 50187 - [meta sequenceId="105"] plugins_configure newwanip (execute task : webgui_configure_do(,wan))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 12184 - [meta sequenceId="106"] plugins_configure dns_reload (execute task : system_hosts_generate(1))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan dhcp6c 65525 - [meta sequenceId="107"] dhcp6c RELEASE on igc0 - running dns reload
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 70493 - [meta sequenceId="108"] plugins_configure dns_reload (1)
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 70493 - [meta sequenceId="109"] plugins_configure dns_reload (execute task : system_resolvconf_generate(1))
<13>1 2023-01-12T01:55:41-06:00 OPNsense.solarczar.lan opnsense 70493 - [meta sequenceId="110"] plugins_configure dns_reload (execute task : system_hosts_generate(1))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan dhcp6c 76199 - [meta sequenceId="111"] dhcp6c REQUEST on igc0 - running newipv6
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="112"] /usr/local/etc/rc.newwanipv6: IPv6 renewal is starting on 'igc0'
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="113"] /usr/local/etc/rc.newwanipv6: On (IP address: 2600:x:x:x:x:x:x:21d9) (interface: WAN[wan]) (real interface: igc0).
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="114"] plugins_configure dhcp (,inet6)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="115"] plugins_configure dhcp (execute task : dhcpd_dhcp_configure(,inet6))
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="116"] /usr/local/etc/rc.newwanipv6: ROUTING: entering configure using 'wan'
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="117"] /usr/local/etc/rc.newwanipv6: ROUTING: IPv4 default gateway set to wan
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="118"] /usr/local/etc/rc.newwanipv6: ROUTING: setting IPv4 default route to 172.x.x.1
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="119"] /usr/local/etc/rc.newwanipv6: ROUTING: keeping current default gateway '172.x.x.1'
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="120"] /usr/local/etc/rc.newwanipv6: ROUTING: IPv6 default gateway set to wan
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="121"] /usr/local/etc/rc.newwanipv6: ROUTING: setting IPv6 default route to fe80::x:x:x:f2b0
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="122"] /usr/local/etc/rc.newwanipv6: ROUTING: keeping current default gateway 'fe80::x:x:x:f2b0%igc0'
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="123"] plugins_configure monitor (,WAN_DHCP6)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="124"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP6))
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="125"] /usr/local/etc/rc.newwanipv6: The WAN_DHCP6 monitor address is empty, skipping.
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="126"] plugins_configure monitor (,WAN_DHCP)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="127"] plugins_configure monitor (execute task : dpinger_configure_do(,WAN_DHCP))
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 80603 - [meta sequenceId="128"] /usr/local/etc/rc.newwanipv6: The WAN_DHCP monitor address is empty, skipping.
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan dhcp6c 96420 - [meta sequenceId="129"] dhcp6c RELEASE on igc0 - running dns reload
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 5438 - [meta sequenceId="130"] plugins_configure dns_reload (1)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 5438 - [meta sequenceId="131"] plugins_configure dns_reload (execute task : system_resolvconf_generate(1))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan opnsense 5438 - [meta sequenceId="132"] plugins_configure dns_reload (execute task : system_hosts_generate(1))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="133"] plugins_configure vpn (,wan)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="134"] plugins_configure vpn (execute task : ipsec_configure_do(,wan))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="135"] plugins_configure vpn (execute task : openvpn_configure_do(,wan))
<11>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="136"] /usr/local/etc/rc.newwanipv6: Resyncing OpenVPN instances for interface WAN.
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="137"] plugins_configure newwanip (,wan)
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="138"] plugins_configure newwanip (execute task : dnsmasq_configure_do())
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="139"] plugins_configure newwanip (execute task : ntpd_configure_do())
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="140"] plugins_configure newwanip (execute task : opendns_configure_do())
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="141"] plugins_configure newwanip (execute task : openssh_configure_do(,wan))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="142"] plugins_configure newwanip (execute task : unbound_configure_do(,wan))
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="143"] plugins_configure newwanip (execute task : vxlan_configure_do())
<13>1 2023-01-12T01:55:42-06:00 OPNsense.solarczar.lan php 80603 - [meta sequenceId="144"] plugins_configure newwanip (execute task : webgui_configure_do(,wan))
root@OPNsense:/var/log/system #


I can't work at home with this situation, as Microsoft Teams is constantly dropping in video conf calls.  I can't figure out what to test next...

I guess you're right, but I just hope some OPNsense Sage can read this and tell me the problem.  All that testing may be getting me in for more than I signed up for.  I went the OPNsense path, because AT&T kept pushing upgrades that disrupted my port-forwarding rules and knocking down my iOT devices. That's it.  I just needed it to stay up and function. If AT&T would have given me the ability to backup those rules or simply not impact them at all, then I would never have been on this OPNsense path and would have $225 in my pocket.  I admit I've got 10x the available functionality that the AT&T modem provided and I've learned a ton with OPNsense, but it was knowledge I wasn't seeking.  I'm now in a hole that I'm trying to get out of.

Any future testing will have to wait until my family is out of the house.  I nearly found myself in divorce court over this.

Thanks for the insight

Update...so far after reverting to 22.7.7_1, I have had no WAN Flapping incidents.  I have no idea what functionality I have lost from not having .8,.9,.10 upgrades, but I can also state that my network is running faster.  My DNS resolve and website surfing "appears" to be more snappy. 

CPU Usage is down from 20-30% spikes to 2-10%, Memory has gone down from an average 10-15% of 16Gb, down to 4-8%, and Temperature has gone down from 85º C to 69º, which would be indicative of less CPU/Memory impact.   

Don't know what all this means, but my config is identical (except now there are no CRON jobs to reboot the router everyday...as I never needed them until newer versions).

So my wife, daughter, and network elements are all happy today, as their internet services are working.  I hope...Whew!

This presents a new problem. I'm going to have difficulty ever upgrading, and therefore promote a greater security risk for my platform, for fear of what I'll introduce.  For this reason, I would LOVE someone to PLEASE advise me (and others that read this) on what I can start troubleshooting to determine the cause.  I don't want to be a router expert, but I also don't want to spend another 2 weeks of my life trying to figure out solutions.  If I'm always going to be hesitant in my ability to rely on OPNsense upgrades, and therefore unwilling to upgrade when I probably would like more functionality or should for security reasons, then the future will always place doubt on trusting OPNsense and I will be forced to another platform...though I honestly don't know what that would be.  OPNSense provides enormous control and versatility over using my AT&T modem. I'm nervous about my future.  Please help, thanks.

Actually I have.  Someone on Reddit suggested that as well.

"Disable hardware large receive offload" is checked.

Well, 22.7.7 went 2hrs and bounced.  Better than every 5min, but I still don't know why or how to troubleshoot what is happening.  I would love to know that I have something not turned on/off correctly, but I can't find anything and it was running fine for months.

I just reverted back to 22.7.7_1 , as I could update the kernel there. 22.7.8 & .9 would show the WAN Flapping every 5 minutes.  It's only been 20minutes, but it hasn't flapped yet.

Sorry, this has been up/down all day.  Running on N5105, 256Gb NVME, 16Gb RAM.  Intel Celeron 2.00Ghz.

I finally figured out how to revert to 22.7.8, but no kernel update on that revision, so not sure that's the issue.

Don't know what to provide to troubleshoot this.  The only change to my setup has been to upgrade to 22.7.10_2.  I followed the recipes that others have provided.

Trying to revert to 22.7.8 and get an error on the update...

Code Select Expand

root@OPNsense:~ # opnsense-revert -r 22.7.8 opnsense
Fetching opnsense.pkg: .... done
Verifying signature with trusted certificate pkg.opnsense.org.20220701... done
opnsense-22.7.10_2: already unlocked
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
Checking integrity... done (0 conflicting)
The following 1 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
opnsense: 22.7.8

Number of packages to be installed: 1

The process will require 22 MiB more space.
[1/1] Installing opnsense-22.7.8...
Extracting opnsense-22.7.8: 100%
Updating /etc/shells
Registering root shell
Hooking into /etc/rc
Hooking into /etc/rc.shutdown
configd already running?  (pid=210).
>>> Invoking update script 'refresh'
Writing firmware setting...done.
Writing trust files...done.
Configuring login behaviour...done.
Configuring system logging...done.
=====
Message from opnsense-22.7.8:

--
Yes, I'm back in black
root@OPNsense:~ # opnsense-update -kr 22.7.8
Fetching kernel-22.7.8-amd64.txz: ..[fetch: https://pkg.opnsense.org/FreeBSD:13:amd64/22.7/sets/kernel-22.7.8-amd64.txz.sig: Not Found] failed, no signature found


OK, I'm getting desperate.  Just when I think my changes based on recommendations are stable, my WAN port starts flapping again.  This all started with 22.7.10.  I reverted back to 22.7.9 and it was worse.  This was working fine for months. I've set up rejected IP as instructed.  I turned off DHCP on my AT&T modem (Arris BGW210-700) which didn't help and wouldn't let me select the

All I know is that I rock along for some period of time and then I get a critical error and then it goes down.  Sometimes it's a bump with a quick recovery, others it's minutes, and other times it's down until I reboot.  I don't know what to check.

Code Select Expand

2023-01-07T09:36:14-06:00 Critical dhclient exiting.
2023-01-07T09:32:43-06:00 Critical dhclient exiting.
2023-01-07T09:30:39-06:00 Critical dhclient exiting.
2023-01-07T07:45:03-06:00 Critical dhclient exiting.
2023-01-07T07:26:42-06:00 Critical dhclient exiting.
2023-01-07T07:08:07-06:00 Critical dhclient exiting.
2023-01-07T06:42:36-06:00 Critical dhclient exiting.
2023-01-07T06:39:53-06:00 Critical dhclient exiting.
2023-01-07T06:24:06-06:00 Critical dhclient exiting.

Amen to that last post!  My last two weekends have been toast.  I tried reverting to 22.7.9 and it made my WAN Flapping worse.  I'm thinking about going to 22.7.8, but I'm also outside my wheelhouse of expertise and fearful that I will make the problem worse

I found this post and adding that my WAN started "flapping" and I have been searching desperately how to fix, as it's knocking down my entire network.  I am NOT doing Mac spoofing. 
I came on with OPNSense around 22.7.3 and have not experienced it until 22.7.10.  I tried to revert to 22.7.9, but the flapping was more frequent.  The only consistent log when it occurs is this...

Code Select Expand

2023-01-07T05:51:05-06:00 Critical dhclient exiting.
2023-01-07T05:49:18-06:00 Critical dhclient exiting.
2023-01-07T05:14:50-06:00 Critical dhclient exiting.
2023-01-07T03:01:36-06:00 Critical dhclient exiting.
2023-01-07T00:45:08-06:00 Critical dhclient exiting.

Any help is appreciated