Losing WAN connection periodically

[BrandyWine]

The fw WAN is likely not in a /30.
So let's ask.... OP, what subnet is your FW WAN getting from dhcp, or now whatever OS is connecting to the ISP?

[BrandyWine]

Not sure what version of OPNsense you are running, but duly noted freeBSD 14.3-RELEASE has a noted fix for igc driver.
https://www.freebsd.org/releases/14.3R/relnotes/

[BrandyWine]

Have you seen the other thread related to igc?
Maybe look that over.
https://forum.opnsense.org/index.php?topic=48564.msg246022#msg246022

[jstarta]

The fw WAN is likely not in a /30.
So let's ask.... OP, what subnet is your FW WAN getting from dhcp, or now whatever OS is connecting to the ISP?

Its /22, but I have a static IP so I'll always get the same IP from the ISP

Not sure what version of OPNsense you are running, but duly noted freeBSD 14.3-RELEASE has a noted fix for igc driver.
https://www.freebsd.org/releases/14.3R/relnotes/

Its on the latest.



I'll have a look at those links you've sent. So far the switch to using proxmox with Opnsense as a VM has been flawless.

[BrandyWine]

Its /22, but I have a static IP so I'll always get the same IP from the ISP

Is that /22 an rfc1918 block, or ISP public? Do you also get DHCP?

[jstarta]

Its /22, but I have a static IP so I'll always get the same IP from the ISP

Is that /22 an rfc1918 block, or ISP public? Do you also get DHCP?

No, it's not. When I initially went with this ISP I had them disable CG-NAT (In case that's what you were thinking it might be).

I've had 5 days uptime with zero problems since installing it as a VM (Under Proxmox), so it seems it's an issue with BSD drivers.

[BrandyWine]

I've had 5 days uptime with zero problems since installing it as a VM (Under Proxmox), so it seems it's an issue with BSD drivers.

Using the same hardware?
When did you get to the newer OPNsense 25.7.x (bsd 14.3) ?

Maybe there's a conflict between the bsd kernel driver and the controller firmware. Must be millions of devices running the Intel 226 running bsd 14.3 (guessing how many).

I don't recall in the thread, did you try an older version of OPNsense (https://docs.opnsense.org/releases.html)? This would have given you a definitive on if the bsd 14.3 with updated igc driver was the cause.

[pdhsker]

I want to chime in and say I have had the same problem of WAN experiencing 100% Packet Loss periodically since upgrading to 25.7. I have two CWWK mini PC routers, one with an N100 CPU and the other with an N350 CPU. Both come with four i226 ports. I have a Verizon Fios connection (residential).

The 100% packet loss happens about once a day. Interestingly, when the N350 mini PC router experienced 100% packet loss, the machine continued to function on the LAN side, but with no WAN connection. I reviewed all the logs but couldn't find anything wrong. When the N100 mini PC router experienced 100% packet loss, it would reboot itself, and the WAN connection would come back.

I have tried all the suggestions in this thread, and nothing worked. Here are the things I have tried:

• Setting hw.pci.enable_aspm to 0 didn't make a difference.
• Setting hw.igc.eee_setting to 0 didn't make a difference.
• I have checked the WAN DHCP leases, and it seemed to work as expected.
• I have turned off VTd in the BIOS, but it didn't make a difference.

For my next troubleshooting step, I will install Proxmox on one of the mini PC and virtualize Opnsense to see if the problem still persists. 

[pfry]

[...]
I have checked the WAN DHCP leases, and it seemed to work as expected.[...]

How about ARP? Don't just check presence - check that the MACs are correct. Incorrect ARP is unlikely outside of a bridged link with multiple devices, but you never can tell.