Hey all, I'm trying to figure out what's going wrong. Nearly everyday i'm losing connection on my WAN interface, and I can't find anything in the logs (though i'm not really sure which logs I should be looking at). I'm running Opnsense on bare-metal on an MSI Cubi NUC 1M (Intel Core 5, 16GB RAM, 500GB SSD). It has 2x Intel I226-V, I have the WAN interface set to auto-negotiate the speed.
When it loses connection I either need to reboot, or just go into the interface settings and click save which seems to be enough to get it reconnected. As for Opnsense, I keep the version up to date (25.7.2), I'm running IDS/IPS just on my LAN interface with the Hyperscan Pattern Matcher. Crowdsec, and Wireguard are also running. I've disabled all Hardware settings in the interface settings (CRC,TSO, LRO, VLAN Filtering).
What logs should I be looking at to help me figure out what the issue is?
Any help would be appreciated
Just to add to this - when it loses WAN it's reporting as 100% Packet Loss. This is the hourly from the last couple months
iso_time | loss | delay | stddev |
2025-06-17T14:00:00+10:00 | 92.330097922 | 0.00052491607689 | 0.00018458892351 |
2025-06-23T05:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T06:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T07:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T08:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T09:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T10:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T11:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T12:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T13:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T14:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T15:00:00+10:00 | 100 | 0 | 0 |
2025-06-29T16:00:00+10:00 | 67.538149056 | 0.037166575359 | 0.13227880102 |
2025-07-07T08:00:00+10:00 | 100 | 0 | 0 |
2025-07-07T09:00:00+10:00 | 100 | 0 | 0 |
2025-07-27T01:00:00+10:00 | 100 | 0 | 0 |
2025-07-27T02:00:00+10:00 | 100 | 0 | 0 |
2025-07-27T03:00:00+10:00 | 100 | 0 | 0 |
2025-07-29T12:00:00+10:00 | 100 | 0 | 0 |
2025-07-29T13:00:00+10:00 | 100 | 0 | 0 |
2025-07-29T14:00:00+10:00 | 75.036629833 | 0.0015248240753 | 0.00042127605431 |
2025-08-14T01:00:00+10:00 | 100 | 0 | 0 |
2025-08-14T02:00:00+10:00 | 100 | 0 | 0 |
2025-08-14T03:00:00+10:00 | 100 | 0 | 0 |
2025-08-14T04:00:00+10:00 | 100 | 0 | 0 |
2025-08-14T05:00:00+10:00 | 100 | 0 | 0 |
2025-08-19T03:00:00+10:00 | 100 | 0 | 0 |
2025-08-21T01:00:00+10:00 | 71.897430038 | 0.002538875804 | 0.0013372099454 |
2025-08-21T02:00:00+10:00 | 100 | 0 | 0 |
2025-08-21T03:00:00+10:00 | 100 | 0 | 0 |
Quote from: jstarta on August 21, 2025, 09:38:14 PM[...]
What logs should I be looking at to help me figure out what the issue is? [...]
I'd look at ARP. One of the logs (General, I believe) may log ARP changes, but that's usually only when ARP moves between bridge member interfaces. You'll probably have to look when you lose connectivity. It could also be the (apparent) i226 ASPM issue (https://forum.opnsense.org/index.php?topic=48296.0).
The most important bit in this mystery is the type of your WAN connection.
Quote from: pfry on Today at 01:26:19 AMQuote from: jstarta on August 21, 2025, 09:38:14 PM[...]
What logs should I be looking at to help me figure out what the issue is? [...]
I'd look at ARP. One of the logs (General, I believe) may log ARP changes, but that's usually only when ARP moves between bridge member interfaces. You'll probably have to look when you lose connectivity. It could also be the (apparent) i226 ASPM issue (https://forum.opnsense.org/index.php?topic=48296.0).
I only see two entries for the WAN interface - i'll take a look at my bios for the ASPM settings (Thanks for the hint).
Quote from: Jyling on Today at 04:33:48 AMThe most important bit in this mystery is the type of your WAN connection.
It's set as a IPv4 DHCP connection, though I guess technically it's static IPv4 because my ISP gives me a static ip
Just a quick add - I checked the BIOS for any ASPM stuff but couldn't see anything. I did see an ErP Ready setting which i've just disabled now (Seemed to have something to do with limiting power).
Added the tunable "hw.pci.enable_aspm" and set it to 0. I'll give it a reboot at some point and then see how it all goes. This BIOS is definitely lacking a lot of advanced features :(