OpnSense seems to freeze / crash and routing is only restored with a reboot

[RakataTech]

Hi

I love OpnSense and have configured a failover set up for my 2 ISPs. This works well, and traffic is routed via WAN1 unless that monitor detects its down in which case it failovers to WAN2. When the monitor detects that WAN1 is back up then the WAN1 gateway is restored. We can watch this happening on the OpnSense dashboard if we disconnect WAN1 or switch off the modem on WAN1.

This can be fine for a number of weeks and with TB's of data flowing through OpnSense, however once in a while we lose connectivity to OpnSense and therefore have no internet access or internal routing at all. All our machines shows no connectivity. The only resolution we have at the moment is to press the power button on the front of the machine so it gracefully shuts down, then pressing the power button for the machine to start back up. Once the machine starts back up the system is fine again.

We have tried replacing the machine that OpnSense is sat on and rebuilt that from a fresh download. The only part of the system that is the same, is that we imported the config file from the first machine to the second.

This made no difference and we lose this connectivity to the OpnSense machine still every once in a while.

How can we go about diagnosing what has happened and how to therefore resolve this issue?

Thank you for reading

[RakataTech]

After speaking to a colleague over here it looks like its actually the LAN that goes down.

When we realised the system had an issue yesterday my colleague was able to successfully connect to the OpnSense machine via our VPN connection.

This would account for why when we have tested the WAN failover everyting seems ok, and why when this crashing happens and we lose all connectivity here, its actually the LAN that goes down for us and symptomatically that means we lose all internal and external routing.

I hope this update on the issue we are having helps