OPNsense panics in my multiwan setup

[elektroinside]

Hi guys,

So.. testing multiwan on my system...
I have a WAN1 which is my PPPoE link and WAN2 which is a Mikrotik with a Huawei 3G modem in it.

I configured a failover group with "packet loss", having as TIER1 the IPv4 gateway of the PPPoE link and as TIER2 the IPv4 gateway of the Mikrotik.

OPNsense crashes every time I disconnect the PPPoE link from Interfaces: Overview.

I submitted the crash report from the WebGUI, don't know if it got uploaded...

Any ideas what's happening?

[mimugmail]

Did you set it up like in the docs?

[elektroinside]

Yep...
If I restart and the WAN is still down (the interface physically disconnected), it never comes back, no network, no GUI. I think it keeps crashing. I don't have a monitor attached to it as it is back in the rack so it's just a guess.

[mimugmail]

Screenshots from all Gateways please. Surely related to apinger

[mimugmail]

And please start with Neighbor Down and not Packet loss

[elektroinside]

Screenshots attached.

OK, switched to "member down". Will get back with the results, I'll try a simple PPPoE disconnect.

UPDATE:
Nope, either it panics and never reboots, or simply just hangs. I had to reset the box.

[elektroinside]

I noticed that first RDS_DHCPv6 is first reported down in the GUI.
WAN2 is still up, managed to stabilize the modem.
Then my guess is it crashes when RDS_PPPoE is down as well, cause after that, no GUI, no network, and from what i'm seeing, it doesn't come back until a physical reset.

[elektroinside]

Another update: I disabled the IPv6 gateway monitoring, but didn't help, still crashes.

[mimugmail]

Please disable V6 completely .. just for testing

[elektroinside]

Nope.. same thing.

Submitted another crash report package. Do these work btw? Where are they stored (I'm guessing & hoping that they are privately available to the devs - didn't read any confidentiality agreement or similar).

[mimugmail]

Hm, OK, without a Display it's just guessing, sorry

[elektroinside]

I disabled "Sticky connections" and "Shared forwarding" and no more crashes.
Narrowed it down to these two.

Multiwan works fine now, I think, I just did a few tests. IPv6 is gone on my PPPoE once I reconnect, but this is known and it's getting a fix soon.

Although I don't think we should consider the issue closed. It shouldn't crash, right?

[elektroinside]

Anyway, thank you mimugmail for your assistance.

Regarding the monitor part, I attached a picture of my rack. It is close to impossible to connect anything anymore there, not to mention I need a ladder to get up there...
I have to take everything out every time I need to connect a display to anything.

[mimugmail]

Be aware that you can't use Traffic Shaping without Shared Forwarding! :(

I'd be interested in the system.log at the time it crashes (console would be way more cooler).

[elektroinside]

Yeah, I know, I don't use it anyway. But it would still be better not to use it and not get a crash...

Ok, I'll collect the logs tomorrow, I'll send you a PM with a gdrive share.