OPNsense panics in my multiwan setup

Started by elektroinside, March 30, 2018, 12:52:07 PM

Previous topic - Next topic
March 30, 2018, 12:52:07 PM Last Edit: March 30, 2018, 12:57:58 PM by elektroinside
Hi guys,

So.. testing multiwan on my system...
I have a WAN1 which is my PPPoE link and WAN2 which is a Mikrotik with a Huawei 3G modem in it.

I configured a failover group with "packet loss", having as TIER1 the IPv4 gateway of the PPPoE link and as TIER2 the IPv4 gateway of the Mikrotik.

OPNsense crashes every time I disconnect the PPPoE link from Interfaces: Overview.

I submitted the crash report from the WebGUI, don't know if it got uploaded...

Any ideas what's happening?
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member


Yep...
If I restart and the WAN is still down (the interface physically disconnected), it never comes back, no network, no GUI. I think it keeps crashing. I don't have a monitor attached to it as it is back in the rack so it's just a guess.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

Screenshots from all Gateways please. Surely related to apinger

And please start with Neighbor Down and not Packet loss

March 30, 2018, 04:08:47 PM #5 Last Edit: March 30, 2018, 04:16:38 PM by elektroinside
Screenshots attached.

OK, switched to "member down". Will get back with the results, I'll try a simple PPPoE disconnect.

UPDATE:
Nope, either it panics and never reboots, or simply just hangs. I had to reset the box.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

I noticed that first RDS_DHCPv6 is first reported down in the GUI.
WAN2 is still up, managed to stabilize the modem.
Then my guess is it crashes when RDS_PPPoE is down as well, cause after that, no GUI, no network, and from what i'm seeing, it doesn't come back until a physical reset.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

Another update: I disabled the IPv6 gateway monitoring, but didn't help, still crashes.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member


March 30, 2018, 06:15:44 PM #9 Last Edit: March 30, 2018, 06:30:52 PM by elektroinside
Nope.. same thing.

Submitted another crash report package. Do these work btw? Where are they stored (I'm guessing & hoping that they are privately available to the devs - didn't read any confidentiality agreement or similar).
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member


March 30, 2018, 09:07:44 PM #11 Last Edit: March 30, 2018, 09:19:14 PM by elektroinside
I disabled "Sticky connections" and "Shared forwarding" and no more crashes.
Narrowed it down to these two.

Multiwan works fine now, I think, I just did a few tests. IPv6 is gone on my PPPoE once I reconnect, but this is known and it's getting a fix soon.

Although I don't think we should consider the issue closed. It shouldn't crash, right?
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

March 30, 2018, 09:44:57 PM #12 Last Edit: March 30, 2018, 09:47:24 PM by elektroinside
Anyway, thank you mimugmail for your assistance.

Regarding the monitor part, I attached a picture of my rack. It is close to impossible to connect anything anymore there, not to mention I need a ladder to get up there...
I have to take everything out every time I need to connect a display to anything.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

Be aware that you can't use Traffic Shaping without Shared Forwarding! :(

I'd be interested in the system.log at the time it crashes (console would be way more cooler).

Yeah, I know, I don't use it anyway. But it would still be better not to use it and not get a crash...

Ok, I'll collect the logs tomorrow, I'll send you a PM with a gdrive share.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member