WAN over PPPoE loses default IPv4 route in multi-WAN setup

[sergiup]

I think this may be related to this bug, though I may well be wrong!

I can provide more logs, config etc as required later.

Setup: latest OPNSense installed on an AOpen i45GMt-HR with an HP NC364T NIC (so all NICs are Intel based); LAN is on the onboard NIC (em4), the two WANs (em0, em1) and a DMZ interface (em3) are on the NC364T.

First WAN (em0) is configured with IPv4 DHCP only; it's a cable ISP, there is no IPv6 connectivity provided.
Second WAN (em1) is configured with PPPoE, IPv4 DHCP and IPv6 DHCPv6 (PPPoE dual-stack). I also get an IPv6 DHCP-PD from this, works fine on the LAN etc. This is a VDSL2 ISP, and these gateways are set as the defaults.

I have a couple of gateway groups configured, but no rules in place that use them. I may try removing them to see if it makes a difference.

If I disable/re-enable the PPPoE connection or interface or IPv4 gateway, I completely lose the default IPv4 route unless I completely disable the PPPoE interface or IPv4 gateway.

It doesn't seem to matter what else I do, I just cannot seem to get the PPPoE default IPv4 route back, short of a reboot. The only thing that works is to disable the PPPoE WAN or PPPoE IPv4 gateway completely, which re-instates the Cable WAN as the default IPv4 route. If I don't do that, there is NO IPv4 default route.

I'm happy to provide logs, config details etc, just kindly let me know what would be required, and what tests would be useful. Thank you!

[franco]

Hi there,

Two times DHCP is tricky, we've had a larger discussion lately about what is supposed to happen and what can be done to end up with a working setup.

The current rationale is:

Go to Firewall: Settings: Advanced and enable "Allow default gateway switching".


Cheers,
Franco

[sergiup]

Thank you Franco! I'll try that when I'm home again, run a few tests and get back to you.

[sergiup]

Hi there,

Two times DHCP is tricky, we've had a larger discussion lately about what is supposed to happen and what can be done to end up with a working setup.

The current rationale is:

Go to Firewall: Settings: Advanced and enable "Allow default gateway switching".


Cheers,
Franco

I disconnected the PPPoE interface under Interfaces > Overview, and re-enabled it; result - no IPv4 default route.

System > Log File
Sep 29 14:40:48   opnsense: /usr/local/etc/rc.newwanip: Cannot switch gateway EM1_WAN_VDSL_DHCP6 with undefined address
Sep 29 14:40:48   opnsense: /usr/local/etc/rc.newwanip: Cannot switch gateway EM1_WAN_VDSL_PPPOE with undefined address

Although I do have valid IPs under Interfaces > Overview.
Also, System > Gateways > Status shows Gateway "dynamic" for both though, and gray "Pending" status.

I Disabled / Re-enabled the Interface, this seems to have fixed the issue; not ideal though.