New WAN Connection - Cant browse, can ping and DNS.

[imolaspin]

I have a new internet connection at my place, which I was hoping to use as load balance or failover. However I cannot get traffic to go out via this new interface.

I have an ISP modem in bridge mode connected to OPNSense providing a DHCP v4 address - this is my WAN and works normally.

I have another connection Australian NBN FTTP, connected to OPNSense on another interface that connects via PPPoE. When enabled - gateway comes to life, interface gets an IP address etc etc. I am using Hybrid NAT and appears all rules are auto generated for the interface. When I disable WAN 1 or disconnect it, OPNSense appears to kick over to WAN2 but web traffic doesnt flow. On both my laptop and on the OPNSense appliance I can traceroute, ping and do DNS lookups, however neither can browse the web. i.e I cannot CURL www.google.com from either device.


Any pointers on where to look?

[bartjsmit]

Start here https://docs.opnsense.org/manual/how-tos/multiwan.html

[imolaspin]

Thanks for the quick reply bartjsmit.

I have followed this documentation, although I have a feeling that this connection might not work in a single WAN setup - unsure.
Steps in bold are completed as per documentation.

    Add monitor IPs to the gateways

    Add a gateway group
    Configure DNS for each gateway
    Use policy based routing to utilize our gateway group
    Add a firewall rule for DNS traffic that is intended for the firewall itself

[imolaspin]

Bump

[bartjsmit]

I have a feeling that this connection might not work in a single WAN setup

I only have a single WAN but if you have WAN and WAN2 then your firewall may disagree with you about the above. Does it work when your ISP modem is off?

Bart...

[imolaspin]

Unfortunately not.

[bartjsmit]

Unfortunately not.

That would indicate that you don't have dual WAN then 

My idea of dual WAN is that they're two connections, independent of each other. If you're adding a second connection on top of your first which is still dependent on it, you're only adding complexity. Unless there are non-technical advantages, such as billing or dependent (media) services, I can't see the attraction.

Bart...

[imolaspin]

My idea of dual WAN is that they're two connections, independent of each other.
I agree and that is what I have here, except when I turn the original/primary WAN off, physically disconnect it etc. I can only ping and do DNS lookups from the 2nd connection but no general web traffic. I do believe it to be an OPNsense configuration issue or potentially a PPPoE issue but I haven't been successful in ruling out either.

I'll test the PPPoE directly to a spare laptop this weekend that should rule that side out at least.

[imolaspin]

I tested the PPPoE directly using the same credentials etc and it worked flawlessly as expected meaning the configuration is definitely at the OPNsense end.

Anyone have any advice on how to troubleshoot this?

[bartjsmit]

back up your config, start from a fresh OPNsense using only the PPPoE connection and try adding your other WAN?

[imolaspin]

Fortunately I have figured it out! Unbound DNS was set only to use WAN1 not both 1&2!
I noticed because today there was an outage on WAN1 but internet was working for the few devices that were hardcoded to external DNS!

All resolved and worked perfectly.