Multi WAN problem

[ivalentinov]

Hey guys,

i am really new to OPNsense and I am trying to setup a multi wan. My main internet provider is having problems and multiple connection drops a day so i have a 4G modem in place as a failover wan connection.

I followed the Setup multi WAN guide from the wiki (for failover) and tried to search through the forums for help but i cannot seem to make OPNsense to route internet traffic through the OPT1 interface although I can see that DNS queries are being routed through OPT1.

In a case of failure of the WAN interface this is shown in the system log:

Code: [Select]

May 10 17:52:39 opnsense: /usr/local/etc/rc.filter_configure: MONITOR: GW_WAN is down, removing from routing group WANGWGROUP
May 10 17:52:39 opnsense: /usr/local/etc/rc.filter_configure: Default gateway down setting as default!
May 10 17:52:39 opnsense: /usr/local/etc/rc.filter_configure: Default gateway down setting GW_WAN as default!

Even though the log says that GW_WAN (that is the WAN interface) is removed from the group the internet traffic is still routed trough igb0 (WAN interface)

Code: [Select]

May 10 18:02:41 WAN   77.71.YYY.YYY:62180   96.126.103.202:443 TCP:S
May 10 18:02:41 LAN   192.168.1.181:59909   96.126.103.202:443 TCP:S

These are the LAN rules i have in the firewall (i also have the lockout rule enabled on top)

Code: [Select]

IPv4 TCP/UDP * * LAN address 53 (DNS) * Local Route DNS   
IPv4 * LAN net * * * WANGWGROUP Default allow LAN to any rule

And then this is how the routing table looks:

Code: [Select]

ipv4 default 77.71.XXX.XXX UGS 5384 1500 igb0 wan
ipv4 4.2.2.1 77.71.XXX.XXX UGHS 914 1500 igb0 wan
ipv4 8.8.4.4 192.168.8.1 UGHS 206 1500 igb1 OPT1
ipv4 8.8.8.8 77.71.XXX.XXX UGHS 206 1500 igb0 wan

I also applied the 2 patches from here https://forum.opnsense.org/index.php?topic=5071.0

I am on version 17.1.6. Is it something i did wrong or is there something wrong with the failover software. Any help will be greatly appreciated 

[ivalentinov]

Just to add to the "picture" if i disable the gateway on the WAN interface everything starts to flow through OPT1. One additional line is logged in the system log in this case that does not appear if i don't disable the failing gateway:

Code: [Select]

May 10 18:33:21 opnsense: /usr/local/etc/rc.filter_configure: GATEWAYS: Group WANGWGROUP did not have any gateways up on tier 1!