Multi-WAN one Interface Gateway Monitoring wrong

[BlackJack7629]

Hello,

I have a failover Setup where one Interface is for the WAN connection. Both Devices uses the CARP IP. On the connected subnet are 2 Router from different ISP:

R1 (active)   RouterNET   IPv4   254 (upstream)   10.64.10.253
R2   RouterNET   IPv4   255 (upstream)   10.64.10.254

I setup public IPs as Monitoring IP. If R1 goes offline, the Monitoring of R2 also goes offline but normally the Monitoring IP should be routed over R2 so it is reachable.

Because both Gateways seems to be offline, WAN is not working until R1 gets online.

Routingtable:
ipv4   default   10.64.10.253   UGS   1623849   1500   em0_vlan1064
ipv4   PUBLIC-MONITOR-IP-R1   10.64.10.253   UGHS   13   1500   em0_vlan1064
ipv4   PUBLIC-MONITOR-IP-R2   10.64.10.254   UGHS   17   1500   em0_vlan1064

Workaround is, thtat I set R2 to be always online. So failover works but I don't recognize if Internet on R2 is really not avaiable.

So I'm not sure if this is a bug or I have a mistake in my config. Perhaps it is not possible to use the same interface for both router?

Best regards,

Alexander

[BlackJack7629]

Now I tried to set static routes:

ipv4   default   10.64.10.253   UGS   1754927   1500   em0_vlan1064
ipv4   1.1.1.1   10.64.10.253   UGHS   12   1500   em0_vlan1064
ipv4   8.8.4.4   10.64.10.254   UGHS   135698   1500   em0_vlan1064
ipv4   8.8.4.4/32   10.64.10.254   UGS   0   1500   em0_vlan1064
ipv4   8.8.8.8   10.64.10.253   UGHS   136152   1500   em0_vlan1064
ipv4   8.8.8.8/32   10.64.10.253   UGS   0   1500   em0_vlan1064

The 8.8.8.8 / 8.8.4.4 is set as Monitoring IP for testing. I also set static routes like ip/32. Both method seems to not working.

Both Gateways (10.64.10.253 and 10.64.10.254) are on the same Interface (em0_vlan1064)

When I make a traceroute to the monitoring ips:

# /usr/sbin/traceroute -w 2 -n  -m '1'  '8.8.8.8'
traceroute to 8.8.8.8 (8.8.8., 1 hops max, 40 byte packets
 1  10.64.10.253  0.449 ms  0.318 ms  0.187 ms

# /usr/sbin/traceroute -w 2 -n  -m '1'  '8.8.4.4'
traceroute to 8.8.4.4 (8.8.4.4), 1 hops max, 40 byte packets
 1  10.64.10.253  0.413 ms  0.270 ms  0.226 ms

Both Ips uses the default route but that is wrong. I setup routes so one ip should use the other gateway but it don't work. Befor I used another Software there it was no problem. I think it could be a bug or something to change in the settings?

A workaround could be to use two interfaces but then I have a problem with the Failover. I use openvpn in client mode to connect to an other network. As interface I used the carp ip so failover should works on master and slave. When I use diffrent interfaces openvpn in client mode with failover dont work like this.

[mimugmail]

MultiWAN works with pf, you will not see any routes.
2 Gateways on the same Interface mean you have to set upstream to "auto-detect" in interface config.