Multi WAN Routes not working / no switch over on gateway failure

[BlackJack7629]

Hello,

I tried to setup multi WAN but that's not working well. I have one Network where 2 routers and the OPNsense application exists.

In OPNsense I added both routers as gateway with different monitoring ups (8.8.8.8 and 8.8.4.4). Under general tab I also used this Ips for DNS and selected the right gateway.

Route Status shows the right entries

Code Select Expand

ipv4 default 10.64.10.253 UGS 70279 1500 igb0_vlan1064 RouterNET
ipv4 8.8.4.4 10.64.10.254 UGHS 391 1500 igb0_vlan1064 RouterNET

But every package get routed through the default gateway see trace route below:

Code Select Expand

# /usr/sbin/traceroute -w 2 -n  -m '4'  '8.8.4.4'
traceroute to 8.8.4.4 (8.8.4.4), 4 hops max, 40 byte packets
1  10.64.10.253  0.526 ms  0.277 ms  0.264 ms
2  * * *
3  81.210.131.174  11.082 ms  12.046 ms  10.768 ms
4  84.116.196.94  18.002 ms  16.866 ms  25.051 ms

The Gateways

Code Select Expand

gwb (active) RouterNET IPv4 255 (upstream) 10.64.10.253 8.8.8.8 15.8 ms 2.7 ms 0.0 % Online    
gwa RouterNET IPv4 255 (upstream) 10.64.10.254 8.8.4.4 16.4 ms 3.9 ms 0.0 % Online

Any idea what the problem could be? Is it because I use the same Interface? I came from pfsense. There was a problem for a long time using the same interface but tis was solved a few years ago. I use version OPNsense 20.7.8-amd64.

Many thanks

Alex