Gateway stays offline after switching

[rowdyrau]

Hello!
I have a multiWAN setup with Starlink and another provider that is working mostly as expected, but whenever my Starlink WAN has an outage it stays offline until I manually toggle it disable/enable.
Once I do that it will immediately show online and the default gateway will switch to it.
"Allow Default Gateway Switching" enabled
"Upstream Gateway" is checked
"Monitor IP" is set for 8.8.8.8

Am I missing some setting that allows monitoring of a offline gateway until it is good to use again?

Thanks for any help!