question about multi-wan-performance

[snoopy78]

hello @all.

i am running an opnsense OPNsense 21.1.2-amd64 on an Intel(R) Atom(TM) CPU C3758 @ 2.20GHz (8 cores).

Due to my poor VDSL connection (110Mbit down & 40 Mbit up) i have added 2 LTE Router (Huawei) (each ~ 70-90Mbit down & 20-40 Mbit up) in NAT-behind-NAT setup. The firewall has disabled sticky connection and is on aggressive mode.

Also i did follow the howto of setting the loadbalancing up and made them all the same weight and tier.


When i connect (use) each WAN 1, WAN2 or WAN3 in single setup i get full speed. This i can verify by connecting a WiFi device to the huawei routers and do an speedtest.
All connections by itselt are workoing correctly.

When i use the GW-Group as my Gateway, then it is also working, however the combined speed is at most 210Mbit, while the upload is up to 120Mbit.

So if i calculate for upload 40+40+40Mbit = 120Mbit for upstream the GW-Group works fine.
However, when i download, i only get max 210 Mbit (usually less), which isn't 110 + 80 + 80 Mbit = 270 MBit (or more).

The CPU load is with traffic between 20-40%.



Is this normal behavior? What can i do to improve the combined download so that i actually can reach the real limits?

Thank you in advance.

BR

[smyers119]

Do you have it weighted correctly? 210 would be correct with a equal split between all wans.

EDIT: Sorry I am coming from a different router (still new to opnsense specific's), it does not appear you can adjust the load-balance weights, so I would say your probably reaching your max throughput as such.

[smyers119]

Do you have it weighted correctly? 210 would be correct with a equal split between all wans.

EDIT: Sorry I am coming from a different router (still new to opnsense specific's), it does not appear you can adjust the load-balance weights, so I would say your probably reaching your max throughput as such.

Looks like i was right, just wasn't looking in the right place on the gui, see here from the documentation

Unequal Balancing (Weight)

If you have a non symmetric setup with one IPS having a much higher bandwidth than the other then you can set a weight on each gateway to change the load balance. For instance if you have one line of 10 Mbps and one of 20 Mbps then set the weight of the first one to 1 and the second one to 2. This way the second gateway will get twice as many traffic to handle than the first.

To do so, go to System %u2023 Gateways %u2023 Single and press the pencil icon next to the Gateway you want to update. The weight is defined under the advanced section.

[snoopy78]

The weight on all interfaces is the same = 1.

AFAIK to my understanding the the weight tells how many packets (compared to the other weight) will be transmitted.

So if i have a 50 & 10 Mbit connection i would use weight 5 on the 50Mbit connection and 1 on the 10 Mbit ones.

However, i have in my setup 110 Mbit + ~90 MBit + ~ 90MBit so its nearly equeal and then it can be 1 1 1 for equeal sharing.

I already tried different values...but no success..
so i tried for testing 1 - 2 -2 but, as expected bad result...
by testing 2 - 1 - 1 i get the similar results as 1 - 1 -1, so for now i use 2 - 1 - 1

also all 3 gw having priority 254

WAN3 only troughput (client firewall rule provides wan 3 as gateway)



WAN 1 - 2 - 3 combined troughput, but only display of WAN 2 & 3



WAN 1 - 2 - 3 combined troughput

[N0b0dy1985]

If you have 110Mbps + 90 + 90, try weighting them 110 90 90.