Speedtest Bandwidth drop through opnsense

[ninja0n3]

Hello,

I'm trying to figure out if I'm doing something wrong in my environment.

Before I describe the issue, here is some context:
- I'm running opnsense as the gateway to the internet
- The appliance has 10Gbge interfaces
- iperf3 testing between opnsense and my windows machine runs at around 9.2Gbps up/down
- Internet runs at 3gbps, opensense speedtest measures 3.2Gbps up/down (daily measurements) through a 10Gbe interface

The issue that I'm experiencing is that when I run a speed test on the windows machine (AV and firewall disabled), I'm only seeing around 2.4Gbps even though the throughput on the firewall seems to be capable of handling the entire 3Gbps (based on iperf3 results).
I'm running speedtest through the browser (same server as the one used by opnsense).

I'm not sure what could be causing the drop, or whether I'm performing the test incorrectly.

Any insight would be greatly appreciated.

Thanks!

[ninja0n3]

Using the speedtest CLI on windows seems to make things a lot better, however I'm still seeing a 400Mbps difference on download whereas I'm getting the full speed on upload (see screenshot)

[N00bOner]

Not a pro at all, but before digging more:

1. Simple browser check: On windows PC try another browser with all the latest updates.
2. Resource limitation check:
    Shell '#top' command can possibly display if you reached any resource limitation while doing the speedtest.
    Or you can observe UI output under --> System: Diagnostics: Activity
3. In case when no resource limit reached, I'd start to probe interface speed on the affected PC with any Live distro.

Last step - not sure if and how it will help - tunables.
For tunables I'd suggest attached thread, last page (11) second post from top - by Kirk
    https://forum.opnsense.org/index.php?topic=18754.150

[opnfwb]

It's also worth checking the specs of the windows PC? I've seen speed tests in the browser be very CPU and disk intensive. For instance, if we're running a speed test on a Windows VM with just a few GB of RAM, it will often swap the binary data to disk while the test is running and cause a large loss in performance.

Are you able to do a file transfer to/from the windows PC from another device on the local LAN and does the performance reach 10GB when doing this test?

[danderson]

mimugmail's repo has a gui based speedtest that uses speedtest-cli on the firewall.

Its a little outdated so you need to manuall install py39-speedtest-cli via pkg, but it works great on the gui or locally.

https://github.com/mimugmail/opn-repo

[ninja0n3]

Yes, I ended up using the speedtest-cli on the second post in this thread, I'm still seeing a 400Mbps drop on download while getting the full 3.2Gbps on the upload.

Not sure what kind of overhead would be causing that, iperf3 between the win machine and opnsense is around 9.5+ Gbps

My opnsense setup is as follows:

Internet [10Gbe] <=> [10Gbe ix1] opnsense [10Gbe ix2] <=> [10Gbe Onboard] Win 11