Internet Download & Upload Performance Issues

[obsidian]

Hello,

I'm new to OPNsense, and I'm having an issue with the DL/UL speeds. I currently have 1 Gbps fiber connection to the internet (tested and confirmed at the modem). OPNsense is running as a VM on top of Proxmox with 6 cores, 16gb or ram, and 64gb of storage. Using the speedtest.org cli on multiple Linux machines, I am only getting a maximum of 375 Mbps down, and 250 Mpbs up, including on the host machine, which eliminates any other hardware/wiring issues. I also had another router before OPNsense and would get the full throughput, so it's I'm pretty certain it's related to an issue with my configuration. I'm also getting an error message at the terminal for all of the Ethernet adapters, which may or may not be related. I'm not sure how to troubleshoot this; other than this issue, it seems my configuration is working exactly as I'd like it to. Please let me know what I can provide or where to begin.

Error: 146.583516 [4335] netmap_transmit vnet1 full hwcur 189 hwtail 432 qlen 268
It does this for vnet0 & vnet2 as well, and quite often.

I did a search but coudln't find a definitive answer. Some noted issues with the CPU but mine never gets above 50% usage according to the dashboard.

OPNsense 25.1.5_5-amd64
FreeBSD 14.2-RELEASE-p2
OpenSSL 3.0.16

[meyergru]

Please read the network "hardware" section here.

Apart from specific issues with a VM setup, you could also look at enabling RSS.

[obsidian]

I enabled RSS per the instructions you provided. I also increased the CPU count to 8, disabled the Proxmox Firewall on all adapters, and installed the Qemu plugin. See the results below. Not only is the DL/UL improved greatly but the ping is less than half of what it was. THANK YOU!!

Original:
Idle Latency:     2.29 ms   (jitter: 0.23ms, low: 2.10ms, high: 2.48ms)
    Download:   370.18 Mbps (data used: 256.3 MB)                                                   
                 14.75 ms   (jitter: 6.36ms, low: 5.07ms, high: 242.12ms)
      Upload:   202.28 Mbps (data used: 249.6 MB)                                                   
                 30.68 ms   (jitter: 9.95ms, low: 5.88ms, high: 258.98ms)
 Packet Loss:     0.0%

After changes:
Idle Latency:    2.50 ms  (jitter: 0.11ms, low: 2.27ms, high: 2.55ms)
    Download:  937.07 Mbps (data used: 807.6 MB)                                                 
                  3.98 ms  (jitter: 0.72ms, low: 2.73ms, high: 6.33ms)
      Upload:  610.43 Mbps (data used: 728.2 MB)                                                 
                  2.13 ms  (jitter: 0.53ms, low: 1.68ms, high: 11.59ms)
Packet Loss:    0.0%

[obsidian]

Oh, should I be concerned about that error I mentioned in my first post? It's still appearing consistently.