Strange Issue Under ProxMox

[Ikyo]

I am currently running OPNSense configured like multiple of the walkthroughs show online.  After configuration, my speeds on my WAN interface (VirtIO) is almost identical to what I had with my bare metal install.  The speeds on the LAN (VirtIO) interface are horrible.  I have tried everything that I could think of to fix the issue.  The one strange thing that I saw was:



ethtool --offload ens4f1 (WAN interface) generic-receive-offload off - fixing my LAN speeds, but cuts my WAN speeds in half.  If I go and turn it back on, the WAN speed goes back to normal, but the download on the LAN download goes to almost nothing, but the upload is almost spot on.  I would rather not pass my interfaces through to the VM if I don't have to.

[Ikyo]

Does anyone have a VM running on an internet connection that is 8/8 or higher?  I think there is just a limitation with the virtualized interfaces not being able to handle the traffic.

[Ikyo]

I just installed ESXI to see if it had the same issues.  Here is something VERY strange:

Windows VM - full speed 8/8
FreeBSD 14.2 - full speed 8/8
OPNSense - reduced speed to around half

[meyergru]

Did you follow the tips here?

You can also try using multiqueue in the NIC settings in Proxmox and hopefully, you have enabled RSS (IDK if your walkthroughs cover that).

[cookiemonster]

I have OPN virtualised on Proxmox. What is 8/8 ?

[Ikyo]

I have OPN virtualised on Proxmox. What is 8/8 ?

8gb/8gb Fiber Connection

[Ikyo]

Did you follow the tips here?

You can also try using multiqueue in the NIC settings in Proxmox and hopefully, you have enabled RSS (IDK if your walkthroughs cover that).

I switched to ESXi to see if that would help resolve some of the issues.  I was able to get the WAN side of the network to show full bandwidth (8/8).  I Did find something strange in the settings.  When I went in and checked the boxes for hardware offloading, it seemed to remove it.  When I had them unchecked, they seemed to work correctly.  So that is the good part of the testing so far.  When I check on a Windows VM on the LAN side, I get very slow download speeds, but my upload speeds seem on par to what I would think to see.

[Ikyo]

I was able to get the VM to now do a 5Gb up and down on the LAN side.  The WAN side is similar.  This is after I got my configuration moved over from my Baremetal machine.  The Server is running Xeon Gold 5115.  I wonder if they are just to slow to handle much more than that.