low throughput on opnsense

[sheely1337]

Hello dear community,

I currently have the issue that my OPNsense is shaping about 80% of the traffic.

Regarding my setup:

Fritz!Box 5530 1 Gbit UP/DOWN (192.168.178.1)

Opnsense virtualized on Proxmox with 2 dedicated 1gbit NIC (WAN: 192.168.178.20, LAN: 10.0.0.1)
VM: 8 core, 16GB RAM, Host Kernel, AES activated
Hardware: The Proxmox has an Intel Core i7 7th Gen installed. NIC chipset is Realtek, rtl8111 (TP-Link TG-3468 v2)

From my workstation in the home network, I achieve the following bandwidths:
Speedtest (wieistmeineip, speedtest.net, etc): 140 mbit DOWN, 1 gbit UP
Web-Download(s): 80 mbit (depending on the mirror, but generally very slow)
Download-Client: 320 mbit (independent of the mirror, 1GBit+ should be achievable)
Battle.net: Full bandwidth
Steam: Full bandwidth

Things I have tried:
Tinkering with the tunables
Deactivated AdGuard Home
General troubleshooting / Google search / Scoured forums

When I connect my home network directly to the Fritzbox, I achieve full bandwidth on every client.

Can anyone explain the significant differences? Since I achieve full bandwidth with Steam and Battlenet, but only a fraction with all other downloads, I initially rule out an incorrect VM setup and defective hardware.

Before the fiber was completed, I used Starlink without any issues.

Tested now with Opnsense directly on baremetal and have the same issue. maybe some configuration on the internet router needed?

Knowing me, I've probably forgotten the most relevant information again :D

Thanks in advance for any help! :)

Regards,
Patrick

[saltyzip]

Hi, Are you using the opnsense Firewall->Shaper at all?

If you aren't do you have some VPN running on opnsense or somewhere that some of the traffic is being proxied via, causing the bandwidth discrepencies?

Cheers
S.

[maclinuxfree]

Hi,

never use any other nic except intel or broadcom on a proxmox hypervisor.
Realtek ist real bad on the hypervisor. If you install opnSense on bare metal you can use realtek.

[sheely1337]

yes, but i have the same issue with opensense on bare metal. One thing that came into my mind is a different MTU between the nic's.

Edit: iperf3 from client to LAN interface = 1 gbit/s, iperf2 from WAN interface to Fritz!box = 200 mbit/s

[maclinuxfree]

ok thats strange

[newsense]

yes, but i have the same issue with opensense on bare metal. One thing that came into my mind is a different MTU between the nic's.

Edit: iperf3 from client to LAN interface = 1 gbit/s, iperf2 from WAN interface to Fritz!box = 200 mbit/s

iperf tests to an interface are misleading - you're doing a CPU test on that.

Any VPNs or PPPoE involved ? This could be an MTU issue

[vpx23]

I already recommended another NIC in the German thread but before you buy a new one did you try the Realtek driver instead of the FreeBSD driver?

It's "os-realtek-re" under System: Firmware: Plugins.