OPNsense Forum

English Forums => Hardware and Performance => Topic started by: zooombie on May 22, 2024, 01:19:24 pm

Title: Wan speed with opnsense and a r86s u4 is slower than expected
Post by: zooombie on May 22, 2024, 01:19:24 pm
Hi,
I've been using pfsense for a long time but my isp recently installed a 10/10 fiber in my home, so I took the opportunity to reinstall everything and finally try opnsense.

This is my final/desired configuration:
The isp router is connected in "dmz mode" with a rj45 to an opnsense router (I'll replace it with a bridge in a few days).
On the router there are some vlans with some rules (lan, lansrv, security, linuxisosdownload, ...), haproxy, unbound,..
Everything is trunked to a MikroTik CRS305 via SFP+, with no untagged traffic (the physical interface is enabled but without ip assigned).
On the MikroTik:
- the rj45 port goest to an unifi switch (wap, appletv, server's ipmi port).
- one sfp+ goest to my proxmox machine (network card: connectx-3) (trunk).
- one sfp+ goes to my pc (network card: connectx-3) (untagged).

The problem is that with a gowin r86s u4 i can "only" reach max 5000/5000.

So I did some tests removing the switch and vlans from the equation.

fromtonotesspeed
isp routerdirectly to pc10gbase-t transceiver7900/7900
r86s u4 opnsensedirectly to pcspectre/meltdown mitigations ON5000/5000
r86s u4 opnsensedirectly to pcspectre/meltdown mitigations OFF microcodes update5000/5000
r86s u4 opnsensedirectly to pcspectre/meltdown mitigations OFF5000/5000
x9scm-f e3-1270v2 opnsensedirectly to pcspectre/meltdown mitigations ON5000/5000
x9scm-f e3-1270v2 opnsensedirectly to pcspectre/meltdown mitigations OFF7600/7600
r86s u4 pfsensedirectly to pcrun the test only once so I don't have a real avg7500/7500

I though the problem was caused by the r86s but since it seems to be a lot faster with pfsense there must be something else (freebsd version, some misterious settings...).

I also did some crossvlan iperf between the pc and a vm, with both devices I can reach around 6 Gbits/sec.

Any ideas on how to investigate this? I don't think i will go back to pfsense because 5000/5000 is not really a problem 8) but I'd like to understand why this happens.


Thanks!