Ookla speedtest with NIC 25 Gbits

[Morta]

Hi

I have a ISP Connection of 25 Gbps and a NIC with 2x25 Gbps. When I lunch Ookla CLI Speedtest I get 10 Gbps in Up/Download but no ~20 Gbps. The Server ID of ooklaserver is 43030.

Are 25 Gbps possible with OPNsense…

[seed]

Did you do already basic checks?

Whats the portspeed negogiation on the link?
Whats your CPU load?
How many streams?

Whats your TCP windows size?
What cpu are you using?

[Morta]

Yes.

I have a Intel NIC and should not have any isssues.
Xeon CPU loads go never over 30%
I believe there is one stream.

Jumboframes aren’t supported by ISP.

Xeon W-? a eightcore CPU with enough power.

[Morta]

Code: [Select]

ifconfig | grep ixl1

ixl1: flags=8a63<UP,BROADCAST,RUNNING,ALLMULTI,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN
options=4800028<VLAN_MTU,JUMBO_MTU,NOMAP>
ether 64:9d:99:b1:b4:ae
inet XXX netmask 0xffffff00 broadcast XXX
inet6 XXX::669d:99ff:feb1:b4ae%ixl1 prefixlen 64 scopeid 0x4
inet6 XXX:168:XXX:33:669d:99ff:feb1:b4ae prefixlen 64 autoconf
inet6 XXX:168:XXX:33::26 prefixlen 128
media: Ethernet autoselect (25GBase-LR <full-duplex>)
status: active
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>


Code: [Select]

sysctl hw.model hw.machine hw.ncpu

hw.model: Intel(R) Xeon(R) W-3223 CPU @ 3.50GHz
hw.machine: amd64
hw.ncpu: 16


[seed]

i wasnt refering to jumboframes. i meant TCP window size.

you can read more about that here.:
https://networklessons.com/cisco/ccie-routing-switching-written/tcp-window-size-scaling

increase your tcp buffers in system tunables. you might google for the sysctl values you need.

if possible spin up a 25G Server in the cloud and test with iperf3 to that server.

[Morta]

Thx.

I found that on pfsense TCP widows size not be touched by the firewall. (Nothing found for OPNsense)

https://support.pfsense.narkive.com/ESAuH5Oy/tcp-tuning-for-pfsense

I will sniff with wireshark the TCP window size of the connection.

https://docs.netgate.com/pfsense/en/latest/hardware/tune.html#intel-ix-4-cards

Is this also guilty for ixl cards? I can't find anything for ixl cards only ix.

I have no Cloud access with 25 Gbps.