OPNsense Forum

Archive => 22.7 Legacy Series => Topic started by: Morta on October 24, 2022, 02:34:29 PM

Title: Ookla speedtest with NIC 25 Gbits
Post by: Morta on October 24, 2022, 02:34:29 PM
Hi

I have a ISP Connection of 25 Gbps and a NIC with 2x25 Gbps. When I lunch Ookla CLI Speedtest I get 10 Gbps in Up/Download but no ~20 Gbps. The Server ID of ooklaserver is 43030.

Are 25 Gbps possible with OPNsense...
Title: Re: Ookla speedtest with NIC 25 Gbits
Post by: seed on October 24, 2022, 03:39:02 PM
Did you do already basic checks?

Whats the portspeed negogiation on the link?
Whats your CPU load?
How many streams?

Whats your TCP windows size?
What cpu are you using?
Title: Re: Ookla speedtest with NIC 25 Gbits
Post by: Morta on October 24, 2022, 03:48:39 PM
Yes.

I have a Intel NIC and should not have any isssues.
Xeon CPU loads go never over 30%
I believe there is one stream.

Jumboframes aren't supported by ISP.

Xeon W-? a eightcore CPU with enough power.
Title: Re: Ookla speedtest with NIC 25 Gbits
Post by: Morta on October 24, 2022, 04:05:04 PM

ifconfig | grep ixl1

ixl1: flags=8a63<UP,BROADCAST,RUNNING,ALLMULTI,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN
options=4800028<VLAN_MTU,JUMBO_MTU,NOMAP>
ether 64:9d:99:b1:b4:ae
inet XXX netmask 0xffffff00 broadcast XXX
inet6 XXX::669d:99ff:feb1:b4ae%ixl1 prefixlen 64 scopeid 0x4
inet6 XXX:168:XXX:33:669d:99ff:feb1:b4ae prefixlen 64 autoconf
inet6 XXX:168:XXX:33::26 prefixlen 128
media: Ethernet autoselect (25GBase-LR <full-duplex>)
status: active
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>



sysctl hw.model hw.machine hw.ncpu

hw.model: Intel(R) Xeon(R) W-3223 CPU @ 3.50GHz
hw.machine: amd64
hw.ncpu: 16
Title: Re: Ookla speedtest with NIC 25 Gbits
Post by: seed on October 24, 2022, 04:32:23 PM
i wasnt refering to jumboframes. i meant TCP window size.

you can read more about that here.:
https://networklessons.com/cisco/ccie-routing-switching-written/tcp-window-size-scaling

increase your tcp buffers in system tunables. you might google for the sysctl values you need.

if possible spin up a 25G Server in the cloud and test with iperf3 to that server.
Title: Re: Ookla speedtest with NIC 25 Gbits
Post by: Morta on October 24, 2022, 05:12:59 PM
Thx.

I found that on pfsense TCP widows size not be touched by the firewall. (Nothing found for OPNsense)

https://support.pfsense.narkive.com/ESAuH5Oy/tcp-tuning-for-pfsense

I will sniff with wireshark the TCP window size of the connection.

https://docs.netgate.com/pfsense/en/latest/hardware/tune.html#intel-ix-4-cards

Is this also guilty for ixl cards? I can't find anything for ixl cards only ix.

I have no Cloud access with 25 Gbps.