Hello everybody!
I am running openSense on OVH VPS (current offering name: VPS vps2020-elite-8-8-160 ) which comes with 2 Gbps network throughput (as well as 8 vCores and 8GB of RAM). Running Debian live I get full 2 Gbps speed. In opnSense I get 1.2Gbps tops. The role of this instance is hosting a Wireguard end-node and proxy exposing some of my homelab services to the Internet. There is no IPS/IDP running.
Testing methodology and results:
1. speedtest utility (https://www.speedtest.net/apps/cli) installed from ookla repository
Speedtest by Ookla
Server: Nextmap - LeKloud - Paris (id: 33869)
ISP: OVH SAS
Idle Latency: 6.82 ms (jitter: 0.08ms, low: 6.68ms, high: 6.87ms)
Download: 1009.36 Mbps (data used: 1.2 GB)
60.84 ms (jitter: 49.77ms, low: 6.71ms, high: 435.52ms)
Upload: 1191.78 Mbps (data used: 1.7 GB)
17.63 ms (jitter: 2.73ms, low: 6.68ms, high: 39.55ms)
Packet Loss: 7.4%
Result URL: https://www.speedtest.net/result/c/34e8b7ee-c258-448b-8d8b-4365752d6cf9
2. iperf3 test with OVH iperf3 server (https://proof.ovh.net/)
# iperf3 -c proof.ovh.net -i 1
Connecting to host proof.ovh.net, port 5201
[ 5] local <vps IP> port 52084 connected to 152.228.221.228 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 114 MBytes 954 Mbits/sec 0 3.00 MBytes
[ 5] 1.00-2.00 sec 138 MBytes 1.16 Gbits/sec 0 3.00 MBytes
[ 5] 2.00-3.00 sec 144 MBytes 1.21 Gbits/sec 0 3.00 MBytes
[ 5] 3.00-4.00 sec 135 MBytes 1.13 Gbits/sec 0 3.00 MBytes
[ 5] 4.00-5.00 sec 142 MBytes 1.19 Gbits/sec 0 3.00 MBytes
[ 5] 5.00-6.00 sec 135 MBytes 1.13 Gbits/sec 0 3.00 MBytes
[ 5] 6.00-7.00 sec 146 MBytes 1.23 Gbits/sec 0 3.00 MBytes
[ 5] 7.00-8.00 sec 146 MBytes 1.23 Gbits/sec 0 3.00 MBytes
[ 5] 8.00-9.00 sec 134 MBytes 1.13 Gbits/sec 483 1.58 MBytes
[ 5] 9.00-10.00 sec 117 MBytes 985 Mbits/sec 87 108 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.32 GBytes 1.13 Gbits/sec 570 sender
[ 5] 0.00-10.01 sec 1.32 GBytes 1.13 Gbits/sec receiver
iperf Done.
Steps taken so far:
1. disabled Spectre and Meltdown mitigation as per the docs (https://docs.opnsense.org/troubleshooting/hardening.html)
2. disabled hardware offloding as per the docs (https://docs.opnsense.org/manual/virtuals.html)
3. setting tunables:
net.isr.maxthreads = -1
net.isr.dispatch = deferred
net.isr.bindthreads = 1
net.isr.defaultqlimit = 2048
net.inet.rss.enabled = 1
as per many blog posts
My target:
to have the same (well, I won't complain if its better) performance as Debian (full 2Gbps throughput)
Additional data:
netstat -Q (https://pastebin.com/W7nGYqnQ)
loader.conf (http://ix.io/4qgJ)
pciconf -lv (http://ix.io/4qgL)
I'm reaching out to openSense forums, as under live Linux distro performance is OK, hence I suspect it's not ISP fault.
Has anyone here dealt with similar issue before?
Do you have any tips or hints I might follow?
Regards,
Bretos
Hello,
unfortunately the issue persists :( Bumping the thread, as I didn't find any solution thus far.
Hello,
maybe now, after some time has passed, anybody has an idea? ;-)
Do they have different virtual network interfaces available? Could you try changing from VirtIO to Intel Gigabit?
Unfortunately there is no such option :(
Could you show the output of
ifconfig vtnet0
please?
root@stronghold:~ # ifconfig vtnet0
vtnet0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN (wan)
options=80088<VLAN_MTU,VLAN_HWCSUM,LINKSTATE>
ether fa:16:3e:b2:d6:aa
inet 51.210.41.17 netmask 0xfffffe00 broadcast 51.210.41.255
media: Ethernet autoselect (10Gbase-T <full-duplex>)
status: active
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Dang. Nothing unusual ...