openSense on OVH VPS - half network speed

[Bretos]

Hello everybody!

I am running openSense on OVH VPS (current offering name:  VPS vps2020-elite-8-8-160 ) which comes with 2 Gbps network throughput (as well as 8 vCores and 8GB of RAM). Running Debian live I get full 2 Gbps speed. In opnSense I get 1.2Gbps tops. The role of this instance is hosting a Wireguard end-node and proxy exposing some of my homelab services to the Internet. There is no IPS/IDP running.

Testing methodology and results:

1. speedtest utility installed from ookla repository
   Speedtest by Ookla

      Server: Nextmap - LeKloud - Paris (id: 33869)
         ISP: OVH SAS
Idle Latency:     6.82 ms   (jitter: 0.08ms, low: 6.68ms, high: 6.87ms)
    Download:  1009.36 Mbps (data used: 1.2 GB)
                 60.84 ms   (jitter: 49.77ms, low: 6.71ms, high: 435.52ms)
      Upload:  1191.78 Mbps (data used: 1.7 GB)
                 17.63 ms   (jitter: 2.73ms, low: 6.68ms, high: 39.55ms)
Packet Loss:     7.4%
  Result URL: https://www.speedtest.net/result/c/34e8b7ee-c258-448b-8d8b-4365752d6cf9

2. iperf3 test with OVH iperf3 server
# iperf3 -c proof.ovh.net -i 1
Connecting to host proof.ovh.net, port 5201
[  5] local <vps IP> port 52084 connected to 152.228.221.228 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   114 MBytes   954 Mbits/sec    0   3.00 MBytes
[  5]   1.00-2.00   sec   138 MBytes  1.16 Gbits/sec    0   3.00 MBytes
[  5]   2.00-3.00   sec   144 MBytes  1.21 Gbits/sec    0   3.00 MBytes
[  5]   3.00-4.00   sec   135 MBytes  1.13 Gbits/sec    0   3.00 MBytes
[  5]   4.00-5.00   sec   142 MBytes  1.19 Gbits/sec    0   3.00 MBytes
[  5]   5.00-6.00   sec   135 MBytes  1.13 Gbits/sec    0   3.00 MBytes
[  5]   6.00-7.00   sec   146 MBytes  1.23 Gbits/sec    0   3.00 MBytes
[  5]   7.00-8.00   sec   146 MBytes  1.23 Gbits/sec    0   3.00 MBytes
[  5]   8.00-9.00   sec   134 MBytes  1.13 Gbits/sec  483   1.58 MBytes
[  5]   9.00-10.00  sec   117 MBytes   985 Mbits/sec   87    108 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.32 GBytes  1.13 Gbits/sec  570             sender
[  5]   0.00-10.01  sec  1.32 GBytes  1.13 Gbits/sec                  receiver

iperf Done.


Steps taken so far:

1. disabled Spectre and Meltdown mitigation as per the docs
2. disabled hardware offloding as per the docs
3. setting tunables:

net.isr.maxthreads = -1
net.isr.dispatch = deferred
net.isr.bindthreads = 1
net.isr.defaultqlimit = 2048
net.inet.rss.enabled = 1

as per many blog posts

My target:
to have the same (well, I won't complain if its better) performance as Debian (full 2Gbps throughput)

Additional data:
netstat -Q
loader.conf
pciconf -lv


I'm reaching out to openSense forums, as under live Linux distro performance is OK, hence I suspect it's not ISP fault.
Has anyone here dealt with similar issue before?
Do you have any tips or hints I might follow?

Regards,
Bretos

[Bretos]

Hello,

unfortunately the issue persists :( Bumping the thread, as I didn't find any solution thus far.

[Bretos]

Hello,

maybe now, after some time has passed, anybody has an idea? ;-)

[Patrick M. Hausen]

Do they have different virtual network interfaces available? Could you try changing from VirtIO to Intel Gigabit?

[Bretos]

Unfortunately there is no such option :(

[Patrick M. Hausen]

Could you show the output of

ifconfig vtnet0

please?

[Bretos]

root@stronghold:~ # ifconfig vtnet0
vtnet0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: WAN (wan)
        options=80088<VLAN_MTU,VLAN_HWCSUM,LINKSTATE>
        ether fa:16:3e:b2:d6:aa
        inet 51.210.41.17 netmask 0xfffffe00 broadcast 51.210.41.255
        media: Ethernet autoselect (10Gbase-T <full-duplex>)
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

[Patrick M. Hausen]

Dang. Nothing unusual ...