New install extremely slow through router but fast to or from the router

[ritkit]

Hello all,

I just migrated to OpnSense from a dd-wrt installation on my proxmox environment. When I first installed and tested with speedtest I was seeing proper download speed, but my upload speed never went past 800Kbps / .8 Mbps.

Now after the 18hrs of operation has gone by, it has dropped to 1.5 ish Mbps up and down for almost all users except for my work laptop. My work laptop uses a VPN and that seems fine. I have not disabled VPN to test that yet cause I don't want to mess with what works.

Where this gets really interesting is the fact that when I run tests to or from the Router specifically, the data rates are expected. However any tests through the box see the speeds hold at around 1ish Mbps

For a quick breakdown the diagram of the 3 different tests I ran.

Code Select Expand

                 IPerf Public Tst .08Kbps
                 Speedtest-CLI .8~ Mbps
           ┌──────────────────────────────────┐
           │                                  │
┌──────────▼┐         ┌──────────────┐        ├────────────┐
│ Speedtest │310~Mbps │ OPNSense RTR │ 2.5Gbps│ Speed Test │
│   or      ├─────────┤              ├────────┤     VM     │
│ Iperf Srv │ Up/Down │ VM Host 3    │ Up/Down│  VM Host 1 │
└───────────┘         └──────────────┘        └────────────┘

Screenshots of each test are also below.

Test 1 - Speed Test VM Testing to OpnSense


Test 2 - OpnSense Testing to speedtest.net


Test 3 - Speed Test VM Testing to Public IPerf Server


Test 4 - Speed Test VM Testing to Speedtest.net


I really don't understand what is going on, this is a brand new deployment. Below are some of the items I have checked so far and have messed around with none of which have made a difference.

Things I have tried, from other posts and myself

• Enable and disable netflow and rrp analysis items
• Set the power management to Maximum, even though PowerD is set to disabled.
• Enabled PowerD with the same settings, and tried some other combinations
• Cleared out config in Shaper/pipes just clicked the clear button on everything
• Rebooted the appliance multiple times
• TOP and CPU reported is basically 0
• Enabled and Disabled all of the various hardware acceleration settings
• Reinstalled the VM using the CD but on the same VM config/disk
• Set Outbound NAT to both Automatic and Hybrid

Prox VM Config for those who want to know.

Code Select Expand


boot: order=scsi0;net0
cores: 4
cpu: kvm64,flags=+aes
memory: 12288
name: home-rtr-01
net0: virtio=FA:13:D6:D3:47:7A,bridge=vmbr0,tag=66
net1: virtio=0E:F9:61:BF:1A:CB,bridge=vmbr0,trunks=10;20;30;40;50;60
numa: 0
ostype: l26
scsi0: PrimaryStore:vm-100-disk-0,iothread=1,size=64G
scsihw: virtio-scsi-single
smbios1: uuid=b62a9860-d256-4019-80ff-750deaea85fd
sockets: 1
vmgenid: 92e6c4f1-b304-4297-9581-d236b29d22c0


Screenshot of running services


Lastly, I can provide a redacted config or answer questions about the config as needed.

OPNsense 22.1-amd64
FreeBSD 13.0-STABLE
OpenSSL 1.1.1m 14 Dec 2021

I am just at a loss now on what next items I can check or mess around with. Any suggestions are appreciated.

[Griff1962]

I am seeing a similar issue with a new install on a Protectli Vault FW4B, speedtest from the firewall is inline with the ISP service speed, but when running a speedtest on a PC attached to the LAN side of the firewall/router with a OPNSense basic setup the speedtest results are less than half up/down speeds.  Any ideas on a cause?

[ars_tom]

I'm facing similar issues after my upgrade to 22.1. Download speed on WAN is normal but upload speed is extremly low.

I found some information on https://forum.opnsense.org/index.php?topic=26364 but this is related to hyper-v virtualization but I'm running on qemu/kvm.

Up to now I haven't found any solution for this issue besides going back to 21.7.

[ars_tom]

This change helped me to solve my upload issue:
https://forum.opnsense.org/index.php?topic=26602.msg128862#msg128862

If you have a VLAN but HAVE NOT assigned the parent interface please do so, enable it and then all the hardware features are properly turned off to get your speed back.