Reporting>Traffic halves my Gigabit bandwidth

[bunchofreeds]

Hi,

If I have Reporting>Traffic open and displaying the realtime traffic graph in a browser, a speedtest.net from a device behind OPNsense reports about half of my Gigabit connection. I have a 900/400 plan.

Is anyone else seeing this?

My instance is virtual on Proxmox
Connection to WAN is PPPoE with VLAN 10 tagged on the proxmox virtio device

With Reporting>Traffic open
    Latency:     1.45 ms   (0.06 ms jitter)
   Download:   429.59 Mbps (data used: 691.8 MB)
     Upload:   164.40 Mbps (data used: 294.3 MB)
Packet Loss:     0.0%

Without Reporting>Traffic open
    Latency:     1.22 ms   (0.15 ms jitter)
   Download:   918.34 Mbps (data used: 800.9 MB)
     Upload:   497.61 Mbps (data used: 263.9 MB)
Packet Loss:     0.0%

[bunchofreeds]

It would be great to hear from someone who can say its working fine for them.
Reporting>Traffic open and showing their full gigabit bandwidth being used when running a speedtest to/from the internet.

I'm assuming I'm missing something simple and its fine?
But currently it looks like having Reporting>Traffic open actually drops my connection to half speed. So I can't actually use this to see what my bandwidth is up to.

[KHE]

Hi,

I just tested it, and I get my full gigabit bandwidth regardless if I have the Reporting->Traffic page open or not.
I used the speedtest cli on debian 10 and on the opnsense itself.

I run my opnsense on a Protectli FW6. No idea what goes wrong on your side.
Try to run top on the command line and do you speedtest then with the Traffic page open. Also you can have a look in Proxmox how the Opnsense VM and the CPU load is when you run the speedtest. 

KH

[bunchofreeds]

Thanks for the reply KHE

It's good to know it should work, I wanted to make sure it wasn't some bug.
I'll see what I'm doing wrong.
Both the Proxmox host and OPNsense report very little utilisation when both running a speedtest with or without reporting>traffic. So it doesn't seem to be hardware related.
It's possible it's NIC related.
I'm running through a dual port intel 82576EB card

Is it possible for you to run the speedtest from a device behind OPNsense?

Thanks again

[KHE]

The debian machine is behind the OPNsense. And there is no real difference between the debian machine and the OPNsense itself.

[bunchofreeds]

Thanks again for verifying it works for you.

'top' on OPNsense shows two instances of iftop consume about 30% WCPU each when reporting>traffic is running.
They don't do this when not running reporting>traffic

interesting...

I'm assuming that an instance of iftop is spawned for each interface being monitored through Reporting>Traffic. In my case this is WAN and LAN.

That's quite an overhead for traffic monitoring I would have thought. ~30% for each process.

Removing one interface from being monitored does improve throughput when Reporting>Traffic is being viewed.

[bunchofreeds]

bum

[giffordj]

On dedicated hardware, Dell Precision T1700 with 4 port Intel network adapter,  getting  full gig internet up and down, when I was on VM, no way. I was only getting 700/700 up and down.

On proxmox the only way I got it work properly, is a dedicated nic, that wasn't realtek.

[johndchch]

'top' on OPNsense shows two instances of iftop consume about 30% WCPU each when reporting>traffic is running.
They don't do this when not running reporting>traffic

what's the cpu in your host?

I just opened up the traffic graph and watched whilst I initiated a speedtest run from another machine on a 940/500 fibre connection - I get full speed as expected and I can see the 2 instances of iftop are each taking 2% cpu  ( opnsense is running bare-metal on an i7-6700 with an intel x540-t2 nic )

[bunchofreeds]

Thanks for the reply giffordj and johndchch

Host has an i7-3770 CPU
I've only allocated 4 vCPU and 8GB to OPNsense however.

OPNsense never really gets above 20% utilisation sustained for any time.
The host only has OPNsense and another low utilisation VM running currently.
Everything works really well and fast unless I open Reporting>Traffic

OPNsense if running very basic. Nothing additional is configured to run like IPS etc.

It does seem a lot higher for me at ~30% CPU per iftop process and you only seeing ~2%

I just find it strange that I can easily get my 900/400 through unless I run Reporting>Traffic.

[bunchofreeds]

If I putty into OPNsense and run iftop without any switches, this also drops my available bandwidth when running a speedtest.

I will try allocating more resources to the OPNsense VM and retest.

Edit: Same outcome with 8 vCPU and 16GB RAM. Backing disk is SSD.

Thanks for replying everyone.
Unless there is some silver bullet I have missed I will put it down to having OPNsense virtualised.
If I find anything out I will reply to this post.

Thanks
 

[bunchofreeds]

This is resolved for me in 22.1