Call for testing: official netmap kernel

Started by mb, September 16, 2020, 06:53:51 PM

Previous topic - Next topic
September 17, 2020, 03:24:09 AM #15 Last Edit: September 17, 2020, 03:27:02 AM by mb
Quote from: almodovaris on September 16, 2020, 11:40:47 PM
Nope, it did not change the download speed in APU2. If anything, it got even lower. I use Sensei 1.6 with September definitions.

@almadovaris, APU2 is quite weak. Though, I would not expect BW getting lower. Can you share a few figures?

New netmap kernel + Sensei 1.6 is producing better results for us and for some users we're in touch with. We were able to attain around 1 Gbps  sustained throughput even with old Xeon servers (ubench scores around 180K-220K - all igb drivers).

I only have a free license in a home learning / testing environment but thanks for the info.

Sent from my SM-N986U using Tapatalk


September 17, 2020, 03:25:49 AM #17 Last Edit: September 17, 2020, 03:28:05 AM by mb
Quote from: DanMc85 on September 17, 2020, 03:24:27 AM
I only have a free license in a home learning / testing environment but thanks for the info.

Register for https://sunnyvalley.cloud and you'll find a surprise ;) You can get a trial license for 7 days now - will be publicly announced next week.




Quote from: mb on September 17, 2020, 03:25:49 AM
Quote from: DanMc85 on September 17, 2020, 03:24:27 AM
I only have a free license in a home learning / testing environment but thanks for the info.

Register for https://sunnyvalley.cloud and you'll find a surprise ;) You can get a trial license for 7 days now - will be publicly announced next week.

Is the trial license the surprise lol

Sent from my SM-N986U using Tapatalk


Upgrading on a system with igb drivers gains no improvement or benefit correct?

Quote from: XeroX on September 17, 2020, 04:03:55 PM
Upgrading on a system with igb drivers gains no improvement or benefit correct?

Hi @XeroX, with regard to reliability,stock 20.7.2 is already fine. With the beta kernel and 1.6, we've been reported of performance improvements. If you're fine with your performance, you might want to wait for the release.

September 17, 2020, 04:44:30 PM #21 Last Edit: September 17, 2020, 05:00:21 PM by almodovaris
Quote from: mb on September 17, 2020, 03:24:09 AM
Quote from: almodovaris on September 16, 2020, 11:40:47 PM
Nope, it did not change the download speed in APU2. If anything, it got even lower. I use Sensei 1.6 with September definitions.

@almadovaris, APU2 is quite weak. Though, I would not expect BW getting lower. Can you share a few figures?

New netmap kernel + Sensei 1.6 is producing better results for us and for some users we're in touch with. We were able to attain around 1 Gbps  sustained throughput even with old Xeon servers (ubench scores around 180K-220K - all igb drivers).
I am a home user, I won't invest thousand Euros for a router. I have unprotected igb2 (i.e. got it outside of Sensei) and that's where my Usenet download boxes are.

In Opnsense 20.1 I got 180 to 200 Mbps download speed through Sensei.

In Opnsense 20.7 with normal kernel I get 65 to 75 Mbps download speed. With the netmap kernel I get 60 to 65 Mbps.

Of course that's measuring the download speed the same way, with Ookla from my internet provider. If I measure it with Fing for mobile phone I get now (netmap kernel) 120 Mbps to 235 Mbps, depending on the router. Through OpenVPN from a computer behind Sensei the speed is again much higher than without VPN.

I did notice that easpect runs about 92% of one processor core during high speed download.

So, yeah, basically I am content about Sensei since my high speed downloads go outside of it.
OPNsense HW:

Minisforum Venus series UN100C, 16 GB RAM, 512 GB SSD
T-bao N9N Pro, 16 GB RAM, 512 GB SSD

Thanks for the further information.

Quote from: almodovaris on September 17, 2020, 04:44:30 PM
I am a home user, I won't invest thousand Euros for a router. I have unprotected igb2 (i.e. got it outside of Sensei) and that's where my Usenet download boxes are.

Fair enough.

As a side note, for home-use; at a few hundred, it's possible to find some other solutions in the market.
My colleague is able to saturate his 1Gbps AT&T fiber (Sensei 1.6 and 20.7.2-netmap kernel) with a cheap box:
https://www.speedtest.net/result/c/b847d8ab-56a3-42bc-983e-fc6e5d89adfe

September 17, 2020, 05:42:32 PM #23 Last Edit: September 17, 2020, 07:51:19 PM by almodovaris
Like I said, I got 235 Mbps with Sensei. I suspect that's the maximum my WiFi allows through my mobile phone (I also have other clients for 5 GHz WiFi).

Between 60 Mbps and 235 Mbps there is a huge difference. I don't know how Fing measures speed, but if it would work the same way for Usenet speed, it would be great.

Ok, got it: TLS Usenet connections have a speed of just under 9 MB/s through Sensei. Unencrypted Usenet connections have a speed around 26 MB/s or 27.5 MB/s.

So, unencrypted Usenet reaches about 220 Mbps.
OPNsense HW:

Minisforum Venus series UN100C, 16 GB RAM, 512 GB SSD
T-bao N9N Pro, 16 GB RAM, 512 GB SSD

Quote from: mb on September 17, 2020, 03:18:01 AM
Quote from: heresjody on September 16, 2020, 11:22:00 PM
To doublecheck I'm providing valid testing results for you (PPPoE WAN / Suricata)
1. Only select interface: In my case LAN (vtnet) and don't select WAN (vtnet vlan 6)
2. Add public IP to home networks.

Hi @heresjody:

1- Correct. Though we have not touched pppoe+netmap yet. Use Sensei on LAN.
2- Not sure if I understood correctly. Can you elaborate?

I'm using Suricata, not Sensei. In the settings of Suricata you can add your public IP to the home network setting. Since PPPoE and netmap hasn't been touched yet thi setting is irrelevant. For now at least 😬

September 17, 2020, 11:27:21 PM #25 Last Edit: September 18, 2020, 01:05:44 AM by almodovaris
I have pressed 12 and y without knowing in advance that it will revert my kernel. So, after rebooting APU2, I measured the download speed for unencrypted Usenet through Sensei and it's almost 270 Mbps (instead of 220 Mbps with the netmap kernel).

Found the solution: uncheck "Disable hardware large receive offload" save, and reboot. Then netmap kernel is as fast as stock kernel. I mean for unencrypted Usenet connections I got 275 Mbps out of 300 Mbps nominal Usenet speed. But this does not work for SSL or TLS Usenet connections.
OPNsense HW:

Minisforum Venus series UN100C, 16 GB RAM, 512 GB SSD
T-bao N9N Pro, 16 GB RAM, 512 GB SSD

whats the uname output of the "fixed" kernel?

I did install all available upgrades and ended up with a bootloop so selected previous kernel, disabled sensei 1.6 for the moment at boot while I figure out what I should be seeing ...

this is on ESX 6.7.0 (Build 9484548)


Quote from: heresjody on September 18, 2020, 02:18:41 PM
FreeBSD 12.1-RELEASE-p9-HBSD

so this is the fixed, correct kernel?

FreeBSD host.name.xyz 12.1-RELEASE-p9-HBSD FreeBSD 12.1-RELEASE-p9-HBSD  3b652d8ad0e(master) SMP  amd64