OPNsense
  • Home
  • Help
  • Search
  • Login
  • Register

  • OPNsense Forum »
  • Archive »
  • 22.1 Legacy Series »
  • [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« previous next »
  • Print
Pages: 1 2 [3] 4 5 ... 7

Author Topic: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense  (Read 53730 times)

madj42

  • Newbie
  • *
  • Posts: 47
  • Karma: 3
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #30 on: September 18, 2021, 03:54:19 pm »
Does anyone know if there is a way to change the policy on the ip6 protocol from flow to cpu?  That is the difference I notice in some of the previous posts.  Thinking this may be why I'm not getting RSS on ip6.
Logged

hemirunner426

  • Newbie
  • *
  • Posts: 18
  • Karma: 4
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #31 on: September 30, 2021, 08:02:33 pm »
Also decided to test this out with a Protectli FW6B.

- WAN is PPPoE 1G/1G
- LAN is split between LAN and 4 VLANs
- Sensei running on LAN.

I set net.inet.rss.bits = 2.  Not sure if this is correct on a 2 core/2HT processor.  Seems to work fine on speedtest with reasonable CPU usage.

Also something to keep in mind, if you upgrade to a hotfix release it will replace the RSS kernel.  Be sure to reinstall the RSS kernel if you upgrade to the hotfix released yesterday.
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #32 on: October 01, 2021, 09:48:49 am »
> Also something to keep in mind, if you upgrade to a hotfix release it will replace the RSS kernel.  Be sure to reinstall the RSS kernel if you upgrade to the hotfix released yesterday.

That's why you can lock any package to prevent it from upgrading. ;)
Logged

hemirunner426

  • Newbie
  • *
  • Posts: 18
  • Karma: 4
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #33 on: October 01, 2021, 03:18:13 pm »
I found the lock in the UI.  That's handy.  ;D
Logged

dinguz

  • Full Member
  • ***
  • Posts: 189
  • Karma: 7
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #34 on: October 04, 2021, 10:23:33 am »
Quote from: dinguz on September 17, 2021, 12:06:38 am
I am seeing something odd here. If I have RSS enabled, unbound is no longer working on all threads. I have a 2 core machine, unbound starts with 2 threads, but thread 0 is not doing any work. When I disable RSS using the sysctl and reboot, unbound is working normally again.
Are any other people seeing this?

I have reported this a few weeks ago, and I'm wondering if I'm the only one experiencing this. Are other people seeing this as well, or have been able to reproduce?

It's quite easy to check: just enable RSS, reboot, go to the Unbound stats page in the GUI, and you'll probably see all zeroes for thread 0.


BTW: how do I revert to the stock kernel? If I do
Code: [Select]
opnsense-update -kr 21.7.2 it keeps trying to download a RSS version of the kernel.
« Last Edit: October 04, 2021, 02:49:53 pm by dinguz »
Logged
In theory there is no difference between theory and practice. In practice there is.

madj42

  • Newbie
  • *
  • Posts: 47
  • Karma: 3
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #35 on: October 04, 2021, 07:28:45 pm »
Same thing here with the kernel.  No matter what you type in, it will append -rss to the name.  Looking at the verbose output it's saying that it's trying to download from the sets folder but when I look on every mirror, these kernels are in the snapshots folder.  Not sure if they were removed?  Due to this I'm getting a no valid signature error.
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #36 on: October 05, 2021, 12:43:22 pm »
It's trying to stick to the kernel device designation which is correct historically speaking. We rarely do have different kernel builds and only really needed them with ARM which is where this feature comes from.

This should force it back to the generic device configuration (the -D '' bit is important)

# opnsense-update -kf -D ''


Cheers,
Franco
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #37 on: October 05, 2021, 08:07:11 pm »
PS: https://github.com/opnsense/tools/commit/6fa3d553a -- this only affects testing kernels really and no production kernel can exhibit this issue.
Logged

dinguz

  • Full Member
  • ***
  • Posts: 189
  • Karma: 7
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #38 on: October 05, 2021, 08:48:25 pm »
Another observation, this is part of the 'netstat -Q' output from a stock kernel:
Code: [Select]
Protocols:
Name   Proto QLimit Policy Dispatch Flags
ip         1   1000   flow  default   ---
igmp       2    256 source  default   ---
rtsock     3    256 source  default   ---
arp        4    256 source  default   ---
ether      5    256 source   direct   ---
ip6        6    256   flow  default   ---


Below is the 'netstat -Q' output from a system with the RSS kernel, but RSS disabled (net.inet.rss.enabled=0):
Code: [Select]
Protocols:
Name   Proto QLimit Policy Dispatch Flags
ip         1   2048   flow  default   ---
igmp       2    256 source  default   ---
rtsock     3    256 source  default   ---
arp        4    256 source  default   ---
ether      5    256 source   direct   ---
ip6        6    256    cpu   hybrid   C--

Notice the difference for ip6? Apparently the sysctl does not completely enable/disable RSS for ip6.
Logged
In theory there is no difference between theory and practice. In practice there is.

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #39 on: October 07, 2021, 08:06:36 am »
Let me check when I have some spare time. Stephan is not available at the moment to look into it.


Cheers,
Franco
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #40 on: October 07, 2021, 09:53:56 am »
Stephan found it, small issue with a refactor from my side:

# opnsense-update -zfkr 21.7.2-rss

The sticky device issue was also fixed, the kernel should report:

% uname -v
FreeBSD 12.1-RELEASE-p20-HBSD  b9b6960472e(master) SMP


Cheers,
Franco
Logged

dinguz

  • Full Member
  • ***
  • Posts: 189
  • Karma: 7
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #41 on: October 07, 2021, 12:07:51 pm »
Thanks for the quick reply. Has anyone been able to have a look at the interaction with unbound?
Logged
In theory there is no difference between theory and practice. In practice there is.

MartB

  • Newbie
  • *
  • Posts: 47
  • Karma: 6
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #42 on: October 07, 2021, 12:19:24 pm »
Quote from: franco on October 07, 2021, 09:53:56 am
Stephan found it, small issue with a refactor from my side:

# opnsense-update -zfkr 21.7.2-rss

The sticky device issue was also fixed, the kernel should report:

% uname -v
FreeBSD 12.1-RELEASE-p20-HBSD  b9b6960472e(master) SMP


Cheers,
Franco

Not available to download, no signature found.
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13637
  • Karma: 1174
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #43 on: October 07, 2021, 01:17:11 pm »
Quote from: MartB on October 07, 2021, 12:19:24 pm
Not available to download, no signature found.

Make sure:

1. Default mirror is set
2. "-z" is being used as indicated

It looks like everything is there: https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/sets/

I can look at Unbound issue too as soon as I can finish my work on the upcoming 21.10 business update.


Cheers,
Franco
Logged

tuto2

  • Administrator
  • Newbie
  • *****
  • Posts: 48
  • Karma: 11
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #44 on: October 07, 2021, 01:51:10 pm »
Quote from: dinguz on October 07, 2021, 12:07:51 pm
Thanks for the quick reply. Has anyone been able to have a look at the interaction with unbound?

I will take a look at it, but as Franco noted I have a limited amount of time at hand right now. Will update as soon as I can.

Cheers,

Stephan
Logged

  • Print
Pages: 1 2 [3] 4 5 ... 7
« previous next »
  • OPNsense Forum »
  • Archive »
  • 22.1 Legacy Series »
  • [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
 

OPNsense is an OSS project © Deciso B.V. 2015 - 2023 All rights reserved
  • SMF 2.0.19 | SMF © 2021, Simple Machines
    Privacy Policy
    | XHTML | RSS | WAP2