OPNsense
  • Home
  • Help
  • Search
  • Login
  • Register

  • OPNsense Forum »
  • Archive »
  • 22.1 Legacy Series »
  • [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« previous next »
  • Print
Pages: 1 2 3 [4] 5 6 7

Author Topic: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense  (Read 54174 times)

MartB

  • Newbie
  • *
  • Posts: 47
  • Karma: 6
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #45 on: October 07, 2021, 02:03:05 pm »
Quote from: franco on October 07, 2021, 01:17:11 pm
Quote from: MartB on October 07, 2021, 12:19:24 pm
Not available to download, no signature found.

Make sure:

1. Default mirror is set
2. "-z" is being used as indicated

It looks like everything is there: https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/sets/

I double checked (copied your command before), no dice cant get it to work. Mirror is also set to default.
Do i need to go back to base kernel and then install the new rss version maybe?

Code: [Select]
Fetching kernel-21.7.2-rss-amd64-RSS.txz: .+ mkdir -p /var/cache/opnsense-update/41781
+ opnsense-fetch -a -T 30 -q -o /var/cache/opnsense-update/41781/kernel-21.7.2-rss-amd64-RSS.txz.sig https://pkg.opnsense.org/FreeBSD:12:amd64/snapshots/sets/kernel-21.7.2-rss-amd64-RSS.txz.sig
.+ exit_msg ' failed, no signature found'
+ [ -n ' failed, no signature found' ]
+ echo ' failed, no signature found'
 failed, no signature found
+ exit 1
« Last Edit: October 07, 2021, 02:06:37 pm by MartB »
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13695
  • Karma: 1177
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #46 on: October 07, 2021, 02:05:28 pm »
Maybe you're having that other device type issue mentioned here. Helping is difficult if you don't paste the error, but try this one then:

    # opnsense-update -zfkr 21.7.2-rss -D ''


Cheers,
Franco
Logged

MartB

  • Newbie
  • *
  • Posts: 47
  • Karma: 6
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #47 on: October 07, 2021, 02:12:10 pm »
Yup it was the additional RSS breaking things, solved with the -D '' saw it only after running verbose output on the update command.
Logged

madj42

  • Newbie
  • *
  • Posts: 47
  • Karma: 3
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #48 on: October 22, 2021, 04:48:14 am »
Just curious as it's been a while since this was initially posted for testing.  Will this eventually be rolled into an upcoming point release soon or an updated kernel with the latest changes in the repo?

Thank you so much for the fort and work you guys do!
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13695
  • Karma: 1177
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #49 on: October 22, 2021, 03:40:32 pm »
The issue with RSS in IPv6 was fixed and the Unbound situation looks like a problem in the kernel regarding SO_REUSEPORT/RSS enabled combination: Unbound is using this by default, but it could be made conditional upon RSS flag for example.

Nevertheless we will ship the RSS-capable kernel with 21.7.4 defaulting to off like in this test series and will continue to improve it and do further testing to see if it can be enabled by default later on.


Cheers,
Franco
Logged

dinguz

  • Full Member
  • ***
  • Posts: 189
  • Karma: 7
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #50 on: October 22, 2021, 09:05:20 pm »
I just tested this and indeed the problem is gone when I disable so-reuseport in unbound.

Are there any other applications in general use with OPNsense that are known to use this socket option, and thus are possibly affected?
« Last Edit: October 22, 2021, 09:22:21 pm by dinguz »
Logged
In theory there is no difference between theory and practice. In practice there is.

bunchofreeds

  • Full Member
  • ***
  • Posts: 171
  • Karma: 10
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #51 on: October 24, 2021, 03:13:30 am »
Hi,

Will RSS and multiqueue benefit PPPoE when used as the WAN connection with your ISP?

Thanks
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13695
  • Karma: 1177
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #52 on: October 26, 2021, 08:40:52 am »
I added the RSS conditional for so-reuseport:

https://github.com/opnsense/core/commit/84d6b2acd5

After a bit of research PPPoE does not accelerate in RSS since the IP packets are higher up the stack and RSS will hash these to "0" so the distribution is one core only. I assume that also includes using the

Code: [Select]
net.isr.dispatch=deferred
tunable so for PPPoE users RSS would likely have to be kept off to get at least some performance increase from their connection. Linux does have RPS to deal with PPPoE acceleration but FreeBSD has no equivalent.


Cheers,
Franco
Logged

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13695
  • Karma: 1177
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #53 on: October 26, 2021, 08:41:57 am »
PS: Thanks all for testing this, highly appreciated! We will be adding a note in the release notes for Suricata speedup testing in the development version for 21.7.4.
Logged

bunchofreeds

  • Full Member
  • ***
  • Posts: 171
  • Karma: 10
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #54 on: October 26, 2021, 09:10:16 pm »
@Franco, thanks for the reply regarding PPPoE
Logged

madj42

  • Newbie
  • *
  • Posts: 47
  • Karma: 3
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #55 on: October 27, 2021, 01:51:41 pm »
Removed the question.  Sorry, lack of caffeine.  It's working great on 21.7.4.  Thank you for the work as always!
« Last Edit: October 27, 2021, 02:00:00 pm by madj42 »
Logged

dinguz

  • Full Member
  • ***
  • Posts: 189
  • Karma: 7
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #56 on: October 27, 2021, 09:24:16 pm »
Quote from: franco on October 22, 2021, 03:40:32 pm
The issue with RSS in IPv6 was fixed and the Unbound situation looks like a problem in the kernel regarding SO_REUSEPORT/RSS enabled combination: Unbound is using this by default, but it could be made conditional upon RSS flag for example.

I would consider this more of a workaround than a proper fix. Would this be a complicated issue to achieve a 'real' fix?
« Last Edit: October 28, 2021, 02:44:56 pm by dinguz »
Logged
In theory there is no difference between theory and practice. In practice there is.

franco

  • Administrator
  • Hero Member
  • *****
  • Posts: 13695
  • Karma: 1177
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #57 on: October 27, 2021, 09:28:30 pm »
Sure, did not claim it was a fix -- more of an opportunistic safeguard to prevent misconfiguring unbound when using RSS since it's not possible to turn so-reuseport off from the GUI.

Digging through the kernel code is going to take a lot more time than a two line change and Stephan is currently pushing the RSS modifications to our upcoming 22.1 branch on FreeBSD 13 so we can have that datapoint as well (it could have been fixed already?).


Cheers,
Franco
Logged

Tupsi

  • Newbie
  • *
  • Posts: 20
  • Karma: 0
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #58 on: November 13, 2021, 05:01:42 pm »
I wanted to thank you guys for getting this into the 21.7.x release lately. After doing the works with the mentioned tunables, I know finally get my full internet I currently should have (1000/500). Before these changes the download side throttled around 500, so I ended up with a 500/500 line.

so THANK YOU!
Logged

Koldnitz

  • Newbie
  • *
  • Posts: 48
  • Karma: 12
    • View Profile
Re: [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
« Reply #59 on: November 13, 2021, 08:16:51 pm »
Has anyone noticed significant (a full magnitude or greater slow down) on the average recursion time in unbound after enabling this option?

I tried with the latest stable build 21.7.5.

Cheers,
Logged

  • Print
Pages: 1 2 3 [4] 5 6 7
« previous next »
  • OPNsense Forum »
  • Archive »
  • 22.1 Legacy Series »
  • [Tutorial/Call for Testing] Enabling Receive Side Scaling on OPNsense
 

OPNsense is an OSS project © Deciso B.V. 2015 - 2023 All rights reserved
  • SMF 2.0.19 | SMF © 2021, Simple Machines
    Privacy Policy
    | XHTML | RSS | WAP2