OPNsense
  • Home
  • Help
  • Search
  • Login
  • Register

  • OPNsense Forum »
  • English Forums »
  • Intrusion Detection and Prevention »
  • Performance tuning for IPS maximum performance
« previous next »
  • Print
Pages: 1 ... 3 4 [5] 6 7 8

Author Topic: Performance tuning for IPS maximum performance  (Read 219963 times)

Supermule

  • Full Member
  • ***
  • Posts: 235
  • Karma: 15
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #60 on: June 12, 2020, 09:05:33 pm »
I am hitting no more than 300/300 with IDS/IPS and running a 16core/32GB highend server.

IDS takes a big hit on performance.
Logged

spetrillo

  • Hero Member
  • *****
  • Posts: 721
  • Karma: 8
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #61 on: June 12, 2020, 09:08:46 pm »
I am curious...is there a way to know which tunable options are actually in effect when the system is up? Can I run a command to list all of them as active?
Logged

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #62 on: June 12, 2020, 11:14:24 pm »
That's a superb question... When I check the settings with sysctl -A | grep dev.igb, everything is fine; which means is set to 0. Obviously, it isn't; else, I would not expect to see any change regarding the throughput when typing the settings on console...
And, how can I be sure that the other settings related to the NICs are applied correctly ? They all show up fine; but who knows ...
Btw, I disabled IPS; just checking is active. I run a smal and well controlled network. I just want to know, in case of some possible problems. With IPS enabled, I achieved close to 300M... 8 cores don't help, afaik... It looks like only one core is used.
Logged

spetrillo

  • Hero Member
  • *****
  • Posts: 721
  • Karma: 8
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #63 on: June 15, 2020, 03:52:31 am »
It definitely would be helpful to know that those options you have selected are indeed active.

As to your test it seems there is a real premium on higher frequency cores rather than many lower frequency cores, if only one core is used.
Logged

Supermule

  • Full Member
  • ***
  • Posts: 235
  • Karma: 15
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #64 on: June 15, 2020, 11:25:18 am »
what IDS profile are you using??

There is a setting to change how IDS uses the process/cores.

Quote from: dl3it on June 12, 2020, 11:14:24 pm
That's a superb question... When I check the settings with sysctl -A | grep dev.igb, everything is fine; which means is set to 0. Obviously, it isn't; else, I would not expect to see any change regarding the throughput when typing the settings on console...
And, how can I be sure that the other settings related to the NICs are applied correctly ? They all show up fine; but who knows ...
Btw, I disabled IPS; just checking is active. I run a smal and well controlled network. I just want to know, in case of some possible problems. With IPS enabled, I achieved close to 300M... 8 cores don't help, afaik... It looks like only one core is used.
Logged

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #65 on: June 15, 2020, 07:08:06 pm »
I use Hyperscan, promiscuous mode (due to VLANs), IDS enabled, IPS disabled. Currently are abt. 1900 rules enabled. But there is still some space for more, until I loose the 1 Gbit/s.
Where do you configure the CPU usage ? I don't have such an option, even in advanced mode. I run a 4 core CPU (AMD FX-8800 P), where 3 cores most of the time feel quite bored  ;D
Logged

hushcoden

  • Hero Member
  • *****
  • Posts: 551
  • Karma: 23
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #66 on: June 15, 2020, 10:03:23 pm »
Quote from: Supermule on June 15, 2020, 11:25:18 am
what IDS profile are you using??

There is a setting to change how IDS uses the process/cores.
Sorry, where is it ?
Logged

Supermule

  • Full Member
  • ***
  • Posts: 235
  • Karma: 15
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #67 on: June 16, 2020, 12:10:16 am »
Quote from: hushcoden on June 15, 2020, 10:03:23 pm
Quote from: Supermule on June 15, 2020, 11:25:18 am
what IDS profile are you using??

There is a setting to change how IDS uses the process/cores.
Sorry, where is it ?

Sorry. I mixed up OPNSense with pfsense. Running both to compare.
Logged

mimugmail

  • Hero Member
  • *****
  • Posts: 6767
  • Karma: 494
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #68 on: June 16, 2020, 05:53:12 am »
Profiles come with 20.7
Logged
WWW: www.routerperformance.net
Support plans: https://www.max-it.de/en/it-services/opnsense/
Commercial Plugins (German): https://opnsense.max-it.de/

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #69 on: June 16, 2020, 09:09:18 am »
I changed to development firmware upgrade. It's 20.7 now, but still with 11.2 BSD.
Performance is significantly improved. I can run now IDS and IPS, with increased rule set (~3000) at 1GB/s; with Hyperscan and net.bpf.zerocopy_enabled=1. The load goes to slightly more than 1 without IPS, and close to 2 with IPS enabled. Powerd is set to hiactive.
Logged

mimugmail

  • Hero Member
  • *****
  • Posts: 6767
  • Karma: 494
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #70 on: June 16, 2020, 09:58:59 am »
Quote from: dl3it on June 16, 2020, 09:09:18 am
I changed to development firmware upgrade. It's 20.7 now, but still with 11.2 BSD.
Performance is significantly improved. I can run now IDS and IPS, with increased rule set (~3000) at 1GB/s; with Hyperscan and net.bpf.zerocopy_enabled=1. The load goes to slightly more than 1 without IPS, and close to 2 with IPS enabled. Powerd is set to hiactive.

Switching to devel mode will only update the UI, not (yet!) the OS, but it should install Suricata 5 and allows to set profile mode.
Logged
WWW: www.routerperformance.net
Support plans: https://www.max-it.de/en/it-services/opnsense/
Commercial Plugins (German): https://opnsense.max-it.de/

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #71 on: June 16, 2020, 10:22:55 am »
That's what it looks like now....

Logged

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #72 on: June 16, 2020, 03:44:25 pm »
I did an ISO upgrade and 20.7 with 12.1 is running now. Currently ~8000 rules are activated, IDS and IPS enabled, Hyperscan gives abt. 850MB/s. The other algorithms gave significantly worse results; down to 100MB/s.
Do you have any hints for me regarding the profile ? Do I have to edit the settings file, or can this be done by GUI ? 
Logged

mimugmail

  • Hero Member
  • *****
  • Posts: 6767
  • Karma: 494
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #73 on: June 16, 2020, 07:34:26 pm »
Hit Advanced in General
Logged
WWW: www.routerperformance.net
Support plans: https://www.max-it.de/en/it-services/opnsense/
Commercial Plugins (German): https://opnsense.max-it.de/

dl3it

  • Newbie
  • *
  • Posts: 9
  • Karma: 0
    • View Profile
Re: Performance tuning for IPS maximum performance
« Reply #74 on: June 16, 2020, 09:37:11 pm »
Thanks.... Got it...

Best results with Hyperscan and profile "High"... Abt. 780Mb/s with 8556 rules. The changes between the profiles are marginal; between 740MB/s and 780Mb/s.
The other algorithmns are far slower... Maximum 400Mb/s, down to 140Mb/s... With any profile.

Current "optimum" settings attached.

If I can test anything special for you, fell free to ask  8)
Logged

  • Print
Pages: 1 ... 3 4 [5] 6 7 8
« previous next »
  • OPNsense Forum »
  • English Forums »
  • Intrusion Detection and Prevention »
  • Performance tuning for IPS maximum performance
 

OPNsense is an OSS project © Deciso B.V. 2015 - 2024 All rights reserved
  • SMF 2.0.19 | SMF © 2021, Simple Machines
    Privacy Policy
    | XHTML | RSS | WAP2