I am in the process of switching from PFsense to OPNsense.I upgraded hardware at the same time but am not seeing the same speeds between VLAN's with SMB or Veeam backups as I did on the old system. The new system is a Xeon E-2174G, 2x 8GB DDR4 at 2666 and a Mellanox MCX416A ConnectX-4 NIC for internal traffic running OPNsense 25.7.5. I know dual 40Gb ports is wishful thinking but the old system with 2x 10Gb ports was faster.
Anyways, looking at the guides for tunables like net.isr.maxthreads to experiment with, I cannot find them. Under system/settings/tunables it goes from net.inet6.ip6.use_tempaddr to net.link.bridge.pfil_bridge without any net.isr listed. Is there some hidden toggle I am missing to make more tunables show up? The tunables for everything I have searched for in the performance guides don't seem to exist.
If a sysctl is not present you can add it using the "+" at the bottom right (of "System: Settings: Tunables").
What was your old system?
Thanks, that was what I was missing. Gained about 2Gb/s with net.isr.maxthreads -1. Will be interesting to see what else helps.
The old PFsense system was a E3-1230 v5 with a dual port Intel X520.
Disabling the Spectre and Meltdown mitigations with vm.pmap.pti 0 and hw.ibrs_disable 1 then rebooting has been interesting. I was testing with several parallel SMB transfers to max out the network speed since one SMB transfer was hovering around 600-700 MB/s. With those two changes, a single SMB transfer ends up the same speed as on the local unrouted subnet which is maxing out a 10Gb connection.