Big performance loss after upgrade

[Cuffs]

Hi

This is the topology:

  .-----+------.
  |  O   igb0  +
  |  P            |              .------------.     .------------.
  |  N   igb1  +--Trunk--+ Switch    +- -+ RPi        |
  |  s            |              .------------.     .------------.
  |  e   igb2  +
  |  n            |             .------------.
  |  s   igb3  +----------+ Laptop    |
  |  e            |             .------------.
  .------------.

RPi is connected to an access port in VLAN10
Laptop is connected to default LAN interface on OPNSense (no VLAN)

igb1 is connected to a trunk port, native VLAN10 and some other ones tagged.
(i know it might be better to change to everything tagged, I planned to do that in 22.1)


Before Upgrading I performed iperf3 tests and got throughputs ~900MBit
After Upgrading the same test shows ~300MBit
No changes were made to any config.

I have read through some articles of https://github.com/ocochard
There I also found the bridge performace issue in FreeBSD12 which was one of the reasons to update OPNSense to 22.1.

Question:
How to debug where this bottleneck resides (I'm very sure it is inside the OPNSense box)?
What board tools of OPNSense / FreeBSD13 can you recommend to look at?

I suspect it has to do with Queues/number of CPUs bound to the interface/interrupts/whatever?


Cheers
Christian

[Cuffs]

Ok,
lacking the skills to really follow @ocochards benches I chose to do what he calls "drunk method".
I tried out random things.

In the end I reinstalled the box with OPNSense 22.1 and rebuilt the config today.
What can I say... performance is back.

Thanks to FreeBSD 13 I even can use bridges to transfer SMB ~50 to 75 MB/sec. now

I suspect some tunables carried over from 21.7 might have caused my issues, but this is only a wild guess.


Just wanted to let the internet know what solved the problem for me.

Cheers
Christian