Slow performance bandwidth - 1/2GB on 10GB NIC.

Started by Aghast1396, June 26, 2025, 05:59:52 PM

Previous topic - Next topic
June 26, 2025, 05:59:52 PM Last Edit: June 26, 2025, 08:29:04 PM by Aghast1396
Hello,
I am new in this world and I face something that I can't figure it out.

Setup:

OPN, LAN(PC), NAS(TrueNAS Scale), AP(wifi)

OPN - Silicom Quad Port 10Gb PCIe RJ45 PE310G4I40EU-T X540-T4   - i3-12100F, 8GB RAM
LAN & NAS - SILICOM PE210G2I40E-T-LP Dual Port 10G Ethernet Adapter PE210G2I40-T X540-T2
NAS - 5900X, 128GB RAM
PC  - 3700x, 32GB RAM

LAN 192.168.1.1/24
NAS 192.168.2.1/24
AP 192.168.3.1/24

OPN <-> LAN
OPN <-> NAS
OPN <-> AP

Traffic from LAN to NAS hop thru OPN.

IPERF3

OPN -> LAN 10Gb
LAN -> OPN 10Gb
---------------
OPN -> NAS 10Gb
NAS -> OPN 10Gb
---------------
LAN -> NAS 1Gb
NAS -> LAN 2Gb


I don't understand why I get these results of 1/2Gb ( and why different ) between LAN and NAS. This in contrast with the others working on 10Gb

Config in OPN:
ix0 - WAN
ix1 - LAN
ix2 - NAS
ix3 - AP

Rules in firewall ( directly on interfaces, no vLANs as I don't think they are required for my small homelab )

Source - Destination - Rule
WAN
* - NAS Address - Block

LAN
* - * - Allow

NAS
nothing

AP
AP net - NAS Address - Allow
AP net - LAN Address - Block
AP net - * - Allow



Tunables:
dev.ix.1.num_queues - 4
dev.ix.2.num_queues - 4
net.isr.dispatch - deffered
net.isr.bindthreads - 1
net.isr.maxthreads - 4
net.inet.rss.enabled - 1


OPN Versions
OPNsense 25.1.9_2-amd64
FreeBSD 14.2-RELEASE-p3
OpenSSL 3.0.16