20.7.8: SMB Performance

[ToniG]

Hello

I have searched quite a bit and found various mentions of this issue but I wanted to open another thread because the other discussions went a bit into different directions.

So we are currently on opnSense 20.7.8. The firewall has (among others) 2 VLAN interfaces (both networks are on the same switch). We have an rsync job that copies files from one network to the other and noticed a dramatic performance degradation a while ago, potentially when we upgraded opnSense or switched from pfSense to opnSense.

Previously, we had a transfer performance of around 200-400 MB/s (so 2-4Gbit). Now we are down to 10-20 MB/s (i.e. around 100-200Mbit).
We did performance test:
- The same transfers within the same network (i.e. on the same source/target) are perfectly fine. We reach 700-900MB/s, so we can exclude an issue with the shares or the underlying storage.
- iPerf shows good performance
- Other applications, such as a Veeam job accross the two VLANs also perform okay (300-500MB/s)

However, any type of Samba or SMB transfers through the firewall perform extremely bad and we are not sure why this is. We tried rsync, SMB shares with windows, Samba shares, copy-paste with windows, robocopy, rsync...basically all roughly in the same ballpark (10-30MB/s). Note that we are talking about the copy of single, large files (i.e. the issue of having millions of tiny files is not the problem here).

The firewalls are sufficiently specced (actually, rather overspecced) :
- 12 Physical Cores
- 32GB RAM
- Dual 40Gbit to the switch
- The endpoints / hosts are connected with dual 10Gbit


Is there an issue with this particular version? Can someone think of any configuration issue we might be having?


Edit: Here the graph as an example. The left side, basically barely visible is the SMB copy, the 3-4Gbits are when backups are running....

[bartjsmit]

You can try:

- deep dive into the packet traces with Wireshark
- retooling the transfers with NFS

but I reckon since you seem to have an enterprise environment, you'd be better off speaking to business support: https://shop.opnsense.com/product-categorie/support/

Bart...