46
Hardware and Performance / Re: Poor 10Gb performance, need help troubleshooting
« on: November 04, 2021, 10:46:37 pm »I'm sure there are people using cxgbe based NICs. Have you search this forum ?Yes and without much coming up. But yes, I understand Chelsio are very popular both with TrueNAS and pfSense due to strong support in FreeBSD, so I would expect the cards to work very well. Indeed I use the same card (Chelsio T420-CR) in TrueNAS and it works very well and easily saturates 10Gb against other hosts (not OpnSense!).
Paste here some boot messages output of the driver ( dmesg | grep cxgbe ) , so it can be double-checked for queues/buffers/netmap configurations.
Code: [Select]
root@XXX:~ # dmesg | grep cxgbe
cxgbe0: <port 0> on t4nex0
cxgbe0: Ethernet address: 00:07:43:11:2b:10
cxgbe0: 8 txq, 8 rxq (NIC)
cxgbe1: <port 1> on t4nex0
cxgbe1: Ethernet address: 00:07:43:11:2b:18
cxgbe1: 8 txq, 8 rxq (NIC)
cxgbe1: tso4 disabled due to -txcsum.
cxgbe1: tso6 disabled due to -txcsum6.
cxgbe0: tso4 disabled due to -txcsum.
cxgbe0: tso6 disabled due to -txcsum6.
cxgbe1: link state changed to UP
cxgbe0: link state changed to UP
556.329305 [1130] generic_netmap_attach Emulated adapter for cxgbe1 created (prev was NULL)
556.329322 [1035] generic_netmap_dtor Emulated netmap adapter for cxgbe1 destroyed
556.331828 [1130] generic_netmap_attach Emulated adapter for cxgbe1 created (prev was NULL)
556.373055 [ 320] generic_netmap_register Emulated adapter for cxgbe1 activated
556.381334 [1130] generic_netmap_attach Emulated adapter for cxgbe0 created (prev was NULL)
556.381356 [1035] generic_netmap_dtor Emulated netmap adapter for cxgbe0 destroyed
556.384000 [1130] generic_netmap_attach Emulated adapter for cxgbe0 created (prev was NULL)
556.384271 [ 320] generic_netmap_register Emulated adapter for cxgbe0 activated
When you switch network adapters of the VM from PCI passthrough to Linux bridge+Virtio for example, are you getting more throughput with iperf3 ?Haven't tried virtual NICs. If there's one thing that people seems to have problem with, it's that... Recommendation seems to be to use passthrough if possible.
(my smaller HW based Proxmox + 4 vCore OPNsense VM give up to 3Gbps from WAN PC - through OPN - to LAN PC, iperf3 -P2 -t60 ... )