I turned SMTEN on in the bios for the Dec850. Seems like it might be improving performance of Suricata. Hope we get support for that driver update soon. Some speed tests have been coming in 200 Mb/s faster since I've turned it on. I also have various tuneables turned on. But, the issue started showing up after turning on multithreading. I know this cpu only has 8 threads, and not 16 with multi-threading. But, does that setting still do something for Epyc 302s?
I have to manually assign my ip, and either reboot the firewall or restart Kea to get dhcp up. Networking works out of the router, but my devices are not getting assigned after every reboot. Could this be a bug?
Update: Looks like it was from setting dev.igb.<x>.fc=0. I'd assume other settings from here (https://forum.opnsense.org/index.php?topic=6590.0) would have a similar impact. Either that or disabling powerd did it. I was able to get higher speeds intermittently, but those settings were not stable. Gateways kept going down, and download speeds would be 600 Mb/s for awhile, before suddenly dropping to 150 Mb/s. Still have SMT turned on and have not noticed any issues.