Hi all!
Struggling with some network weirdness in the last few days and I believe it could be down to the firewall, so turning here for help. Running OPNsense on an older Qotom Intel passive box and a Proxmox host elsewhere running Pihole (DNS, DHCP) and other things like HA, Pialert, Unifi NC and such.
I'm seeing tests be really sporadic; speedtests via Ookla's tool will start at anywhere between 35-5 mpbs and 'freeze' for a few seconds, then instantly drop to 2-6 mpbs. This might happen again, or, it might stay completely steady at an exact number until the up/down portion (whatever bit is being tested) completes. Clearly, it hangs - you obviously can't get a network speed solid enough to sit at 8.63 mpbs for seconds in a row!
Similarly, using Ubiquiti's WIFIMan, I can't run speed tests - they either start, or don't start at all, and drop to a generic failed error. My ping in WIFIMan to general public servers can be anywhere from normal (40-60~ odd) or hang up at 120-250~.
Had a look around and ended up coming to the OPNsense; these usage graphs make me think it's hanging - working too hard, getting pinned, and hanging the network until some CPU space frees up. Posting here to see if you guys concur or disagree.
Relevant screenshots here as it's easier to post to imgur than downsize for the forums. For the included Speedtest results, I roughly annotated the speeds around the cuts. It really does hang there for a sec then instantly dip like a cliff; that's part of what makes me feel like CPU bottlenecking. For instance, the download section hits 33.something (about right for this time of day on my 50/20 connection) then hangs, and suddenly it's at 4.something. Same with upload, and it could do this two or even three times a test.
If I'm right and it IS CPU pinning - what would you recommend I do to loosen up the device a bit? Disable Zenarmor, I'm guessing would be the most impactful/unneeded service? I can replace this box with something else, but I'd need it to work until I can. FWIW, before this, it was quite solid - it only started this in the last, hmm, roughly 4 days.
I rebooted everything last night and ran updates, so everything (OPNsense, Proxmox, Pihole etc.) is on the latest firmware.
https://imgur.com/a/z4aSJrZ
Thanks all in advance!
Speedtest are good measuring max bandwith but not so great in measuring stability.
You could run a ping test to google.com instead (both for IPv4 and IPv6) and see if there are spikes in the response time or even timeouts.
I am currently doing the same thing, not sure if my AP, Switch or OPNsense is acting up.
Since I only have ping problems from my Laptop, but not if I ping from OPNsense Interfaces: Diagnostics: Ping
I know that the problem has to be my hardware in between :)
Okay, a bit of an update here. Not sure why this has reared it's head in this way.
I ran a health check in OPNsense and all the stock stuff seemed happy, but, I got a ton of Python errors (pasted below) from ZenArmor. I've turned off the interface to monitor + put it in report only mode and this seems to have resolved the problem. Short of the OPNsense device itself degrading (for example, overheating due to aging thermal paste - no, temps aren't an issue as far as the OPNsense monitor shows) I can't see why it would suddenly start pinning the CPU, so my guess is this missing Python library is causing ZenArmor--and by extension, the whole system--to hang while it, I dunno - works around the problem or waits for an error?
Might need to move this to a ZenArmor thread if I can get a hand from a smart cookie out there to narrow it down to definitely being ZA. Definitely looking for some advice on how best to repair ZA here or reinstall it - I don't want to screw anything up now that this device is deployed.
Thanks again to all!
Extracted health check info relating to ZA:
os-sensei is missing a required shared library: libpython3.9.so.1.0
>>> Check for missing or altered package files
Checking all packages: ....
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/MarkupSafe-2.1.5.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/MarkupSafe-2.1.5.dist-info/WHEEL
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/_distutils_hack/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiofiles-24.1.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiohappyeyeballs-2.3.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiohttp-3.10.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiohttp-3.10.1.dist-info/WHEEL
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiosignal-1.3.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/aiosqlite-0.20.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/async_cache-1.1.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/attrs-24.1.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/certifi-2024.7.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/charset_normalizer-3.3.2.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/distro-1.9.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/distutils-precedence.pth
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/dnspython-2.6.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/frozenlist-1.4.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/idna-3.7.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/importlib_metadata-8.2.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/jinja2-3.1.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/motor-3.5.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/multidict-6.0.5.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/nest_asyncio-1.6.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/packaging-24.1.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pip-24.2.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/__about__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/_structures.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/markers.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/requirements.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/specifiers.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/tags.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/utils.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/_vendor/packaging/version.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pkg_resources/extern/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/psutil-6.0.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/psutil-6.0.0.dist-info/WHEEL
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/py_cpuinfo-9.0.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pygal-3.0.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pymongo-4.8.0.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pymongo-4.8.0.dist-info/WHEEL
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/pythonping-1.1.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/requests-2.32.3.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/_msvccompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/archive_util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/bcppcompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/ccompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/cmd.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/bdist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/bdist_dumb.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/bdist_rpm.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/build.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/build_clib.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/build_py.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/build_scripts.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/check.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/clean.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/config.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install_data.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install_egg_info.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install_headers.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install_lib.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/install_scripts.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/py37compat.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/register.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/sdist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/command/upload.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/config.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/core.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/cygwinccompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/dep_util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/dir_util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/dist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/errors.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/extension.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/fancy_getopt.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/file_util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/filelist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/log.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/msvc9compiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/msvccompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/py38compat.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/spawn.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/sysconfig.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/text_file.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/unixccompiler.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/version.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_distutils/versionpredicate.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/more_itertools/more.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/__about__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/_structures.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/markers.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/requirements.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/specifiers.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/tags.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/utils.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/_vendor/packaging/version.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/archive_util.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/build_meta.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/bdist_egg.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/build_ext.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/build_py.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/dist_info.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/easy_install.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/egg_info.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/install.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/install_egg_info.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/install_scripts.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/sdist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/test.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/command/upload_docs.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/depends.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/dist.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/errors.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/extension.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/extern/__init__.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/installer.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/monkey.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/msvc.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/package_index.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/wheel.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/setuptools/windows_support.py
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/typing_extensions-4.12.2.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/urllib3-2.2.2.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/yarl-1.9.4.dist-info/RECORD
os-sensei-1.17.6: checksum mismatch for /usr/local/zenarmor/py_venv/lib/python3.9/site-packages/zipp-3.19.2.dist-info/RECORD
Second update. I put Zenarmor in report only mode and unchecked LAN and it resolved itself.
Looking up os-sensei is missing a required shared library: libpython3.9.so.1.0 I found other mention of things breaking, including one or two posts about Zenarmor, albeit from previous versions (one post was from 3.9>3.11, one from 3.8>3.9) and in one, the user suggested that they reinstalled Zenarmor and it was resolved.
Looks like, for whatever reason, Zenarmor upgraded and Python 3.9 screwed up. I'm no dev and I don't know much about implementation in FreeBSD or Python so I can't do more than speculate, but my guess is it had an upgrade at some point from 3.9 and that, I dunno, screwed up. Maybe the installed didn't have permissoin to delete or modify the 3.9 folder? Again, I can only make vaguely educated guesses based on juuuust enough Linux knowledge to be dangerous. (Yes, I know FreeBSD is it's own OS and not a Linux distro, but I think it would get lumped in with Linux 99/100 times so it stands as a generalisation.)
I've reinstalled ZA, disappointingly, and will update this one more time if that resolves it. After approx. 10~ minutes of monitoring the (previously lagging/freezing/very spiky graphs) it looks smooth, so I'm guessing the reinstalled removed and redownloaded the bad/good python portions.