Messages

241

19.7 Legacy Series / Re: Python 3.7 using max memory and filling disk space

« on: December 15, 2019, 06:17:09 pm »

When I manually run that command I receive back "status" : "ok"

This is a stock install, I think I started with an early version of 19.7 and have upgraded it as updates were made available through the OPNsense repos. I have not made any customizations to packages and have only installed two packages available on the mirrors, WOL and Smart.

One thing I also wanted to add, the "python3.7.core" file that was filling the disk was not removed on a reboot. I shutdown the firewall gracefully and powered it back up. When it came up, the disk space was completely exhausted and I had to manually remove the "python3.7.core" file to get the space back.

242

19.7 Legacy Series / Re: Python 3.7 using max memory and filling disk space

« on: December 14, 2019, 08:56:17 pm »

Here's the output of my filter_tables.conf file.

243

19.7 Legacy Series / Re: Python 3.7 using max memory and filling disk space

« on: December 14, 2019, 07:21:40 pm »

Thank you for the response. This is a fairly basic install and I don't use aliases. Here's a screenshot of my firewall aliases table.

The only packages I have installed are wake-on-lan and smart tools. I'm not using Suricata or Sensei on this install.

244

19.7 Legacy Series / Re: Python 3.7 using max memory and filling disk space

« on: December 14, 2019, 05:48:56 pm »

Looks like Python is completely filling the disk. I tried restarting all of the services shown on the dashboard homepage, this did not have any impact on the disk fill. I'm shutting down the firewall now, these are the last screen caps I grabbed before shutdown.

245

19.7 Legacy Series / Re: Python 3.7 using max memory and filling disk space

« on: December 14, 2019, 05:31:56 pm »

Replying 2nd time to add more attachments due to size limits.

246

19.7 Legacy Series / Python 3.7 using max memory and filling disk space

« on: December 14, 2019, 05:31:27 pm »

I noticed this morning that Python 3.7 seems to be maxing out my memory and is filling up the disk space on my SSD. I have not made any config changes to the firewall for the last week, the last config change that I made a week ago was to change the firewall optimization from "standard" to "aggressive". The firewall has been very stable for weeks without rebooting until today. It is currently passing traffic for now.

Is there a reason why Python 3.7 would fill the disk like this? This seems like a major problem in how it is functioning.

Firewall specs are as follows:
Intel J3455 (bare metal install)
16GB RAM
120GB SSD
Dual Broadcom NICs
OPNsense 19.7.7-amd64
FreeBSD 11.2-RELEASE-p16-HBSD
OpenSSL 1.0.2t 10 Sep 2019

Below are the screenshots showing the problem.

247

General Discussion / Re: Installation of Opnsense Minipc with Intel atom E3845 and quad core

« on: December 11, 2019, 05:05:02 am »

There was another user that posted here a few days ago with a similar issue. See this thread for a work around, it's related to a FreeBSD bug.

https://forum.opnsense.org/index.php?topic=11869.0

248

Hardware and Performance / Re: Large sawtooth CPU pattern at idle

« on: December 11, 2019, 05:03:42 am »

Unfortunately, I've noticed the same behavior since upgrading to the 19.7.x series. There was a thread on it early on when 19.7 was first released but I think it fell off the radar.

I know there was a push to migrate from Python 2.7 to 3, and it was theorized that this caused some of the usage increased. However, I've seen a significant increase in CPU usage and a noticeable delay in the webGUI when clicking and opening pages in OPNsense. It doesn't seem to impact the throughput or functionality of the system as a firewall, but it's been a step backwards in terms of usability.

Sorry I don't have a solution but, I'm also seeing the same thing for many months now with 19.7. Link to the 19.7 CPU usage thread for reference: https://forum.opnsense.org/index.php?topic=13507.0

249

General Discussion / Re: System stuck at "Booting... \"

« on: December 06, 2019, 05:48:14 am »

I recalled reading about this on the last version. This seems like the issue you are experiencing. I would try the fix listed in this thread and see if that helps? It looks to be a bug inherited from FreeBSD.

https://forum.opnsense.org/index.php?topic=11869.0

250

19.7 Legacy Series / Re: Zotac CI329 Nano - Error 19 during installation

« on: December 02, 2019, 03:32:39 am »

The error messages mention OPNsense Nano. Are you able to duplicate these same errors when using the full version of OPNsense and booting that off of a USB stick?

251

Hardware and Performance / Re: Are Realtek NICs really that bad?

« on: November 11, 2019, 04:34:39 am »

Realtek NICs tend to get a bad reputation due to the native FreeBSD driver support being poor. OPNsense does have a better driver for Realtek based NICs which can help them be more viable. Also, in situations where you are using an all-in-one device with little or no expansion options, a Realtek NIC may be the only connectivity option available.

However, in systems that are expandable with a PCIe slot, it's a minimal cost to buy a used server NIC with 2 or 4 ports and an Intel chipset. This is not strictly necessary but it's nearly a guarantee that the NIC won't be an issue down the road. Is it a necessity, definitely not. But if you have expansion options it's a minimal cost that will result in better utilization.

That's my 2c on the matter anyway. For the record, I used Realtek NICs for years on *BSD based firewalls. I always switched to Intel when possible (and when cost effective).

252

19.7 Legacy Series / Re: Firewall States Dump shows closed connections as established

« on: October 05, 2019, 05:52:20 pm »

I have only a basic understand of these so unfortunately I can't speak authoritatively as to why these defaults were chosen. Also it's worth noting that I took that screenshot from the other *sense site which is still FreeBSD based.

OPNsense may use different defaults if HardenedBSD changes these, but I don't know for sure. One of the devs would probably be able to shed more light on A) are the defaults different in HardenedBSD and B) why were the default values chosen?

253

19.7 Legacy Series / Re: Firewall States Dump shows closed connections as established

« on: October 05, 2019, 02:02:43 am »

Firewall/Settings/Advanced/Firewall Optimization is what you're looking for. Default is "normal". Be careful though, it changes more than just the parameters for "established" sessions. Attached a screenshot of option details.

254

General Discussion / Re: How to update from 16.1

« on: October 05, 2019, 01:56:08 am »

16.1 is very old. I'm not sure there is a direct upgrade path? I think your best bet would be to make a config backup and restore it on a new install. One of the devs may have another way to manually update the repos to potentially allow you to upgrade but unless it can skip packages we're talking years of versions that have come and gone.

255

19.7 Legacy Series / Re: constant ~50% cpu usage according to 'sysctl dev.cpu.*'

« on: September 12, 2019, 02:04:11 am »

Do you have the outputs of these two?

dev.cpu.0.cx_supported
dev.cpu.0.cx_lowest

If the supported value is C1 this may be why you're seeing such high values. If you have C states enabled in the BIOS and you are using the Power Savings settings, you should see C2/C3 or even higher values supported.