OPNsense Forum

Archive => 23.7 Legacy Series => Topic started by: nrw on September 22, 2023, 12:03:17 PM

Title: Very high memory usage
Post by: nrw on September 22, 2023, 12:03:17 PM
Appeared after updating to version 23.7.4. Traffic is not high, on average 10-30 megabits/s.

OPNsense 23.7.4-amd64
FreeBSD 13.2-RELEASE-p3
OpenSSL 1.1.1v 1 Aug 2023

Intel(R) Celeron(R) N5105 @ 2.00GHz (4 cores, 4 threads)

Memory usage:
89 % ( 14506/16191 MB )

SYSTEM: DIAGNOSTICS: ACTIVITY

247 root 20 0 343M 142M wait 1 0:00 0.58% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 3 0:00 0.30% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 20 0 343M 142M wait 2 0:00 0.26% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 0 0:00 0.24% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 20 0 343M 142M wait 0 0:00 0.13% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 2 0:00 0.13% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 2 0:00 0.12% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 0 0:00 0.08% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 3 0:00 0.07% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M accept 0 0:44 0.03% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}


Services:

configd System Configuration Daemon
cron Cron
dhcpd DHCPv4 Server
dpinger Gateway monitor watcher
dpinger Gateway monitor (MTS_DHCP)
dpinger Gateway monitor (ROST_DHCP)
login Users and Groups
ntpd Network Time Daemon
pf Packet Filter
routing System routing
shadowsockslocal shadowsockslocal daemon
sysctl System tunables
syslog-ng Syslog-ng Daemon
unbound Unbound DNS
webgui Web GUI
Title: Re: Very high memory usage
Post by: _Alchemist_ on September 22, 2023, 02:32:10 PM
If you have OPNsense installed on ZFS, this is probably the ARC cache, which uses all free/unused RAM for caching.

In your case, however, it seems that there are a lot of Python processes eating up your available RAM.
Have you tried rebooting your OPNsense firewall?
Title: Re: Very high memory usage
Post by: nrw on September 22, 2023, 03:26:30 PM
I used the default installation options. If I'm not mistaken, in this case ufs is selected. After a reboot, 540MB of memory is used and is not growing yet.
Title: Re: Very high memory usage
Post by: newsense on September 22, 2023, 05:57:22 PM
Shadowsocks is not in the default install, and may have a memory leak. What happens when you restart the process ?
Title: Re: Very high memory usage
Post by: nrw on September 22, 2023, 07:59:01 PM
Quote from: newsense on September 22, 2023, 05:57:22 PM
Shadowsocks is not in the default install, and may have a memory leak. What happens when you restart the process ?
After the restart, the problem has not yet recurred, so I can't check. But do you really think that shadowsocks can create a bunch of python processes?
Title: Re: Very high memory usage
Post by: newsense on September 22, 2023, 09:03:02 PM
May very well be.

I'm not running shadowsocks anywhere and I don't have this issue with anything else running on my FWs
Title: Re: Very high memory usage
Post by: nrw on September 22, 2023, 09:33:27 PM
shadowsocks-libev is written in C
Title: Re: Very high memory usage
Post by: axsdenied on September 23, 2023, 12:43:31 AM
Quote from: nrw on September 22, 2023, 12:03:17 PM
Appeared after updating to version 23.7.4. Traffic is not high, on average 10-30 megabits/s.

OPNsense 23.7.4-amd64
FreeBSD 13.2-RELEASE-p3
OpenSSL 1.1.1v 1 Aug 2023

Intel(R) Celeron(R) N5105 @ 2.00GHz (4 cores, 4 threads)

Memory usage:
89 % ( 14506/16191 MB )

SYSTEM: DIAGNOSTICS: ACTIVITY

247 root 20 0 343M 142M wait 1 0:00 0.58% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 3 0:00 0.30% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 20 0 343M 142M wait 2 0:00 0.26% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 0 0:00 0.24% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 20 0 343M 142M wait 0 0:00 0.13% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 2 0:00 0.13% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 2 0:00 0.12% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 0 0:00 0.08% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M wait 3 0:00 0.07% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}
247 root 52 0 343M 142M accept 0 0:44 0.03% /usr/local/bin/python3 /usr/local/opnsense/service/configd.py console (python3.9){python3.9}


Services:

configd System Configuration Daemon
cron Cron
dhcpd DHCPv4 Server
dpinger Gateway monitor watcher
dpinger Gateway monitor (MTS_DHCP)
dpinger Gateway monitor (ROST_DHCP)
login Users and Groups
ntpd Network Time Daemon
pf Packet Filter
routing System routing
shadowsockslocal shadowsockslocal daemon
sysctl System tunables
syslog-ng Syslog-ng Daemon
unbound Unbound DNS
webgui Web GUI


Your diagnostic list looks cut off and it also doesn't by default, sort by memory usage.  You can sort that though.  i.e. unbound is taking most of my memory usage.

Title: Re: Very high memory usage
Post by: nrw on September 23, 2023, 08:43:22 AM
Quote from: axsdenied on September 23, 2023, 12:43:31 AM
Your diagnostic list looks cut off and it also doesn't by default, sort by memory usage.  You can sort that though.  i.e. unbound is taking most of my memory usage.
I sorted by the RES column, i.e. by memory usage.