Ntopng 1.2 randomly stopping

[mcat528]

Having an issue where NTOPNG service keeps crashing on OPNsense firewall. Seems to happen at top of the hour on random hours but always exits with "error 11" as shown below. There are a few errors on NTOPNG startup that don't seem to be related to this issue.

System Info:

Version: OPNsense 20.1.7-amd64
FreeBSD 11.2-RELEASE-p20-HBSD
CPU Type Intel(R) Celeron(R) CPU J1900 @ 1.99GHz (4 cores)
ntopng Community Edition v.4.0.200422

NTOP version:  os-ntopng (installed)   1.2

System error log:

504385 2020-04-30T14:01:03 kernel: pid 1606 (ntopng), uid 288: exited on signal 11
511085 2020-05-01T08:17:45 ntopng: [Utils.cpp:3351] WARNING: ntopng has not been compiled with libcap-dev
511205 2020-05-01T08:17:45 ntopng: [Utils.cpp:3352] WARNING: Network discovery and other privileged activities will fail

NtopNG log:

29/Apr/2020 09:05:59 [main.cpp:380] Logging onto /var/db/ntopng/ntopng.log
29/Apr/2020 09:05:59 [main.cpp:383] Working directory: /var/db/ntopng
29/Apr/2020 09:05:59 [main.cpp:385] Scripts/HTML pages directory: /usr/local/share/ntopng
29/Apr/2020 09:05:59 [Ntop.cpp:437] Welcome to ntopng amd64 v.4.0.200422 - (C) 1998-20 ntop.org
29/Apr/2020 09:05:59 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for re0
29/Apr/2020 09:05:59 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for re0
29/Apr/2020 09:05:59 [Ntop.cpp:832] Adding xx/32 as IPv4 interface address for re0
29/Apr/2020 09:05:59 [Ntop.cpp:841] Adding 72.192.132.0/22 as IPv4 local network for re0
29/Apr/2020 09:05:59 [Ntop.cpp:832] Adding 192.168.1.1/32 as IPv4 interface address for re1
29/Apr/2020 09:05:59 [Ntop.cpp:841] Adding 192.168.1.0/24 as IPv4 local network for re1
29/Apr/2020 09:05:59 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for re1
29/Apr/2020 09:05:59 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for re1
29/Apr/2020 09:05:59 [Ntop.cpp:863] Adding ::1/128 as IPv6 interface address for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:873] Adding ::1/128 as IPv6 local network for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:863] Adding fe80::1/128 as IPv6 interface address for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:873] Adding fe80::1/64 as IPv6 local network for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:832] Adding 127.0.0.1/32 as IPv4 interface address for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:841] Adding 127.0.0.0/8 as IPv4 local network for lo0
29/Apr/2020 09:05:59 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for ovpns1
29/Apr/2020 09:05:59 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for ovpns1
29/Apr/2020 09:05:59 [Ntop.cpp:832] Adding 192.168.2.1/32 as IPv4 interface address for ovpns1
29/Apr/2020 09:05:59 [Ntop.cpp:841] Adding 192.168.2.1/32 as IPv4 local network for ovpns1
29/Apr/2020 09:05:59 [PeriodicActivities.cpp:105] Started periodic activities loop...
29/Apr/2020 09:06:03 [PeriodicActivities.cpp:165] Each periodic activity script will use 5 threads
29/Apr/2020 09:06:03 [NetworkInterface.cpp:2343] Started packet polling on interface re0 [id: 1]...
29/Apr/2020 09:06:03 [NetworkInterface.cpp:2343] Started packet polling on interface re1 [id: 2]...
29/Apr/2020 09:06:03 [NetworkInterface.cpp:2343] Started packet polling on interface lo0 [id: 3]...
29/Apr/2020 09:06:03 [NetworkInterface.cpp:2343] Started packet polling on interface ovpns1 [id: 4]...
29/Apr/2020 10:00:01 [LuaEngine.cpp:3405] ERROR: Unable to enable capabilities
29/Apr/2020 10:00:15 [LuaEngine.cpp:3405] ERROR: Unable to enable capabilities
29/Apr/2020 10:01:08 [LuaEngine.cpp:3405] ERROR: Unable to enable capabilities
30/Apr/2020 14:01:02 [LuaEngine.cpp:3405] ERROR: Unable to enable capabilities
30/Apr/2020 14:01:03 [LuaEngine.cpp:12141] WARNING: Script failure [/usr/local/share/ntopng/scripts/callbacks/system/discover.lua][attempt to index a string value]
01/May/2020 08:17:45 [main.cpp:380] Logging onto /var/db/ntopng/ntopng.log
01/May/2020 08:17:45 [main.cpp:383] Working directory: /var/db/ntopng
01/May/2020 08:17:45 [main.cpp:385] Scripts/HTML pages directory: /usr/local/share/ntopng
01/May/2020 08:17:45 [Ntop.cpp:437] Welcome to ntopng amd64 v.4.0.200422 - (C) 1998-20 ntop.org
01/May/2020 08:17:45 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for re0
01/May/2020 08:17:45 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for re0
01/May/2020 08:17:45 [Ntop.cpp:832] Adding xx/32 as IPv4 interface address for re0
01/May/2020 08:17:45 [Ntop.cpp:841] Adding 72.192.132.0/22 as IPv4 local network for re0
01/May/2020 08:17:45 [Ntop.cpp:832] Adding 192.168.1.1/32 as IPv4 interface address for re1
01/May/2020 08:17:45 [Ntop.cpp:841] Adding 192.168.1.0/24 as IPv4 local network for re1
01/May/2020 08:17:45 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for re1
01/May/2020 08:17:45 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for re1
01/May/2020 08:17:45 [Ntop.cpp:863] Adding ::1/128 as IPv6 interface address for lo0
01/May/2020 08:17:45 [Ntop.cpp:873] Adding ::1/128 as IPv6 local network for lo0
01/May/2020 08:17:45 [Ntop.cpp:863] Adding fe80::1/128 as IPv6 interface address for lo0
01/May/2020 08:17:45 [Ntop.cpp:873] Adding fe80::1/64 as IPv6 local network for lo0
01/May/2020 08:17:45 [Ntop.cpp:832] Adding 127.0.0.1/32 as IPv4 interface address for lo0
01/May/2020 08:17:45 [Ntop.cpp:841] Adding 127.0.0.0/8 as IPv4 local network for lo0
01/May/2020 08:17:45 [Ntop.cpp:863] Adding xx/128 as IPv6 interface address for ovpns1
01/May/2020 08:17:45 [Ntop.cpp:873] Adding xx/64 as IPv6 local network for ovpns1
01/May/2020 08:17:45 [Ntop.cpp:832] Adding 192.168.2.1/32 as IPv4 interface address for ovpns1
01/May/2020 08:17:45 [Ntop.cpp:841] Adding 192.168.2.1/32 as IPv4 local network for ovpns1
01/May/2020 08:17:45 [PeriodicActivities.cpp:105] Started periodic activities loop...
01/May/2020 08:17:51 [PeriodicActivities.cpp:165] Each periodic activity script will use 5 threads
01/May/2020 08:17:51 [NetworkInterface.cpp:2343] Started packet polling on interface re0 [id: 1]...
01/May/2020 08:17:51 [NetworkInterface.cpp:2343] Started packet polling on interface re1 [id: 2]...
01/May/2020 08:17:51 [NetworkInterface.cpp:2343] Started packet polling on interface lo0 [id: 3]...
01/May/2020 08:17:51 [NetworkInterface.cpp:2343] Started packet polling on interface ovpns1 [id: 4]...
mkc@firewall:/var/db/ntopng %

Any help greatly appreciated! Any way to run a service status watcher like in pfsense?

[firewall]

Unfortunately I don't have a solution for you but I can empathize. I gave up on it recently after experiencing the same problem for over a year. It's a pretty cool plugin but not worth the headache.

[mimugmail]

What happens when you listen to only one interface?

[firewall]

@mimugmail it still dies after some time.  i've tried listening on LAN & WAN individually with same result.

[mimugmail]

Hm, I have customers running it for weeks without a problem.
With the next release we get some fresh update to v4, also killing the CPU problem

[firewall]

great, looking forward to giving it another try!