Messages

1

24.7 Production Series / 24.7.x Unbound does not start automaticaly

« on: September 13, 2024, 05:42:50 pm »

Hi All,
After I had upgraded to 24.7.x train Unbound is not starting automatically after reboot. It does start manualy and has no issue running.
This is what I have in the log post reboot:

2024-09-12T16:44:06-04:00   Error   opnsense   /usr/local/sbin/pluginctl: The command '/bin/kill -'TERM' '15616''(pid:/var/run/unbound.pid) returned exit code '1', the output was 'kill: 15616: No such process'   
2024-09-12T16:44:02-04:00   Error   opnsense   /usr/local/etc/rc.newwanip: The command '/bin/kill -'TERM' '15616''(pid:/var/run/unbound.pid) returned exit code '1', the output was 'kill: 15616: No such process'   
2024-09-12T16:44:02-04:00   Notice   opnsense   /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : unbound_configure_do(,opt1))   
2024-09-12T16:44:02-04:00   Notice   opnsense   /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : unbound_configure_do(,opt2))   
2024-09-12T16:43:58-04:00   Notice   kernel   <118>Starting Unbound DNS...done.   
2024-09-12T16:43:50-04:00   Notice   opnsense   /usr/local/etc/rc.bootup: plugins_configure bootup (execute task : unbound_configure_do(1))   
2024-09-12T16:43:47-04:00   Notice   kernel   <118>Starting Unbound DNS...done.   
2024-09-12T16:43:36-04:00   Notice   opnsense   /usr/local/etc/rc.bootup: plugins_configure dns (execute task : unbound_configure_do(1))   
2024-09-12T16:43:33-04:00   Notice   opnsense   /usr/local/etc/rc.bootup: plugins_configure early (execute task : unbound_cache_flush(1))   
2024-09-02T14:25:20-04:00   Error   opnsense   /usr/local/sbin/pluginctl: The command '/bin/kill -'TERM' '97640''(pid:/var/run/unbound.pid) returned exit code '1', the output was 'kill: 97640: No such process'

2

23.7 Legacy Series / Re: Best way to increase swap

« on: December 21, 2023, 08:15:11 pm »

Thank you for talking me off the ledge ... efforts would be better applied figuring out why ntopng is crashing. 

3

23.7 Legacy Series / Re: Best way to increase swap

« on: December 21, 2023, 05:11:54 pm »

I am trying to avoid swap, but also need to keep services running untill I can figure out why I am getting memory spikes from ntopng

swap_pager: out of swap space
swp_pager_getswapspace(3): failed
pid 72730 (ntopng), jid 0, uid 288, was killed: a thread waited too long to allocate a page
pid 42341 (python3.9), jid 0, uid 0, was killed: failed to reclaim memory
swap_pager: out of swap space
swp_pager_getswapspace(: failed

When this happens ntopng and unbound exit.

4

23.7 Legacy Series / Best way to increase swap

« on: December 21, 2023, 04:20:53 pm »

Hi All,
Looking for guidance on best way to increase swap size (getting out of swap notices while running ntopng and Unbound ) Should I get bigger swap partition or add a swap file? Currently 16G RAM 8G swap, planning to go to 32G of swap.
I am surprised that in settings the only option is to add 2G swap file

5

General Discussion / Upgrade dilemma - stay with i5 Dell or switch to J4105 minipc

« on: December 20, 2023, 08:34:42 pm »

Hi All,
I am running Opensense on Dell OptiPlex 990 Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores, 4 threads) 16GB with Intel I225 Chipset (2.5G) on WAN side and INTEL I350T4 1GbE Quad Port Ethernet Server on LANs side.
HD is starting to show some errors so it is time to replace.

The question is should I just get SSD 512G drive and call it good or switch to something like "Qotom Q730G5-S08 Latest New J4105 2.5G 5*LAN Firewall Router,Support DDR4,16G RAM 512G SSD" (not sure if Amazon links are allowed)
I am using NtopNG and UnboundDNS in addition to standard FW.

6

Tutorials and FAQs / How to access Hitron CODA56 modem admin page

« on: December 20, 2023, 06:38:12 pm »

Finaly got Hitron CODA56  admin/stats page working from behind Opensense.

Modem only responds to https://192.168.100.1/home/html from the same network.

Solution:
Create virtual IP on the interface facing the modem.
Create Outgoing NAT to the Modem
Create LAN allow rule - it is critical not to specify gateway in the rule

7

23.7 Legacy Series / ntopng-enterprise starts consuming memory and dies

« on: December 20, 2023, 05:35:42 pm »

Hi all,
I am running ntopng Community v.6.1.231220 (FreeBSD 13.1) and seeing the following behavior:
ntopng starts, runs for a while but all of a sudden starts consuming memory until it quietly dies.

There is nothing substantial in the log:
20/Dec/2023 10:06:59 [main.cpp:442] Logging onto /var/db/ntopng-enterprise/ntopng.log
20/Dec/2023 10:06:59 [main.cpp:445] Working directory: /var/db/ntopng-enterprise
20/Dec/2023 10:06:59 [main.cpp:447] Scripts/HTML pages directory: /usr/local/share/ntopng
20/Dec/2023 10:06:59 [Ntop.cpp:536] Welcome to ntopng amd64 v.6.1.231220 (dev:501ebba24850504d76848d65e033d45dc3b05238:20231220)
20/Dec/2023 10:06:59 [Ntop.cpp:545] Built on FreeBSD 13.1
20/Dec/2023 10:06:59 [Ntop.cpp:547] (C) 1998-23 ntop
20/Dec/2023 10:06:59 [Ntop.cpp:1028] Adding 192.168.1.1/32 as IPv4 interface address for bge3
20/Dec/2023 10:06:59 [Ntop.cpp:1039] Adding 192.168.1.0/24 as IPv4 local network for bge3
20/Dec/2023 10:06:59 [Ntop.cpp:1028] Adding reducted as IPv4 interface address for igc0
20/Dec/2023 10:06:59 [Ntop.cpp:1039] Adding reducted as IPv4 local network for igc0
20/Dec/2023 10:06:59 [Ntop.cpp:1028] Adding 192.168.100.100/32 as IPv4 interface address for igc0
20/Dec/2023 10:06:59 [Ntop.cpp:1039] Adding 192.168.100.0/23 as IPv4 local network for igc0
20/Dec/2023 10:06:59 [PeriodicActivities.cpp:108] Started periodic activities loop...
20/Dec/2023 10:07:00 [startup.lua:38] Processing startup.lua: please hold on...
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:835] Refreshing category lists...
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'ip' category '100' in list 'Stratosphere Lab'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host '56565' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'noluyoruzawk' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host '4040' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'datacikerim' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'nicehash' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'mpapwpodllalw' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'makelovenotmalware.local' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'lwwfechxdr8aiq0bbhtrxry7i1c8itnz' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:467] Failure loading host 'ddkkba0zqra9dtqunixbqaa8olgtkc5j' category '100' in list 'ThreatFox'
20/Dec/2023 10:07:00 [startup.lua:121] [lists_utils.lua:756] Category Lists (31657 hosts, 11233 IPs, 0 JA3) loaded in 0 sec
20/Dec/2023 10:07:00 [startup.lua:125] Initializing device polices...
20/Dec/2023 10:07:00 [startup.lua:141] Initializing alerts...
20/Dec/2023 10:07:00 [startup.lua:150] Initializing timeseries...
20/Dec/2023 10:07:00 [startup.lua:217] [blog_utils.lua:125] Fetching latest ntop blog posts...
20/Dec/2023 10:07:01 [startup.lua:245] Completed startup.lua
20/Dec/2023 10:07:01 [PeriodicActivities.cpp:167] Found 10 activities
20/Dec/2023 10:07:01 [NetworkInterface.cpp:3720] Started packet polling on interface WAN (opt1) [id: 1]...
20/Dec/2023 10:07:01 [NetworkInterface.cpp:3720] Started packet polling on interface LAN (lan) [id: 4]...
20/Dec/2023 10:15:13 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 10:16:26 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 10:30:17 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 10:31:17 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 10:45:37 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 10:45:37 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 11:00:05 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 11:01:43 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 11:15:14 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 11:16:11 [local_network_checks.lua:36] [recipients.lua:955] ERROR: Failure encoding notification
20/Dec/2023 11:16:54 [Ntop.cpp:729] Houkeeping activities (main loop) took 6.726s

Had anyone seen that as well?

8

23.7 Legacy Series / Re: Strange stats discreptancy between WAN and LAN

« on: December 15, 2023, 07:26:06 pm »

Turned out to be self-inflicted: I had misconfigured bandwidth testing on Opensence and it was running every 5 min ...

9

23.7 Legacy Series / Strange stats discreptancy between WAN and LAN

« on: December 14, 2023, 05:09:21 pm »

Hi All,
I am straggling to explain this huge difference in in/out between WAN and LAN interfaces:

WAN:
In/out packets   78631985 / 70208427 (87.26 GB / 17.27 GB)
In/out packets (pass)   78455868 / 70208424 (87.25 GB / 17.27 GB)
In/out packets (block)   10740231 / 3 (172 KB / 120 bytes)

LAN:
In/out packets   18196848 / 26080168 (3.82 GB / 17.57 GB)
In/out packets (pass)   18190017 / 26080167 (3.82 GB / 17.57 GB)
In/out packets (block)   1788262 / 1 (7 KB / 40 bytes)


I am running OPNsense 23.7.10_1-amd64

10

General Discussion / Re: Can not access ntopng admin page

« on: December 06, 2023, 11:09:12 pm »

{SOLVED} for me .... embarrassed to say - I had forgotten to put allow rule for port 3000 on FW
I am having the same issue - all services are green but can not access port 3000
I had installed
os-ntopng (installed)   1.2_2   20.5KiB   3   OPNsense   Traffic Analysis and Flow Collection   

Should I install os-ntop-enterprise ?

11

23.7 Legacy Series / Can not start redis

« on: December 06, 2023, 10:32:49 pm »

Hi All,
I am trying to setup ntop and getting the following error on redis start:

17946:M 06 Dec 2023 21:28:44.286 # WARNING: The TCP backlog setting of 511 cannot be enforced because kern.ipc.somaxconn is set to the lower value of 128.
17946:M 06 Dec 2023 21:28:44.286 # Warning: Could not create server TCP listening socket dhcp:6379: Name does not resolve
17946:M 06 Dec 2023 21:28:44.287 # Failed listening on port 6379 (tcp), aborting.

I am running

OPNsense 23.7.9-amd64
FreeBSD 13.2-RELEASE-p5
OpenSSL 1.1.1w

12

23.7 Legacy Series / speedtest cli not running from cron

« on: November 27, 2023, 11:24:24 pm »

Hi All,
Attempting to run speedtest plugin from cron but getting the following error:

Script action failed with Command '/usr/local/bin/python3 /usr/local/opnsense/scripts/OPNsense/speedtest/opn_speedtest.py stat ' returned non-zero exit status 1. at Traceback (most recent call last): File "/usr/local/opnsense/service/modules/actions/script_output.py", line 44, in execute subprocess.check_call(script_command, env=self.config_environment, shell=True, File "/usr/local/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '/usr/local/bin/python3 /usr/local/opnsense/scripts/OPNsense/speedtest/opn_speedtest.py stat ' returned non-zero exit status 1.

I have serverid specified as a parameter in cron entry

From cli and "run test" it runs just fine:

/usr/local/bin/python3 /usr/local/opnsense/scripts/OPNsense/speedtest/opn_speedtest.py 50854
{"timestamp": "2023-11-27T21:29:42Z", "clientip": "removed", "serverid": 50854, "servername": "123NET, Grand Rapids, MI", "country": "United States", "latency": 29.52, "download": 1338.73, "upload": 40.51, "link": "https://www.speedtest.net/result/c/removed"}

I am running:

OPNsense 23.7.9-amd64
FreeBSD 13.2-RELEASE-p5
OpenSSL 1.1.1w
os-speedtest-community (installed)   0.9_4   36.7KiB   N/A   mimugmail   Speedtest

13

Tutorials and FAQs / What is the best way for iPhone USB Tethering ?

« on: January 24, 2023, 12:29:59 am »

Hi all,
I had got really tired of my cable connection to constantly be out, and need to enable iPhone tethering with OPENSense 22.7

My main issue if I can configure everything and have it be available after I reconnect the phone.
There were some discussions on pfSense that if I leave ue interface configured as a WAN interface and it is not available at reboot it will halt the boot (https://youtu.be/03_UHjKsxxI and in the comments there is way to disable scanning of ue in /etc/inc/utils.inc - not present on OPNSense).

Also is there a way to include kldload if_ipheth  and usbconfig -d 1.3 set_config 3 during boot?
-------------
SOUTION

After a bit of soul searching I had ended up with the following solution:

1. Connected SFT-1200 (travel router with mobile tethering built in - https://www.gl-inet.com/products/gl-sft1200/) to the secondary interface
2. Created gateway group according with  fail-over scenario in https://docs.opnsense.org/manual/how-tos/multiwan.html
3. when main WAN becomes unstable - connect phone to mobile router and it will get you trough apps and downs of main WAN link.