Messages

I ran both of these just in case:

Code Select Expand

pkg remove os-dyndns
pkg remove py37-markupsafe

Update ran through without error, looks like the dashboard is back! Curiously, reloading all services still has the same issue but I can dig futher in the webgui now at least!

I'm getting the same issue, I can log in but the dashboard never loads and when I try to navigate around the page view doesn't change. The firewall seems functional otherwise.

Update output:

Code Select Expand

Fetching change log information, please wait... fetch: transfer timed out
fetch: /usr/local/opnsense/changelog/changelog.txz appears to be truncated: 0/128592 bytes
done

This will automatically fetch all available updates and apply them.

Proceed with this action? [y/N]: y

Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
Checking for upgrades (13 candidates): .......... done
Processing candidates (13 candidates): . done
Checking integrity... done (0 conflicting)
The following 1 package(s) will be affected (of 0 checked):

Installed packages to be UPGRADED:
        redis: 7.2.3 -> 7.2.4 [OPNsense]

Number of packages to be upgraded: 1
[1/1] Upgrading redis from 7.2.3 to 7.2.4...
===> Creating groups.
Using existing group 'redis'.
===> Creating users
Using existing user 'redis'.
[1/1] Extracting redis-7.2.4: ......... done
You may need to manually remove /usr/local/etc/redis.conf if it is no longer needed.
Checking integrity... done (0 conflicting)
Nothing to do.
Checking all packages: .......... done
py37-markupsafe has a missing dependency: python37
py37-markupsafe has a missing dependency: py37-setuptools
py37-markupsafe is missing a required shared library: libpython3.7m.so.1.0

>>> Missing package dependencies were detected.
>>> Found 2 issue(s) in the package database.

pkg-static: No packages available to install matching 'python37' have been found in the repositories
pkg-static: No packages available to install matching 'py37-setuptools' have been found in the repositories
>>> Summary of actions performed:

python37 dependency failed to be fixed
py37-setuptools dependency failed to be fixed

>>> There are still missing dependencies.
>>> Try fixing them manually.

>>> Also make sure to check 'pkg updating' for known issues.
The following package files will be deleted:
        /var/cache/pkg/unbound-1.19.1~1e222dead0.pkg
        /var/cache/pkg/openssl-3.0.13,1.pkg
        /var/cache/pkg/unbound-1.19.1.pkg
        /var/cache/pkg/os-ntopng-1.3~29462b1d3f.pkg
        /var/cache/pkg/os-ntopng-1.3.pkg
        /var/cache/pkg/libidn2-2.3.7~e0f4062e85.pkg
        /var/cache/pkg/libidn2-2.3.7.pkg
        /var/cache/pkg/opnsense-update-24.1.2~25afe81a1f.pkg
        /var/cache/pkg/flowd-0.9.1_5~0665450ab3.pkg
        /var/cache/pkg/opnsense-update-24.1.2.pkg
        /var/cache/pkg/flowd-0.9.1_5.pkg
        /var/cache/pkg/openssl-3.0.13,1~7450192c48.pkg
        /var/cache/pkg/libuv-1.48.0~070616d698.pkg
        /var/cache/pkg/nss-3.97.pkg
        /var/cache/pkg/boost-libs-1.84.0.pkg
        /var/cache/pkg/libuv-1.48.0.pkg
        /var/cache/pkg/boost-libs-1.84.0~2f5323e297.pkg
        /var/cache/pkg/nss-3.97~b886a3f7cc.pkg
        /var/cache/pkg/py39-numpy-1.25.0_6,1~caea3330dd.pkg
        /var/cache/pkg/ldns-1.8.3_1~9ee08c2b50.pkg
        /var/cache/pkg/py39-numpy-1.25.0_6,1.pkg
        /var/cache/pkg/radvd-2.19_3~d7b5de023a.pkg
        /var/cache/pkg/ldns-1.8.3_1.pkg
        /var/cache/pkg/openvpn-2.6.9~f449de0c12.pkg
        /var/cache/pkg/openvpn-2.6.9.pkg
        /var/cache/pkg/krb5-1.21.2_3~e14442be17.pkg
        /var/cache/pkg/krb5-1.21.2_3.pkg
        /var/cache/pkg/libnghttp2-1.59.0~12cb676c6a.pkg
        /var/cache/pkg/libnghttp2-1.59.0.pkg
        /var/cache/pkg/dnsmasq-2.90,1~6a479a6940.pkg
        /var/cache/pkg/dnsmasq-2.90,1.pkg
        /var/cache/pkg/libpaper-1.1.28_1~ba27057674.pkg
        /var/cache/pkg/libpaper-1.1.28_1.pkg
        /var/cache/pkg/rrdtool-1.8.0_4~b0198116d9.pkg
        /var/cache/pkg/rrdtool-1.8.0_4.pkg
        /var/cache/pkg/php82-phalcon-5.6.1~a2424517b4.pkg
        /var/cache/pkg/php82-phalcon-5.6.1.pkg
        /var/cache/pkg/py39-tzdata-2024.1.pkg
        /var/cache/pkg/radvd-2.19_3.pkg
        /var/cache/pkg/syslog-ng-4.6.0~bb1c28f46f.pkg
        /var/cache/pkg/syslog-ng-4.6.0.pkg
        /var/cache/pkg/libpsl-0.21.5~553f85ac10.pkg
        /var/cache/pkg/ivykis-0.43.pkg
        /var/cache/pkg/libpsl-0.21.5.pkg
        /var/cache/pkg/py39-tzdata-2024.1~3491704eb3.pkg
        /var/cache/pkg/ivykis-0.43~e71e9f41a6.pkg
        /var/cache/pkg/kea-2.4.1_1~24c8a6402d.pkg
        /var/cache/pkg/pcre2-10.42_1.pkg
        /var/cache/pkg/kea-2.4.1_1.pkg
        /var/cache/pkg/libunwind-20240112~b91152021b.pkg
        /var/cache/pkg/curl-8.5.0_1~0e79993cd0.pkg
        /var/cache/pkg/libunwind-20240112.pkg
        /var/cache/pkg/pcre2-10.42_1~2a13d74440.pkg
        /var/cache/pkg/py39-pytz-2024.1,1.pkg
        /var/cache/pkg/curl-8.5.0_1.pkg
        /var/cache/pkg/py39-pytz-2024.1,1~57291c7281.pkg
        /var/cache/pkg/os-ddclient-1.21~db22d92308.pkg
        /var/cache/pkg/os-ddclient-1.21.pkg
        /var/cache/pkg/suricata-7.0.3~0677788be0.pkg
        /var/cache/pkg/suricata-7.0.3.pkg
        /var/cache/pkg/openldap26-client-2.6.7~b2a27bfe22.pkg
        /var/cache/pkg/libucl-0.9.0~ab659f473d.pkg
        /var/cache/pkg/openldap26-client-2.6.7.pkg
        /var/cache/pkg/libucl-0.9.0.pkg
        /var/cache/pkg/opnsense-24.1.2_1~e5cb000c6e.pkg
        /var/cache/pkg/squid-6.6~9eb90de2b7.pkg
        /var/cache/pkg/opnsense-24.1.2_1.pkg
        /var/cache/pkg/squid-6.6.pkg
        /var/cache/pkg/sudo-1.9.15p5_4~574ec7d982.pkg
        /var/cache/pkg/sudo-1.9.15p5_4.pkg
        /var/cache/pkg/squid-langpack-7.0.0.20231227~85e25dcf9b.pkg
        /var/cache/pkg/redis-7.2.4~e139fbebf6.pkg
        /var/cache/pkg/squid-langpack-7.0.0.20231227.pkg
        /var/cache/pkg/redis-7.2.4.pkg
The cleanup will free 57 MiB
Deleting files: .......... done
All done
Nothing to do.
Starting web GUI...done.
Generating RRD graphs...done.
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
pkg: No packages available to install matching 'os-wireguard' have been found in the repositories
Checking integrity... done (0 conflicting)
Nothing to do.


I notice the python dependancy issues, should I be trying to fix those manually?

When I try to manually restart all services it fails on ntopng due to Redis timing out, is this the cause of the gui hang? It never moves on past this point:

Code Select Expand

Writing firmware settings: FreeBSD OPNsense SunnyValley
Writing trust files...done.
Scanning /usr/share/certs/blacklisted for certificates...
Scanning /usr/share/certs/trusted for certificates...
Scanning /usr/local/share/certs for certificates...
Writing trust bundles...done.
Configuring login behaviour...done.
Configuring CRON...done.
Setting timezone: Europe/London
Setting hostname: Avanger.fenris.local
Generating /etc/resolv.conf...done.
Generating /etc/hosts...done.
Configuring loopback interface...done.
Configuring LAGG interfaces...done.
Configuring VLAN interfaces...done.
Configuring LAN interface...done.
Configuring WAN interface...done.
Configuring NordVPN interface...done.
Configuring WireGuard interface...done.
Setting up routes...done.
Setting up gateway monitors...done.
Configuring firewall.......done.
Starting DHCPv4 service...done.
Starting NTP service...done.
Configuring OpenSSH...done.
Starting web GUI...done.
Syncing OpenVPN settings...done.
Configuring WireGuard VPN...done.
Generating RRD graphs...done.
ntopng not running?
Stopping ddclient.
Waiting for PIDS: 91857.
Stopping flowd.
Waiting for PIDS: 77940 78759.
flowd_aggregate not running? (check /var/run/flowd_aggregate.pid).
Stopping monit.
Waiting for PIDS: 44696.
Stopping netdata.
redis not running? (check /var/run/redis/redis.pid).
Stopping suricata.
Waiting for PIDS: 64825.
Starting suricata.
Info: conf-yaml-loader: Including configuration file installed_rules.yaml.
Info: conf-yaml-loader: Configuration node 'rule-files' redefined.
Warning: conf-yaml-loader: Multipline "include" fields at the same level are deprecated and will not work in Suricata 8, please move to an array of include files: line: 1811
Info: conf-yaml-loader: Including configuration file custom.yaml.
Starting redis.
setup bce3
setup bce0 [egress only]
Starting netdata.
Starting monit.
Starting Monit 5.33.0 daemon with http interface at /var/run/monit.sock
Starting flowd_aggregate.
Starting flowd.
Starting ddclient.
Starting adguardhome.
Certificates generated /usr/local/share/ntopng/httpdocs/ssl/ntopng-cert.pem
Starting ntopng.
26/Feb/2024 13:31:19 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:20 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 14]
26/Feb/2024 13:31:21 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:22 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 13]
26/Feb/2024 13:31:24 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:25 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 12]
26/Feb/2024 13:31:27 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:28 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 11]
26/Feb/2024 13:31:29 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:30 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 10]
26/Feb/2024 13:31:32 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:33 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 9]
26/Feb/2024 13:31:34 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:35 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 8]
26/Feb/2024 13:31:37 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:38 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 7]
26/Feb/2024 13:31:39 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:40 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 6]
26/Feb/2024 13:31:42 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:43 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 5]
26/Feb/2024 13:31:44 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:45 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 4]
26/Feb/2024 13:31:47 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:48 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 3]
26/Feb/2024 13:31:49 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:50 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 2]
26/Feb/2024 13:31:52 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:53 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 1]
26/Feb/2024 13:31:54 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:55 [Redis.cpp:80] Redis has disconnected, reconnecting [remaining attempts: 0]
26/Feb/2024 13:31:57 [Redis.cpp:98] ERROR: Connection error [Operation timed out]
26/Feb/2024 13:31:58 [Redis.cpp:153] ERROR: ntopng requires redis server to be up and running
26/Feb/2024 13:31:58 [Redis.cpp:154] ERROR: Please start it and try again or use -r
26/Feb/2024 13:31:58 [Redis.cpp:157] ERROR: to specify a redis server other than the default
/usr/local/etc/rc.d/ntopng: WARNING: failed to start ntopng

I'm getting the same issue now. How are you doing the cron job? Is that defined in the WebUI or through cli?