21.1.7: Updates tab is hanging

[opn_nwo]

After upgrading to 21.1.7 I noticed that the Updates tab under System, Firmware is hanging and not displaying anything every time I check for updates, run an audit or install a plugin.

[iam]

I can confirm the issue. I've also notice that output of upgrade was stopping during the upgrade.

[fields987]

I had the same issue. After I cleared the cache in my web browser (edge 91) this started working again

[opn_nwo]

I had the same issue. After I cleared the cache in my web browser (edge 91) this started working again

Thanks, that did it!

[human_usb]

Yep, same issue. No matter how I clean my cache things will not display correct in health audit, Update, etc.

**EDIT**

Going to try a full on chrome cache nuke.

** EDIT 2 **

That did it. Lame, but it fixed it.

[franco]

It seems to enjoy caching the empty backend response from the poller. So it likely works but the browser looks the other way and the page never gets updated in the process.


Cheers,
Franco

[tessus]

IMO there's a bug in the cache invalidation algorithm.

This is one of the most complicated things in API development. It also is not that easy with web app development it seems.

It should not be necessary to clear the browser's cache after any web app update. Otherwise you have to wipe your cache pretty often, which is contrary to the purpose of a cache.

[franco]

Er, yes, obviously? I'm not sure how this is helpful.


Cheers,
Franco

[ArminF]

had to clear cache as well.

Used this as it will only clear cache for specific sites.
https://pitdesigns.com/how-to-clear-chrome-cache-for-specific-website-only-3-steps/

[senser]

***GOT REQUEST TO UPDATE***
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
Checking for upgrades (19 candidates): .......... done
Processing candidates (19 candidates): .......... done
The following 23 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
   oniguruma: 6.9.7.1
   php73-mbstring: 7.3.28
   php73-pecl-psr: 1.1.0
   php73-phalcon4: 4.1.2

Installed packages to be UPGRADED:
   curl: 7.76.1 -> 7.77.0
   glib: 2.66.7_1,1 -> 2.66.8,2
   isc-dhcp44-relay: 4.4.2_1 -> 4.4.2P1
   isc-dhcp44-server: 4.4.2_1 -> 4.4.2P1_1
   nspr: 4.30 -> 4.31
   nss: 3.65 -> 3.66
   openldap-sasl-client: 2.4.58 -> 2.4.59
   opnsense: 21.1.6 -> 21.1.7
   opnsense-lang: 20.1.4 -> 21.1.7
   opnsense-update: 21.1.6 -> 21.1.7
   pcre2: 10.36 -> 10.37
   py37-certifi: 2020.12.5 -> 2021.5.30
   py37-chardet: 3.0.4_3,1 -> 4.0.0,1
   py37-setuptools: 44.0.0_1 -> 57.0.0
   py37-ujson: 3.0.0 -> 4.0.2
   py37-yaml: 5.3.1_1 -> 5.4.1
   squid: 4.14 -> 4.15
   strongswan: 5.9.2_1 -> 5.9.2_2

Installed packages to be REINSTALLED:
   os-theme-tukan-1.25 (ABI changed: 'freebsd:12:x86:64' -> 'freebsd:*:*')

Number of packages to be installed: 4
Number of packages to be upgraded: 18
Number of packages to be reinstalled: 1

The process will require 17 MiB more space.
24 MiB to be downloaded.
[1/23] Fetching strongswan-5.9.2_2.txz: .......... done
[2/23] Fetching squid-4.15.txz: .......... done
[3/23] Fetching py37-yaml-5.4.1.txz: .......... done
[4/23] Fetching py37-ujson-4.0.2.txz: ...... done
[5/23] Fetching py37-setuptools-57.0.0.txz: .......... done
[6/23] Fetching py37-chardet-4.0.0,1.txz: .......... done
[7/23] Fetching py37-certifi-2021.5.30.txz: .......... done
[8/23] Fetching pcre2-10.37.txz: .......... done
[9/23] Fetching os-theme-tukan-1.25.txz: .......... done
[10/23] Fetching opnsense-update-21.1.7.txz: ........ done
[11/23] Fetching opnsense-lang-21.1.7.txz: .......... done
[12/23] Fetching opnsense-21.1.7.txz: .......... done
[13/23] Fetching openldap-sasl-client-2.4.59.txz: .......... done
[14/23] Fetching nss-3.66.txz: .......... done
[15/23] Fetching nspr-4.31.txz: .......... done
[16/23] Fetching isc-dhcp44-server-4.4.2P1_1.txz: .......... done
[17/23] Fetching isc-dhcp44-relay-4.4.2P1.txz: .......... done
[18/23] Fetching glib-2.66.8,2.txz: .......... done
[19/23] Fetching curl-7.77.0.txz: .......... done
[20/23] Fetching php73-phalcon4-4.1.2.txz: .......... done
[21/23] Fetching php73-pecl-psr-1.1.0.txz: .. done
[22/23] Fetching php73-mbstring-7.3.28.txz: .......... done
[23/23] Fetching oniguruma-6.9.7.1.txz: .......... done
Checking integrity... done (1 conflicting)
  - php73-phalcon4-4.1.2 conflicts with php73-phalcon-3.4.5 on /usr/local/etc/php/ext-30-phalcon.ini
Checking integrity... done (0 conflicting)
Conflicts with the existing packages have been found.
One more solver iteration is needed to resolve them.
The following 24 package(s) will be affected (of 0 checked):

Installed packages to be REMOVED:
   php73-phalcon: 3.4.5

New packages to be INSTALLED:
   oniguruma: 6.9.7.1
   php73-mbstring: 7.3.28
   php73-pecl-psr: 1.1.0
   php73-phalcon4: 4.1.2

Installed packages to be UPGRADED:
   curl: 7.76.1 -> 7.77.0
   glib: 2.66.7_1,1 -> 2.66.8,2
   isc-dhcp44-relay: 4.4.2_1 -> 4.4.2P1
   isc-dhcp44-server: 4.4.2_1 -> 4.4.2P1_1
   nspr: 4.30 -> 4.31
   nss: 3.65 -> 3.66
   openldap-sasl-client: 2.4.58 -> 2.4.59
   opnsense: 21.1.6 -> 21.1.7
   opnsense-lang: 20.1.4 -> 21.1.7
   opnsense-update: 21.1.6 -> 21.1.7
   pcre2: 10.36 -> 10.37
   py37-certifi: 2020.12.5 -> 2021.5.30
   py37-chardet: 3.0.4_3,1 -> 4.0.0,1
   py37-setuptools: 44.0.0_1 -> 57.0.0
   py37-ujson: 3.0.0 -> 4.0.2
   py37-yaml: 5.3.1_1 -> 5.4.1
   squid: 4.14 -> 4.15
   strongswan: 5.9.2_1 -> 5.9.2_2

Installed packages to be REINSTALLED:
   os-theme-tukan-1.25 (ABI changed: 'freebsd:12:x86:64' -> 'freebsd:*:*')

Number of packages to be removed: 1
Number of packages to be installed: 4
Number of packages to be upgraded: 18
Number of packages to be reinstalled: 1

The process will require 10 MiB more space.
[1/24] Upgrading py37-setuptools from 44.0.0_1 to 57.0.0...
[1/24] Extracting py37-setuptools-57.0.0: .......... done
[2/24] Upgrading openldap-sasl-client from 2.4.58 to 2.4.59...
[2/24] Extracting openldap-sasl-client-2.4.59: .......... done
[3/24] Upgrading strongswan from 5.9.2_1 to 5.9.2_2...
[3/24] Extracting strongswan-5.9.2_2: .......... done
[4/24] Upgrading squid from 4.14 to 4.15...
===> Creating groups.
Using existing group 'squid'.
===> Creating users
Using existing user 'squid'.
===> Creating homedir(s)
===> Pre-installation configuration for squid-4.15
[4/24] Extracting squid-4.15: .......... done
[5/24] Upgrading py37-ujson from 3.0.0 to 4.0.2...
[5/24] Extracting py37-ujson-4.0.2: ......... done
[6/24] Upgrading opnsense-update from 21.1.6 to 21.1.7...
[6/24] Extracting opnsense-update-21.1.7: .......... done
[7/24] Upgrading opnsense-lang from 20.1.4 to 21.1.7...
[7/24] Extracting opnsense-lang-21.1.7: .......... done
[8/24] Upgrading isc-dhcp44-server from 4.4.2_1 to 4.4.2P1_1...
===> Creating groups.
Using existing group 'dhcpd'.
===> Creating users
Using existing user 'dhcpd'.
[8/24] Extracting isc-dhcp44-server-4.4.2P1_1: .......... done
[9/24] Upgrading isc-dhcp44-relay from 4.4.2_1 to 4.4.2P1...
[9/24] Extracting isc-dhcp44-relay-4.4.2P1: ....... done
[10/24] Deinstalling php73-phalcon-3.4.5...
[10/24] Deleting files for php73-phalcon-3.4.5: ........ done
[11/24] Installing oniguruma-6.9.7.1...
[11/24] Extracting oniguruma-6.9.7.1: .......... done
[12/24] Upgrading nspr from 4.30 to 4.31...
[12/24] Extracting nspr-4.31: .......... done
[13/24] Installing php73-pecl-psr-1.1.0...
[13/24] Extracting php73-pecl-psr-1.1.0: .......... done
[14/24] Installing php73-mbstring-7.3.28...
[14/24] Extracting php73-mbstring-7.3.28: .......... done
[15/24] Installing php73-phalcon4-4.1.2...
[15/24] Extracting php73-phalcon4-4.1.2: ........ done
[16/24] Upgrading pcre2 from 10.36 to 10.37...
[16/24] Extracting pcre2-10.37: .......... done
[17/24] Upgrading py37-certifi from 2020.12.5 to 2021.5.30...
[17/24] Extracting py37-certifi-2021.5.30: .......... done
[18/24] Upgrading py37-yaml from 5.3.1_1 to 5.4.1...
[18/24] Extracting py37-yaml-5.4.1: .......... done
[19/24] Upgrading py37-chardet from 3.0.4_3,1 to 4.0.0,1...
[19/24] Extracting py37-chardet-4.0.0,1: .......... done
[20/24] Upgrading nss from 3.65 to 3.66...
[20/24] Extracting nss-3.66: .......... done
[21/24] Upgrading glib from 2.66.7_1,1 to 2.66.8,2...
[21/24] Extracting glib-2.66.8,2: .......... done
No schema files found: doing nothing.
[22/24] Upgrading curl from 7.76.1 to 7.77.0...
[22/24] Extracting curl-7.77.0: .......... done
[23/24] Reinstalling os-theme-tukan-1.25...
[23/24] Extracting os-theme-tukan-1.25: .......... done
[24/24] Upgrading opnsense from 21.1.6 to 21.1.7...
[24/24] Extracting opnsense-21.1.7: .......... done
Stopping configd...done
Resetting root shell
Updating /etc/shells
Unhooking from /etc/rc
Unhooking from /etc/rc.shutdown
Updating /etc/shells
Registering root shell
Hooking into /etc/rc
Hooking into /etc/rc.shutdown
Starting configd.
>>> Invoking update script 'refresh'
Keep version OPNsense\Monit\Monit (1.0.9)
Keep version OPNsense\Firewall\Alias (1.0.0)
Keep version OPNsense\Firewall\Category (1.0.0)
Keep version OPNsense\OpenVPN\Export (0.0.1)
Keep version OPNsense\CaptivePortal\CaptivePortal (1.0.0)
Keep version OPNsense\Core\Firmware (1.0.0)
Keep version OPNsense\Interfaces\Loopback (1.0.0)
Keep version OPNsense\Interfaces\VxLan (1.0.1)
Keep version OPNsense\Unboundplus\Dnsbl (0.0.1)
Keep version OPNsense\Unboundplus\Miscellaneous (0.0.2)
Keep version OPNsense\Cron\Cron (1.0.2)
Keep version OPNsense\IPsec\IPsec (1.0.0)
Keep version OPNsense\Backup\NextcloudSettings (1.0.0)
Keep version OPNsense\TrafficShaper\TrafficShaper (1.0.3)

Now the update output is hanging at that point...

Update
While the update output hang, the apu2 got rebooted ....so its all good i guess.

[gpb]

Just to confirm, my update output hung also, but at a different point.  The last line in mine was "[34/35] Extracting opnsense-21.1.7: ........", then nothing.  I opened a ping window on my desktop and saw pings eventually failed to opnsense (rebooting) and then they returned.  I had to refresh the browser to get back to the login screen.

[tessus]

Er, yes, obviously? I'm not sure how this is helpful.

Nobody confirmed this as a bug, which was the reason for my comment.

[franco]

Because everyone involved said the browser did cache it and clearing the cache worked.

There might be a problem with the latest Phalcon version which basically was the only change involved, but it is too early to tell.


Cheers,
Franco

[puldi]

Just to confirm that firefox behaves the same way as chrome (didn't see any mention of FF yet). While upgrading from 21.1.6-amd64 to 21.1.7_1-amd64 the output stopped while unpacking firmware. After a while I reloaded the page an got login page as opnsense meanwhile finished upgrade and rebooted.

As far as I can tell all pages display correctly except for upgrade and security check, which I tested. Even forced reload of the tab didn't work (<ctrl><shift><r>) and standard reload of course neither. After clearing the cache everything was fine again. I can search for updates and run security check again.

[Samplex]

Had the same issue, after clearing the cache the update tab works again.