updating to 20.7.3 stopped at "reloading template wireguard"

[Scooter]

Hi all,

Just updating the work firewall. Did the home unit no issues and the satellite site no issues. When I did the main site it's stopped and the last log entry is

"Reloading template OPNsense/Wireguard: OK"

now it's just sitting there. It says updating please wait.
its working at the moment and everything is fine, it just hasn't finished updating.
I'll have people in that office soon, my plan is wait until the end of the working day and reboot.

Any advice would be welcome

[franco]

Hi Scooter,

Did it reboot at some point? What does the dashboard version string say?


Cheers,
Franco

[mimugmail]

I had the same on a test  machine when downgrading zabbix from 5 to 4 for debugging purpose, it stalled at the template point but everything was running fine (except the pkg process which hung)

[XeroX]

Same for me, stuck at:

Code: [Select]

Reloading template OPNsense/Quagga: OK
EDIT: Reboot and running the updated solved the problem. No issues.

[Scooter]

I rebooted sunday (safe noone was using it)
it rebooted fine, but i had to redo the update.

now all seems fine.

[pkernstock]

I was updating from 20.1 to 20.7.3 today and was experiencing the exact same behavior:

[59/69] Upgrading php73-opcache from 7.3.20 to 7.3.22...
[59/69] Extracting php73-opcache-7.3.22: .......... done
[60/69] Upgrading os-wireguard from 1.2 to 1.3...
[60/69] Extracting os-wireguard-1.3: .......... done
Stopping configd...done
Starting configd.
Keep version OPNsense\Wireguard\General (0.0.1)
Keep version OPNsense\Wireguard\Server (0.0.2)
Migrated OPNsense\Wireguard\Client from 0.0.4 to 0.0.5
Reloading plugin configuration
Configuring system logging...done.
Reloading template OPNsense/Wireguard: OK

At this point, it was stuck. After reboot however I was able to update the missing 9 packages just fine.

[falk]

I had something like that,
It stopped after
```
Stopping configd...done
```

But after a "reboot" and an upgrade thru ssh(console) things got done

--
Regards Falk

[mimugmail]

It seems to be related to the pkg update from 1.12 to 1.15 which stucks somewhere.

[rygel_fievel]

I tried updating from latest 20.1.x to 20.7.0 last night to a remote site and got a call this morning that Internet is not up and running.  I did the same with my setup at a few days before to 20.7.0 -> 20.7.2 and figure it was safe before doing the remote site.

Now I find this thread after I decided to update a brand new image and just restore the config.  After a brand new image of 20.7.0, I did upgrade from console and got stuck

Code: [Select]

[43/44] Extracting os-dyndns-1.23: .......... done
Stopping configd...done
Starting configd.
Reloading plugin configuration
Configuring system logging...done.

So I did a CTRL-C and it brought me back to console.  So I try to upgrade again from shell and got this:

Code: [Select]

process with pid 2754 still holds the lock
process with pid 2754 still holds the lock
process with pid 2754 still holds the lock
process with pid 2754 still holds the lock
process with pid 2754 still holds the lock
process with pid 2754 still holds the lock
pkg-static: Cannot get an advisory lock on a database, it is locked by another process
A firmware update is currently in progress.

After it brings me back to console I try the the shell trick:

Code: [Select]

Enter an option: 8

root@OPNsense:~ # service syslog-ng restart
Stopping syslog_ng.
Waiting for PIDS: 35974.
Starting syslog_ng.
[44/44] Upgrading opnsense from 20.7 to 20.7.3...
root@OPNsense:~ # [44/44] Extracting opnsense-20.7.3: .......... done
Stopping configd...done
Resetting root shell
Updating /etc/shells
Unhooking from /etc/rc
Unhooking from /etc/rc.shutdown
Updating /etc/shells
Registering root shell
Hooking into /etc/rc
Hooking into /etc/rc.shutdown
Starting configd.
Keep version OPNsense\Backup\NextcloudSettings (1.0.0)
Keep version OPNsense\CaptivePortal\CaptivePortal (1.0.0)
Keep version OPNsense\Cron\Cron (1.0.1)
Keep version OPNsense\Diagnostics\Netflow (1.0.1)
Keep version OPNsense\Firewall\Alias (1.0.0)
Keep version OPNsense\IDS\IDS (1.0.5)
Keep version OPNsense\IPsec\IPsec (0.0.0)
Migrated OPNsense\Interfaces\VxLan from 0.0.0 to 1.0.1
Migrated OPNsense\Interfaces\Loopback from 0.0.0 to 1.0.0
Keep version OPNsense\Monit\Monit (1.0.8)
Keep version OPNsense\OpenVPN\Export (0.0.1)
Keep version OPNsense\Proxy\Proxy (1.0.3)
Migrated OPNsense\Routes\Route from 0.0.0 to 1.0.0
Keep version OPNsense\Syslog\Syslog (1.0.0)
Keep version OPNsense\TrafficShaper\TrafficShaper (1.0.3)
Keep version OPNsense\Unboundplus\Miscellaneous (0.0.2)
Keep version OPNsense\Unboundplus\Dnsbl (0.0.1)
Writing firmware setting...done.
Writing trust files...done.
Configuring login behaviour...done.
Configuring system logging...done.
=====
Message from py37-urllib3-1.25.10,1:

--
Since version 1.25 HTTPS connections are now verified by default which is done
via "cert_reqs = 'CERT_REQUIRED'".  While certificate verification can be
disabled via "cert_reqs = 'CERT_NONE'", it's highly recommended to leave it on.

Various consumers of net/py-urllib3 already have implemented routines that
either explicitly enable or disable HTTPS certificate verification (e.g. via
configuration settings, CLI arguments, etc.).

Yet it may happen that there are still some consumers which don't explicitly
enable/disable certificate verification for HTTPS connections which could then
lead to errors (as is often the case with self-signed certificates).

In case of an error one should try first to temporarily disable certificate
verification of the problematic urllib3 consumer to see if that approach will
remedy the issue.
=====
Message from opnsense-20.7.3:

--
The lion sleeps tonight

root@OPNsense:~ # exit

So it looks like it continues and finishes.  It does say 20.7.3 afterwards but no indication that it is going to boot or needs a reboot.  So I try the upgrade again and now it appears to be starting over but this time it completes without actually doing anything and proceeds to reboot

Code: [Select]

Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
Checking for upgrades (60 candidates): .......... done
Processing candidates (60 candidates): . done
Checking integrity... done (0 conflicting)
Your packages are up to date.
Checking integrity... done (0 conflicting)
Nothing to do.
The following package files will be deleted:
        /var/cache/pkg/pkg-1.15.6-5457c2d69b.txz
        /var/cache/pkg/unbound-1.11.0.txz
        /var/cache/pkg/pkg-1.15.6.txz
        /var/cache/pkg/unbound-1.11.0~ab09f69c09.txz
        /var/cache/pkg/syslog-ng327-3.27.1_2~1ad11b98f9.txz
        /var/cache/pkg/squid-4.13~21f2feca67.txz
        /var/cache/pkg/syslog-ng327-3.27.1_2.txz
        /var/cache/pkg/rrdtool-1.7.2_4.txz
        /var/cache/pkg/squid-4.13.txz
        /var/cache/pkg/sqlite3-3.33.0,1~db80df7f62.txz
        /var/cache/pkg/rate-0.9_2~be0f156945.txz
        /var/cache/pkg/sqlite3-3.33.0,1.txz
        /var/cache/pkg/rrdtool-1.7.2_4~74cbbb5144.txz
        /var/cache/pkg/py37-urllib3-1.25.10,1.txz
        /var/cache/pkg/rate-0.9_2.txz
        /var/cache/pkg/python37-3.7.9~0349942bbf.txz
        /var/cache/pkg/python37-3.7.9.txz
        /var/cache/pkg/py37-urllib3-1.25.10,1~375e46b391.txz
        /var/cache/pkg/py37-sqlite3-3.7.9_7~897bcd2ba6.txz
        /var/cache/pkg/py37-six-1.15.0~935d1cec33.txz
        /var/cache/pkg/py37-sqlite3-3.7.9_7.txz
        /var/cache/pkg/py37-cffi-1.14.3.txz
        /var/cache/pkg/py37-six-1.15.0.txz
        /var/cache/pkg/py37-cffi-1.14.3~07babc08bf.txz
        /var/cache/pkg/php73-zlib-7.3.22~e3f8120e05.txz
        /var/cache/pkg/php73-sqlite3-7.3.22.txz
        /var/cache/pkg/php73-zlib-7.3.22.txz
        /var/cache/pkg/php73-xml-7.3.22~28041d9d2a.txz
        /var/cache/pkg/php73-xml-7.3.22.txz
        /var/cache/pkg/php73-sqlite3-7.3.22~cb38bfeb75.txz
        /var/cache/pkg/php73-sockets-7.3.22~cf97767d45.txz
        /var/cache/pkg/php73-pdo-7.3.22~d885ed2567.txz
        /var/cache/pkg/php73-sockets-7.3.22.txz
        /var/cache/pkg/php73-simplexml-7.3.22~8090f07f1e.txz
        /var/cache/pkg/php73-simplexml-7.3.22.txz
        /var/cache/pkg/php73-session-7.3.22~13f2115548.txz
        /var/cache/pkg/php73-session-7.3.22.txz
        /var/cache/pkg/php73-openssl-7.3.22.txz
        /var/cache/pkg/php73-pdo-7.3.22.txz
        /var/cache/pkg/php73-openssl-7.3.22~23222d476a.txz
        /var/cache/pkg/php73-dom-7.3.22~1673443386.txz
        /var/cache/pkg/php73-ldap-7.3.22~bc625fd252.txz
        /var/cache/pkg/php73-ldap-7.3.22.txz
        /var/cache/pkg/php73-json-7.3.22~85776048d5.txz
        /var/cache/pkg/php73-json-7.3.22.txz
        /var/cache/pkg/php73-hash-7.3.22~54181f600c.txz
        /var/cache/pkg/php73-hash-7.3.22.txz
        /var/cache/pkg/php73-gettext-7.3.22~e9f5f6bdb2.txz
        /var/cache/pkg/php73-gettext-7.3.22.txz
        /var/cache/pkg/php73-filter-7.3.22~ebe1ce9271.txz
        /var/cache/pkg/php73-filter-7.3.22.txz
        /var/cache/pkg/php73-dom-7.3.22.txz
        /var/cache/pkg/php73-curl-7.3.22~36dc4ffb6b.txz
        /var/cache/pkg/php73-ctype-7.3.22~b9f77945fa.txz
        /var/cache/pkg/php73-curl-7.3.22.txz
        /var/cache/pkg/php73-7.3.22~6820b9e298.txz
        /var/cache/pkg/php73-ctype-7.3.22.txz
        /var/cache/pkg/php73-7.3.22.txz
        /var/cache/pkg/perl5-5.32.0~4342008c40.txz
        /var/cache/pkg/perl5-5.32.0.txz
        /var/cache/pkg/os-dyndns-1.23~620a60b0bf.txz
        /var/cache/pkg/os-dyndns-1.23.txz
        /var/cache/pkg/opnsense-update-20.7.3~5c594cd5e9.txz
        /var/cache/pkg/opnsense-20.7.3~974da3e0a0.txz
        /var/cache/pkg/opnsense-update-20.7.3.txz
        /var/cache/pkg/opnsense-20.7.3.txz
        /var/cache/pkg/openldap-sasl-client-2.4.51~bc9d6fb838.txz
        /var/cache/pkg/ntp-4.2.8p15~670cafefb1.txz
        /var/cache/pkg/openldap-sasl-client-2.4.51.txz
        /var/cache/pkg/nss-3.57~af91bd1182.txz
        /var/cache/pkg/ntp-4.2.8p15.txz
        /var/cache/pkg/nss-3.57.txz
        /var/cache/pkg/nspr-4.29~eda6aa6ac3.txz
        /var/cache/pkg/nspr-4.29.txz
        /var/cache/pkg/mpd5-5.9~760378618a.txz
        /var/cache/pkg/mpd5-5.9.txz
        /var/cache/pkg/libffi-3.3_1~49b953d00b.txz
        /var/cache/pkg/libffi-3.3_1.txz
        /var/cache/pkg/json-c-0.15~0283a80580.txz
        /var/cache/pkg/json-c-0.15.txz
        /var/cache/pkg/isc-dhcp44-server-4.4.2_1~1d10fa7f54.txz
        /var/cache/pkg/isc-dhcp44-server-4.4.2_1.txz
        /var/cache/pkg/isc-dhcp44-relay-4.4.2_1~adade75c88.txz
        /var/cache/pkg/gettext-runtime-0.21~28fefd2893.txz
        /var/cache/pkg/isc-dhcp44-relay-4.4.2_1.txz
        /var/cache/pkg/curl-7.72.0~e401be138c.txz
        /var/cache/pkg/gettext-runtime-0.21.txz
        /var/cache/pkg/curl-7.72.0.txz
        /var/cache/pkg/ca_root_nss-3.57~df7fc72e32.txz
        /var/cache/pkg/ca_root_nss-3.57.txz
The cleanup will free 57 MiB
Deleting files: .......... done
All done
Starting web GUI...done.
Generating RRD graphs...done.
Fetching base-20.7.3-amd64.txz: ....................................................... done
Fetching kernel-20.7.3-amd64.txz: .................. done
!!!!!!!!!!!! ATTENTION !!!!!!!!!!!!!!!
! A critical upgrade is in progress. !
! Please do not turn off the system. !
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Installing kernel-20.7.3-amd64.txz... done
Installing base-20.7.3-amd64.txz... done
Please reboot.
>>> Invoking stop script 'beep'
>>> Invoking stop script 'freebsd'
>>> Invoking stop script 'backup'
>>> Invoking backup script 'captiveportal'
>>> Invoking backup script 'dhcpleases'


After I get back in console and try the upgrade again, it says nothing to do and brings me back.  So I think I'll hold off on 20.7.3 on my own firewall and wait for the next upgrade.

[rhaker]

I had exactly the same. 2.7.0 -> 2.7.3

Reboot from SSH and after that update from SSH. No issues now so far I can tell.