Unable to upgrade from OPNsense 21.1.9_1-amd64 to 21.7

Started by allebone, July 28, 2021, 02:39:50 PM

Previous topic - Next topic
Hi there,

I have tried updating 2 times (once from the GUI and one time from the CLI after SSH into the firewall and selecting option 12).
Noth times the files are downloaded and the firewall reboots, but after some time when it has rebooted I am still on 21.1.9 and am offered the update again.

How can I view what is going wrong with the update/what logs can I check?

Pete

July 28, 2021, 02:41:11 PM #1 Last Edit: July 28, 2021, 02:42:49 PM by allebone
I also notice this if I check for updates via the GUI again:
Package name    Current version    New version    Required action    Repository
base                            21.7              21.1.8               upgrade   OPNsense
kernel                    21.7              21.1.8               upgrade   OPNsense

So some has upgraded and now wants to downgrade...?

My dashboard shows:
Versions    OPNsense 21.1.9_1-amd64
FreeBSD 12.1-RELEASE-p19-HBSD
LibreSSL 3.3.3



No, certainly affects people with third party repos and custom ports.

Please share your firmware status info and /var/cache/opnsense-update/.upgrade.log

Yep, had installed mimugmails repo, but uninstalled it after that.

here is the log and the Firmware status

root@OPNsense:~ # cat /var/cache/opnsense-update/.upgrade.log
bash-5.1.8: already unlocked
beep-1.0_1: already unlocked
ca_root_nss-3.68: already unlocked
choparp-20150613: already unlocked
clog-1.0.2: already unlocked
cpdup-1.22: already unlocked
cpustats-0.1: already unlocked
curl-7.78.0: already unlocked
cyrus-sasl-2.1.27_1: already unlocked
dhcp6c-20200512_1: already unlocked
dhcpleases-0.2: already unlocked
dnsmasq-2.85_1,1: already unlocked
dpinger-3.0: already unlocked
e2fsprogs-libuuid-1.46.2: already unlocked
expat-2.4.1: already unlocked
expiretable-0.6_2: already unlocked
filterlog-0.4_2: already unlocked
flock-2.30.1: already unlocked
flowd-0.9.1_3: already unlocked
gettext-runtime-0.21: already unlocked
glib-2.66.8,2: already unlocked
gmp-6.2.1: already unlocked
hostapd-2.9_4: already unlocked
hyperscan-5.4.0: already unlocked
icu-69.1,1: already unlocked
ifinfo-10.1: already unlocked
iftop-1.0.p4: already unlocked
indexinfo-0.3.1: already unlocked
isc-dhcp44-relay-4.4.2P1: already unlocked
isc-dhcp44-server-4.4.2P1_1: already unlocked
jansson-2.13.1: already unlocked
json-c-0.15_1: already unlocked
krb5-1.19.1: already unlocked
ldns-1.7.1_2: already unlocked
libargon2-20190702: already unlocked
libcbor-0.8.0: already unlocked
libcjson-1.7.14: already unlocked
libedit-3.1.20210216,1: already unlocked
libevent-2.1.12: already unlocked
libffi-3.3_1: already unlocked
libfido2-1.7.0: already unlocked
libiconv-1.16: already unlocked
liblz4-1.9.3,1: already unlocked
libnet-1.1.6_5,1: already unlocked
libnghttp2-1.43.0: already unlocked
libsodium-1.0.18: already unlocked
libucl-0.8.1: already unlocked
libxml2-2.9.12: already unlocked
libyaml-0.2.5: already unlocked
lighttpd-1.4.59: already unlocked
lzo2-2.10_1: already unlocked
monit-5.28.0: already unlocked
mpd5-5.9: already unlocked
mpdecimal-2.5.1: already unlocked
nettle-3.7.3: already unlocked
nspr-4.32: already unlocked
nss-3.68: already unlocked
ntp-4.2.8p15: already unlocked
oniguruma-6.9.7.1: already unlocked
openldap-sasl-client-2.4.59: already unlocked
openssh-portable-8.6.p1,1: already unlocked
openssl-1.1.1k_1,1: already unlocked
openvpn-2.5.3: already unlocked
opnsense-21.1.9_1: already unlocked
opnsense-installer-21.7: already unlocked
opnsense-lang-21.1.7: already unlocked
opnsense-update-21.1.8_1: already unlocked
os-adguardhome-maxit-1.5: already unlocked
os-dyndns-1.24_2: already unlocked
os-postfix-1.18: already unlocked
os-wireguard-1.7: already unlocked
pam_opnsense-19.1.3: already unlocked
pcre-8.44_1: already unlocked
pcre2-10.37: already unlocked
perl5-5.32.1_1: already unlocked
pftop-0.7_9: already unlocked
php74-7.4.21: already unlocked
php74-ctype-7.4.21: already unlocked
php74-curl-7.4.21: already unlocked
php74-dom-7.4.21: already unlocked
php74-filter-7.4.21: already unlocked
php74-gettext-7.4.21: already unlocked
php74-google-api-php-client-2.4.0: already unlocked
php74-json-7.4.21: already unlocked
php74-ldap-7.4.21: already unlocked
php74-mbstring-7.4.21: already unlocked
php74-openssl-7.4.21: already unlocked
php74-pdo-7.4.21: already unlocked
php74-pecl-psr-1.1.0: already unlocked
php74-pecl-radius-1.4.0b1_1: already unlocked
php74-phalcon4-4.1.2: already unlocked
php74-phpseclib-2.0.32: already unlocked
php74-session-7.4.21: already unlocked
php74-simplexml-7.4.21: already unlocked
php74-sockets-7.4.21: already unlocked
php74-sqlite3-7.4.21: already unlocked
php74-xml-7.4.21: already unlocked
php74-zlib-7.4.21: already unlocked
pkg-1.16.3: already unlocked
postfix-sasl-3.5.10,1: already unlocked
py37-Babel-2.9.1: already unlocked
py37-Jinja2-2.11.2_1: already unlocked
py37-certifi-2021.5.30: already unlocked
py37-cffi-1.14.6: already unlocked
py37-chardet-4.0.0,1: already unlocked
py37-cryptography-3.3.2: already unlocked
py37-dnspython-1.16.0: already unlocked
py37-idna-2.10: already unlocked
py37-markupsafe-1.1.1_1: already unlocked
py37-netaddr-0.8.0: already unlocked
py37-openssl-20.0.1: already unlocked
py37-pycparser-2.20: already unlocked
py37-pysocks-1.7.1: already unlocked
py37-pytz-2021.1,1: already unlocked
py37-requests-2.25.1: already unlocked
py37-setuptools-57.0.0: already unlocked
py37-six-1.16.0: already unlocked
py37-sqlite3-3.7.11_7: already unlocked
py37-ujson-4.0.2: already unlocked
py37-urllib3-1.25.11,1: already unlocked
py37-yaml-5.4.1: already unlocked
python37-3.7.11: already unlocked
radvd-2.19_1: already unlocked
readline-8.1.1: already unlocked
rrdtool-1.7.2_4: already unlocked
samplicator-1.3.8.r1_1: already unlocked
sqlite3-3.35.5_3,1: already unlocked
squid-4.15: already unlocked
strongswan-5.9.2_2: already unlocked
sudo-1.9.7p1: already unlocked
suricata-5.0.7: already unlocked
syslog-ng-3.33.2: already unlocked
syslogd-12.1: already unlocked
unbound-1.13.1: already unlocked
wireguard-go-0.0.20210424,1: already unlocked
wireguard-tools-1.0.20210424: already unlocked
wpa_supplicant-2.9_11: already unlocked
zip-3.0_1: already unlocked
Updating OPNsense repository catalogue...
pkg-static: Repository OPNsense has a wrong packagesite, need to re-create database
Fetching meta.conf: . done
Fetching packagesite.txz: .......... done
Processing entries: .......... done
OPNsense repository update completed. 764 packages processed.
Updating mimugmail repository catalogue...
pkg-static: https://opn-repo.routerperformance.net/repo/FreeBSD:12:amd64/meta.txz: Non-recoverable resolver failure
repository mimugmail has no meta file, using default settings
pkg-static: https://opn-repo.routerperformance.net/repo/FreeBSD:12:amd64/packagesite.txz: Non-recoverable resolver failure
Unable to update repository mimugmail
Error updating repositories!

I think I see the issue, it looks like because sensei is not ready maybe:

root@OPNsense:~ # cat /var/cache/opnsense-update/.upgrade.log
alsa-lib-1.1.2_2: already unlocked
bash-5.1.8: already unlocked
beep-1.0_1: already unlocked
ca_root_nss-3.68: already unlocked
choparp-20150613: already unlocked
clog-1.0.2: already unlocked
cpdup-1.22: already unlocked
cpustats-0.1: already unlocked
curl-7.78.0: already unlocked
cyrus-sasl-2.1.27_1: already unlocked
dejavu-2.37_1: already unlocked
dhcp6c-20200512_1: already unlocked
dhcpleases-0.2: already unlocked
dmidecode-3.3: already unlocked
dnsmasq-2.85_1,1: already unlocked
dpinger-3.0: already unlocked
e2fsprogs-libuuid-1.46.2: already unlocked
elasticsearch5-5.6.8_5: already unlocked
expat-2.4.1: already unlocked
expiretable-0.6_2: already unlocked
filterlog-0.4_2: already unlocked
flock-2.30.1: already unlocked
flowd-0.9.1_3: already unlocked
fontconfig-2.13.93,1: already unlocked
freetype2-2.10.4: already unlocked
gettext-runtime-0.21: already unlocked
glib-2.66.8,2: already unlocked
gmp-6.2.1: already unlocked
gnu-watch-3.3.17: already unlocked
hostapd-2.9_4: already unlocked
hw-probe-1.6.b2: already unlocked
hwstat-0.5.1: already unlocked
hyperscan-5.4.0: already unlocked
ifinfo-10.1: already unlocked
iftop-1.0.p4: already unlocked
indexinfo-0.3.1: already unlocked
iperf3-3.10.1_1: already unlocked
isc-dhcp44-relay-4.4.2P1: already unlocked
isc-dhcp44-server-4.4.2P1_1: already unlocked
jansson-2.13.1: already unlocked
java-zoneinfo-2021.a: already unlocked
javavmwrapper-2.7.7: already unlocked
jna-5.7.0: already unlocked
json-c-0.15_1: already unlocked
krb5-1.19.1: already unlocked
ldns-1.7.1_2: already unlocked
libICE-1.0.10,1: already unlocked
libSM-1.2.3,1: already unlocked
libX11-1.6.12,1: already unlocked
libXau-1.0.9: already unlocked
libXdmcp-1.1.3: already unlocked
libXt-1.2.1,1: already unlocked
libargon2-20190702: already unlocked
libcbor-0.8.0: already unlocked
libcjson-1.7.14: already unlocked
libedit-3.1.20210216,1: already unlocked
libevent-2.1.12: already unlocked
libffi-3.3_1: already unlocked
libfido2-1.7.0: already unlocked
libfontenc-1.1.4: already unlocked
libiconv-1.16: already unlocked
libinotify-20180201_2: already unlocked
liblz4-1.9.3,1: already unlocked
libnet-1.1.6_5,1: already unlocked
libnghttp2-1.43.0: already unlocked
libpthread-stubs-0.4: already unlocked
libressl-3.3.3: already unlocked
libsodium-1.0.18: already unlocked
libucl-0.8.1: already unlocked
libunwind-20201110: already unlocked
libxcb-1.14_1: already unlocked
libxml2-2.9.12: already unlocked
libyaml-0.2.5: already unlocked
lighttpd-1.4.59: already unlocked
lscpu-1.2.0: already unlocked
lzo2-2.10_1: already unlocked
mkfontscale-1.2.1: already unlocked
monit-5.28.0: already unlocked
mpd5-5.9: already unlocked
mpdecimal-2.5.1: already unlocked
nano-5.8: already unlocked
nettle-3.7.3: already unlocked
nspr-4.32: already unlocked
nss-3.68: already unlocked
ntp-4.2.8p15: already unlocked
oniguruma-6.9.7.1: already unlocked
openjdk8-8.282.08.1: already unlocked
openldap-sasl-client-2.4.59: already unlocked
openssh-portable-8.6.p1,1: already unlocked
openvpn-2.5.3: already unlocked
opnsense-21.1.9_1: already unlocked
opnsense-installer-21.7: already unlocked
opnsense-lang-21.1.7: already unlocked
opnsense-update-21.1.8_1: already unlocked
os-api-backup-1.0_1: already unlocked
os-dyndns-1.24_2: already unlocked
os-hw-probe-1.0_1: already unlocked
os-iperf-devel-1.0_1: already unlocked
os-sensei-1.9.2: already unlocked
os-sensei-updater-1.9: already unlocked
os-smart-2.2: already unlocked
os-sunnyvalley-1.2_1: already unlocked
os-theme-cicada-1.28: already unlocked
os-theme-rebellion-1.8.7: already unlocked
os-wireguard-1.7: already unlocked
pam_opnsense-19.1.3: already unlocked
pcre-8.44_1: already unlocked
pcre2-10.37: already unlocked
perl5-5.32.1_1: already unlocked
pftop-0.7_9: already unlocked
php74-7.4.21: already unlocked
php74-ctype-7.4.21: already unlocked
php74-curl-7.4.21: already unlocked
php74-dom-7.4.21: already unlocked
php74-filter-7.4.21: already unlocked
php74-gettext-7.4.21: already unlocked
php74-google-api-php-client-2.4.0: already unlocked
php74-json-7.4.21: already unlocked
php74-ldap-7.4.21: already unlocked
php74-mbstring-7.4.21: already unlocked
php74-openssl-7.4.21: already unlocked
php74-pdo-7.4.21: already unlocked
php74-pecl-psr-1.1.0: already unlocked
php74-pecl-radius-1.4.0b1_1: already unlocked
php74-phalcon4-4.1.2: already unlocked
php74-phpseclib-2.0.32: already unlocked
php74-session-7.4.21: already unlocked
php74-simplexml-7.4.21: already unlocked
php74-sockets-7.4.21: already unlocked
php74-sqlite3-7.4.21: already unlocked
php74-xml-7.4.21: already unlocked
php74-zlib-7.4.21: already unlocked
pkg-1.16.3: already unlocked
png-1.6.37_1: already unlocked
py37-Babel-2.9.1: already unlocked
py37-Jinja2-2.11.2_1: already unlocked
py37-aiohttp-3.7.4.p0: already unlocked
py37-async_timeout-3.0.1: already unlocked
py37-attrs-21.2.0: already unlocked
py37-certifi-2021.5.30: already unlocked
py37-cffi-1.14.6: already unlocked
py37-chardet-4.0.0,1: already unlocked
py37-cryptography-3.3.2: already unlocked
py37-dnspython-1.16.0: already unlocked
py37-idna-2.10: already unlocked
py37-markupsafe-1.1.1_1: already unlocked
py37-multidict-5.1.0: already unlocked
py37-netaddr-0.8.0: already unlocked
py37-openssl-20.0.1: already unlocked
py37-pycparser-2.20: already unlocked
py37-pysocks-1.7.1: already unlocked
py37-pytz-2021.1,1: already unlocked
py37-requests-2.25.1: already unlocked
py37-setuptools-57.0.0: already unlocked
py37-six-1.16.0: already unlocked
py37-speedtest-cli-2.1.3: already unlocked
py37-sqlite3-3.7.11_7: already unlocked
py37-typing-extensions-3.10.0.0: already unlocked
py37-ujson-4.0.2: already unlocked
py37-urllib3-1.25.11,1: already unlocked
py37-yaml-5.4.1: already unlocked
py37-yarl-1.6.3: already unlocked
python37-3.7.11: already unlocked
radvd-2.19_1: already unlocked
readline-8.1.1: already unlocked
rrdtool-1.7.2_4: already unlocked
ruby-2.7.4,1: already unlocked
samplicator-1.3.8.r1_1: already unlocked
smartmontools-7.2_1: already unlocked
sqlite3-3.35.5_3,1: already unlocked
squid-4.15: already unlocked
strongswan-5.9.2_2: already unlocked
sudo-1.9.7p1: already unlocked
suricata-5.0.7: already unlocked
syslog-ng-3.33.2: already unlocked
syslogd-12.1: already unlocked
ubench-0.32: already unlocked
unbound-1.13.1: already unlocked
wireguard-go-0.0.20210424,1: already unlocked
wireguard-kmod-0.0.20210606_1: already unlocked
wireguard-tools-1.0.20210424: already unlocked
wpa_supplicant-2.9_11: already unlocked
xorgproto-2020.1: already unlocked
zip-3.0_1: already unlocked
Updating OPNsense repository catalogue...
pkg-static: Repository OPNsense has a wrong packagesite, need to re-create database
Fetching meta.conf: . done
Fetching packagesite.txz: .......... done
Processing entries: .......... done
OPNsense repository update completed. 761 packages processed.
Updating SunnyValley repository catalogue...
pkg-static: https://updates.sunnyvalley.io/opnsense/FreeBSD:12:amd64/21.1/LibreSSL/latest/meta.txz: Non-recoverable resolver failure
repository SunnyValley has no meta file, using default settings
pkg-static: https://updates.sunnyvalley.io/opnsense/FreeBSD:12:amd64/21.1/LibreSSL/latest/packagesite.txz: Non-recoverable resolver failure
Unable to update repository SunnyValley
Error updating repositories!



https://github.com/opnsense/update/commit/99b5aae0918

Should be this. I am a bit surprised that this went completely unreported.


Cheers,
Franco

Quote from: franco on July 28, 2021, 03:12:52 PM
https://github.com/opnsense/update/commit/99b5aae0918

Should be this. I am a bit surprised that this went completely unreported.


Cheers,
Franco

No worries! Thats why we are all here :)

Do you think we will be able to update later if this change is made on your side?

having the exact same issue, I tried upgrading from both web & console

I'm updating 21.1.9 later after confirming this works and then it should fly to 21.7.

Give me 30 minutes...


Cheers,
Franco

No problem, you are a gentleman and a scholar. Thanks!

As mentioned in my duplicate thread of this issue (please delete if you want) I had the same issue.
As franco suspected it appears to have been caused by the mimugmail repo. I deleted the repo and initiated another update (after making sure I had no pkg from said repo installed). Unfortunately my system is not coming up again (it has been about 15 minutes now) and I can only check later when I get home.

Quote from: pp on July 28, 2021, 03:25:42 PM
As mentioned in my duplicate thread of this issue (please delete if you want) I had the same issue.
As franco suspected it appears to have been caused by the mimugmail repo. I deleted the repo and initiated another update (after making sure I had no pkg from said repo installed). Unfortunately my system is not coming up again (it has been about 15 minutes now) and I can only check later when I get home.

It may come up. Drink a coffee and check again. No stressing!