"Check updates" shows new packages to install, then uninstalls them. How to fix?

Started by tangofan, August 18, 2024, 03:22:57 AM

Previous topic - Next topic
Since I wanted to install Adguard on my bare-metal OPNsense 24.7.1 installation, I just added the repository for mimugmail with the commands fetch -o /usr/local/etc/pkg/repos/mimugmail.conf https://www.routerperformance.net/mimugmail.conf
pkg update
(as described at https://github.com/mimugmail/opn-repo ).

I didn't install any packages from that repository, but - after adding the repository - I ran an update check at "System: Firmware: Status" and it showed me that there were several new packages that needed to be installed. I clicked the "Update" button on the "Update" tab and OPNsense installed several packages, however it also apparently uninstalled them immediately afterwards (e.g. lerc: 4.0.0).

Here's the Update log:

***GOT REQUEST TO UPDATE***
Currently running OPNsense 24.7.1 at Sat Aug 17 17:46:21 PDT 2024
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
Checking for upgrades (10 candidates): .......... done
Processing candidates (10 candidates): .......... done
The following 19 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
alsa-lib: 1.2.11 [mimugmail]
brotli: 1.1.0,1 [SunnyValley]
fontconfig: 2.15.0_2,1 [SunnyValley]
freetype2: 2.13.2 [SunnyValley]
giflib: 5.2.2 [SunnyValley]
graphite2: 1.3.14 [mimugmail]
jbigkit: 2.1_2 [SunnyValley]
jpeg-turbo: 3.0.3 [SunnyValley]
lcms2: 2.16_2 [mimugmail]
lerc: 4.0.0 [OPNsense]
libXext: 1.3.6,1 [mimugmail]
libXfixes: 6.0.0_1 [mimugmail]
libXi: 1.8_1,1 [mimugmail]
libXrender: 0.9.10_2 [mimugmail]
libdeflate: 1.20 [SunnyValley]
libfontenc: 1.1.8 [SunnyValley]
png: 1.6.43 [SunnyValley]
tiff: 4.6.0 [OPNsense]
zstd: 1.5.6 [SunnyValley]

Number of packages to be installed: 19

The process will require 18 MiB more space.
4 MiB to be downloaded.
[1/19] Fetching png-1.6.43.pkg: .......... done
[2/19] Fetching freetype2-2.13.2.pkg: .......... done
[3/19] Fetching jpeg-turbo-3.0.3.pkg: .......... done
[4/19] Fetching lcms2-2.16_2.pkg: .......... done
[5/19] Fetching libdeflate-1.20.pkg: .......... done
[6/19] Fetching libXfixes-6.0.0_1.pkg: .. done
[7/19] Fetching giflib-5.2.2.pkg: ......... done
[8/19] Fetching libXrender-0.9.10_2.pkg: .... done
[9/19] Fetching libXi-1.8_1,1.pkg: .......... done
[10/19] Fetching graphite2-1.3.14.pkg: .......... done
[11/19] Fetching alsa-lib-1.2.11.pkg: .......... done
[12/19] Fetching libfontenc-1.1.8.pkg: ... done
[13/19] Fetching zstd-1.5.6.pkg: .......... done
[14/19] Fetching brotli-1.1.0,1.pkg: .......... done
[15/19] Fetching libXext-1.3.6,1.pkg: .......... done
[16/19] Fetching fontconfig-2.15.0_2,1.pkg: .......... done
[17/19] Fetching jbigkit-2.1_2.pkg: .......... done
[18/19] Fetching tiff-4.6.0.pkg: .......... done
[19/19] Fetching lerc-4.0.0.pkg: .......... done
Checking integrity... done (0 conflicting)
[1/19] Installing png-1.6.43...
[1/19] Extracting png-1.6.43: .......... done
[2/19] Installing jpeg-turbo-3.0.3...
[2/19] Extracting jpeg-turbo-3.0.3: .......... done
[3/19] Installing libdeflate-1.20...
[3/19] Extracting libdeflate-1.20: .......... done
[4/19] Installing zstd-1.5.6...
[4/19] Extracting zstd-1.5.6: .......... done
[5/19] Installing brotli-1.1.0,1...
[5/19] Extracting brotli-1.1.0,1: .......... done
[6/19] Installing jbigkit-2.1_2...
[6/19] Extracting jbigkit-2.1_2: .......... done
[7/19] Installing lerc-4.0.0...
[7/19] Extracting lerc-4.0.0: ........ done
[8/19] Installing freetype2-2.13.2...
[8/19] Extracting freetype2-2.13.2: .......... done
[9/19] Installing libXfixes-6.0.0_1...
[9/19] Extracting libXfixes-6.0.0_1: ....... done
[10/19] Installing libXext-1.3.6,1...
[10/19] Extracting libXext-1.3.6,1: .......... done
[11/19] Installing tiff-4.6.0...
[11/19] Extracting tiff-4.6.0: .......... done
[12/19] Installing lcms2-2.16_2...
[12/19] Extracting lcms2-2.16_2: .......... done
[13/19] Installing giflib-5.2.2...
[13/19] Extracting giflib-5.2.2: .......... done
[14/19] Installing libXrender-0.9.10_2...
[14/19] Extracting libXrender-0.9.10_2: .......... done
[15/19] Installing libXi-1.8_1,1...
[15/19] Extracting libXi-1.8_1,1: .......... done
[16/19] Installing graphite2-1.3.14...
[16/19] Extracting graphite2-1.3.14: .......... done
[17/19] Installing alsa-lib-1.2.11...
[17/19] Extracting alsa-lib-1.2.11: .......... done
[18/19] Installing libfontenc-1.1.8...
[18/19] Extracting libfontenc-1.1.8: ......... done
[19/19] Installing fontconfig-2.15.0_2,1...
[19/19] Extracting fontconfig-2.15.0_2,1: .......... done
Running fc-cache to build fontconfig cache...
=====
Message from freetype2-2.13.2:

--
The 2.7.x series now uses the new subpixel hinting mode (V40 port's option) as
the default, emulating a modern version of ClearType. This change inevitably
leads to different rendering results, and you might change port's options to
adapt it to your taste (or use the new "FREETYPE_PROPERTIES" environment
variable).

The environment variable "FREETYPE_PROPERTIES" can be used to control the
driver properties. Example:

FREETYPE_PROPERTIES=truetype:interpreter-version=35 \
cff:no-stem-darkening=1 \
autofitter:warping=1

This allows to select, say, the subpixel hinting mode at runtime for a given
application.

If LONG_PCF_NAMES port's option was enabled, the PCF family names may include
the foundry and information whether they contain wide characters. For example,
"Sony Fixed" or "Misc Fixed Wide", instead of "Fixed". This can be disabled at
run time with using pcf:no-long-family-names property, if needed. Example:

FREETYPE_PROPERTIES=pcf:no-long-family-names=1

How to recreate fontconfig cache with using such environment variable,
if needed:
# env FREETYPE_PROPERTIES=pcf:no-long-family-names=1 fc-cache -fsv

The controllable properties are listed in the section "Controlling FreeType
Modules" in the reference's table of contents
(/usr/local/share/doc/freetype2/reference/index.html, if documentation was installed).
Checking integrity... done (0 conflicting)
Deinstallation has been requested for the following 19 packages:

Installed packages to be REMOVED:
alsa-lib: 1.2.11
brotli: 1.1.0,1
fontconfig: 2.15.0_2,1
freetype2: 2.13.2
giflib: 5.2.2
graphite2: 1.3.14
jbigkit: 2.1_2
jpeg-turbo: 3.0.3
lcms2: 2.16_2
lerc: 4.0.0
libXext: 1.3.6,1
libXfixes: 6.0.0_1
libXi: 1.8_1,1
libXrender: 0.9.10_2
libdeflate: 1.20
libfontenc: 1.1.8
png: 1.6.43
tiff: 4.6.0
zstd: 1.5.6

Number of packages to be removed: 19

The operation will free 18 MiB.
[1/19] Deinstalling lcms2-2.16_2...
[1/19] Deleting files for lcms2-2.16_2: .......... done
[2/19] Deinstalling fontconfig-2.15.0_2,1...
[2/19] Deleting files for fontconfig-2.15.0_2,1: .......... done
[3/19] Deinstalling freetype2-2.13.2...
[3/19] Deleting files for freetype2-2.13.2: .......... done
[4/19] Deinstalling libXi-1.8_1,1...
[4/19] Deleting files for libXi-1.8_1,1: .......... done
[5/19] Deinstalling tiff-4.6.0...
[5/19] Deleting files for tiff-4.6.0: .......... done
[6/19] Deinstalling png-1.6.43...
[6/19] Deleting files for png-1.6.43: .......... done
[7/19] Deinstalling jpeg-turbo-3.0.3...
[7/19] Deleting files for jpeg-turbo-3.0.3: .......... done
[8/19] Deinstalling libfontenc-1.1.8...
[8/19] Deleting files for libfontenc-1.1.8: ......... done
[9/19] Deinstalling zstd-1.5.6...
[9/19] Deleting files for zstd-1.5.6: .......... done
[10/19] Deinstalling brotli-1.1.0,1...
[10/19] Deleting files for brotli-1.1.0,1: .......... done
[11/19] Deinstalling libdeflate-1.20...
[11/19] Deleting files for libdeflate-1.20: .......... done
[12/19] Deinstalling libXext-1.3.6,1...
[12/19] Deleting files for libXext-1.3.6,1: .......... done
[13/19] Deinstalling libXfixes-6.0.0_1...
[13/19] Deleting files for libXfixes-6.0.0_1: ....... done
[14/19] Deinstalling giflib-5.2.2...
[14/19] Deleting files for giflib-5.2.2: .......... done
[15/19] Deinstalling libXrender-0.9.10_2...
[15/19] Deleting files for libXrender-0.9.10_2: .......... done
[16/19] Deinstalling jbigkit-2.1_2...
[16/19] Deleting files for jbigkit-2.1_2: .......... done
[17/19] Deinstalling graphite2-1.3.14...
[17/19] Deleting files for graphite2-1.3.14: .......... done
[18/19] Deinstalling alsa-lib-1.2.11...
[18/19] Deleting files for alsa-lib-1.2.11: .......... done
[19/19] Deinstalling lerc-4.0.0...
[19/19] Deleting files for lerc-4.0.0: ........ done
Checking all packages: .......... done
The following package files will be deleted:
/var/cache/pkg/p5-NetAddr-IP-4.079.pkg
/var/cache/pkg/jna-5.7.0_1~fd296c07d1.pkg
/var/cache/pkg/py311-boto3-1.34.153~5e9e7e0afb.pkg
/var/cache/pkg/py311-jmespath-1.0.1_1.pkg
/var/cache/pkg/py311-jmespath-1.0.1_1~faa1697ff9.pkg
/var/cache/pkg/java-zoneinfo-2021.e.pkg
/var/cache/pkg/libXdmcp-1.1.5~9acc7cee03.pkg
/var/cache/pkg/libxcb-1.16.1~e3a4da7a4a.pkg
/var/cache/pkg/javavmwrapper-2.7.10.pkg
/var/cache/pkg/libSM-1.2.3_1,1.pkg
/var/cache/pkg/p5-NetAddr-IP-4.079~240b826cbe.pkg
/var/cache/pkg/openjdk8-8.402.06.1_1.pkg
/var/cache/pkg/libICE-1.1.0_2,1~dbf45c85fe.pkg
/var/cache/pkg/fontconfig-2.15.0_2,1~bf23c56c96.pkg
/var/cache/pkg/tiff-4.6.0~03aee41964.pkg
/var/cache/pkg/elasticsearch8-8.11.3.pkg
/var/cache/pkg/libXi-1.8_1,1~c75b3a3b76.pkg
/var/cache/pkg/javavmwrapper-2.7.10~7bf11c05e6.pkg
/var/cache/pkg/libICE-1.1.0_2,1.pkg
/var/cache/pkg/ddclient-3.11.2_1~3048b1a69f.pkg
/var/cache/pkg/p5-Data-Validate-IP-0.27.pkg
/var/cache/pkg/libXfixes-6.0.0_1~112ddedf00.pkg
/var/cache/pkg/libXfixes-6.0.0_1.pkg
/var/cache/pkg/libXt-1.3.0,1.pkg
/var/cache/pkg/py311-boto3-1.34.153.pkg
/var/cache/pkg/py311-botocore-1.34.153~c92e9feb69.pkg
/var/cache/pkg/libinotify-20211018_1~06839f03ba.pkg
/var/cache/pkg/jpeg-turbo-3.0.3~2b2514f810.pkg
/var/cache/pkg/lcms2-2.16_2~d0fd020876.pkg
/var/cache/pkg/libfontenc-1.1.8~c32e4188e2.pkg
/var/cache/pkg/libXext-1.3.6,1.pkg
/var/cache/pkg/tiff-4.6.0.pkg
/var/cache/pkg/libXau-1.0.9_1~269e3bd687.pkg
/var/cache/pkg/libXt-1.3.0,1~279730e2bd.pkg
/var/cache/pkg/jbigkit-2.1_2.pkg
/var/cache/pkg/libdeflate-1.20.pkg
/var/cache/pkg/libxcb-1.16.1.pkg
/var/cache/pkg/lcms2-2.16_2.pkg
/var/cache/pkg/elasticsearch8-8.11.3~ce17c6fcf3.pkg
/var/cache/pkg/os-ddclient-1.23~1e36470ba1.pkg
/var/cache/pkg/libXau-1.0.9_1.pkg
/var/cache/pkg/ddclient-3.11.2_1.pkg
/var/cache/pkg/java-zoneinfo-2021.e~1866fc49e3.pkg
/var/cache/pkg/libX11-1.8.7_1,1~bd42b7d5ae.pkg
/var/cache/pkg/libX11-1.8.7_1,1.pkg
/var/cache/pkg/xorgproto-2023.2.pkg
/var/cache/pkg/bash-5.2.26_1.pkg
/var/cache/pkg/openjdk17-17.0.10+7.1_1~cbfcd42d5b.pkg
/var/cache/pkg/libXi-1.8_1,1.pkg
/var/cache/pkg/freetype2-2.13.2~76fa19cd6b.pkg
/var/cache/pkg/lerc-4.0.0.pkg
/var/cache/pkg/os-ddclient-1.23.pkg
/var/cache/pkg/jpeg-turbo-3.0.3.pkg
/var/cache/pkg/libXdmcp-1.1.5.pkg
/var/cache/pkg/libXrender-0.9.10_2.pkg
/var/cache/pkg/alsa-lib-1.2.11.pkg
/var/cache/pkg/giflib-5.2.2~61b06a0d8a.pkg
/var/cache/pkg/zstd-1.5.6~e14bb59e2e.pkg
/var/cache/pkg/jna-5.7.0_1.pkg
/var/cache/pkg/libfontenc-1.1.8.pkg
/var/cache/pkg/py311-s3transfer-0.10.2.pkg
/var/cache/pkg/brotli-1.1.0,1.pkg
/var/cache/pkg/graphite2-1.3.14.pkg
/var/cache/pkg/bash-5.2.26_1~7d19e7a1ea.pkg
/var/cache/pkg/libinotify-20211018_1.pkg
/var/cache/pkg/zstd-1.5.6.pkg
/var/cache/pkg/libSM-1.2.3_1,1~82735b4476.pkg
/var/cache/pkg/libdeflate-1.20~1df5782c2a.pkg
/var/cache/pkg/png-1.6.43.pkg
/var/cache/pkg/fontconfig-2.15.0_2,1.pkg
/var/cache/pkg/libXext-1.3.6,1~30005c79a9.pkg
/var/cache/pkg/brotli-1.1.0,1~8e55295843.pkg
/var/cache/pkg/freetype2-2.13.2.pkg
/var/cache/pkg/jbigkit-2.1_2~4b5c73fda2.pkg
/var/cache/pkg/giflib-5.2.2.pkg
/var/cache/pkg/libXrender-0.9.10_2~020f4558f9.pkg
/var/cache/pkg/p5-Data-Validate-IP-0.27~c6d994fa31.pkg
/var/cache/pkg/xorgproto-2023.2~774aecc8ab.pkg
/var/cache/pkg/py311-botocore-1.34.153.pkg
/var/cache/pkg/graphite2-1.3.14~d2a11600d5.pkg
/var/cache/pkg/openjdk8-8.402.06.1_1~2760de3ee0.pkg
/var/cache/pkg/openjdk17-17.0.10+7.1_1.pkg
/var/cache/pkg/alsa-lib-1.2.11~67ac8ae257.pkg
/var/cache/pkg/py311-s3transfer-0.10.2~5eaadca94c.pkg
/var/cache/pkg/png-1.6.43~e10fcb01ca.pkg
/var/cache/pkg/lerc-4.0.0~c20e4a3f69.pkg
The cleanup will free 395 MiB
Deleting files: .......... done
All done
Nothing to do.
Starting web GUI...done.
Generating RRD graphs...done.
***DONE***


When I ran an Update check again, I once again got the message that 19 packages need to be installed:

***GOT REQUEST TO CHECK FOR UPDATES***
Currently running OPNsense 24.7.1 at Sat Aug 17 18:01:06 PDT 2024
Fetching changelog information, please wait... done
Updating OPNsense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: .......... done
Processing entries: .......... done
OPNsense repository update completed. 838 packages processed.
Updating SunnyValley repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ......... done
Processing entries: ..... done
SunnyValley repository update completed. 66 packages processed.
Updating mimugmail repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ........ done
Processing entries: .......... done
mimugmail repository update completed. 202 packages processed.
All repositories are up to date.
Checking integrity... done (0 conflicting)
Your packages are up to date.
Checking for upgrades (10 candidates): .......... done
Processing candidates (10 candidates): .......... done
The following 19 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
alsa-lib: 1.2.11 [mimugmail]
brotli: 1.1.0,1 [SunnyValley]
fontconfig: 2.15.0_2,1 [SunnyValley]
freetype2: 2.13.2 [SunnyValley]
giflib: 5.2.2 [SunnyValley]
graphite2: 1.3.14 [mimugmail]
jbigkit: 2.1_2 [SunnyValley]
jpeg-turbo: 3.0.3 [SunnyValley]
lcms2: 2.16_2 [mimugmail]
lerc: 4.0.0 [OPNsense]
libXext: 1.3.6,1 [mimugmail]
libXfixes: 6.0.0_1 [mimugmail]
libXi: 1.8_1,1 [mimugmail]
libXrender: 0.9.10_2 [mimugmail]
libdeflate: 1.20 [SunnyValley]
libfontenc: 1.1.8 [SunnyValley]
png: 1.6.43 [SunnyValley]
tiff: 4.6.0 [OPNsense]
zstd: 1.5.6 [SunnyValley]

Number of packages to be installed: 19

The process will require 18 MiB more space.
4 MiB to be downloaded.
***DONE***


It seems that the package manager is inconsistent re. the packages it actually needs to install. Even a reboot of OPNsense didn't help. I should note that I don't know that adding the mimugmail repository is related to this problem, the inconsistency might have been there before this (but I didn't check for updates before adding the mimugmail repository).

Could someone please advise me how to fix this inconsistency or how to further diagnose the root cause of this? (Since I'm an OPNsense and FreeBSD newbie, don't hesitate to be pretty specific  ;) )

A quick followup: FWIW I ran a health audit and the out put is shown below:

***GOT REQUEST TO AUDIT HEALTH***
Currently running OPNsense 24.7.1 at Sun Aug 18 12:42:30 PDT 2024
>>> Root file system: zroot/ROOT/default
>>> Check installed kernel version
Version 24.7.1 is correct.
>>> Check for missing or altered kernel files
No problems detected.
>>> Check installed base version
Version 24.7.1 is correct.
>>> Check for missing or altered base files
Error 2 occurred.
etc/sysctl.conf:
size (299, 364)
sha256digest (0x45f469e7a9b4eef887bab7b55397305043fe101e1d6ce6f7e23d758e72f56dc6, 0x69344d6e7acbd6e60e93c10865e489c54293af7143ef5cc58127aa67175d0dd2)
>>> Check installed repositories
SunnyValley
mimugmail
OPNsense
>>> Check installed plugins
os-crowdsec 1.0.8_1
os-ddclient 1.23
os-sensei 1.17.6
os-sensei-updater 1.17
os-sunnyvalley 1.4_3
os-vnstat 1.3_1
>>> Check locked packages
No locks found.
>>> Check for missing package dependencies
Checking all packages: .......... done
>>> Check for missing or altered package files
Checking all packages:
elasticsearch8-8.11.3: checksum mismatch for /usr/local/lib/elasticsearch/lib/jna-0.0.0.jar
Checking all packages............. done
>>> Check for core packages consistency
Core package "opnsense" has 68 dependencies to check.
Checking packages: ..................................................................... done
***DONE***


Current content of the file etc/sysctl.conf

#
#  This file is read when going to multi-user and its contents piped thru
#  ``sysctl'' to adjust kernel values.  ``man 5 sysctl.conf'' for details.
#

# Uncomment this to prevent users from seeing information about processes that
# are being run under another UID.
#security.bsd.see_other_uids=0
kern.corefile=/usr/local/zenarmor/support/crash_dumps/%N.%P.core


Not sure what all this means in the context of my original problem, but perhaps it will help in the diagnosis...

Update 2: I stumbled across this thread at https://forum.opnsense.org/index.php?topic=41778.0 , in which @franco suggested to run "sh -x /usr/local/sbin/opnsense-update -p" for an eerily similar issue:

Output of that command (with 2 redactions):

root@OPNsense:/home/admin # sh -x /usr/local/sbin/opnsense-update -p
+ set -e
+ id -u
+ [ 0 '!=' 0 ]
+ CONFIGFILE=/usr/local/etc/opnsense-update.conf
+ SIG_KEY='^[[:space:]]*signature_type:[[:space:]]*'
+ URL_KEY='^[[:space:]]*url:[[:space:]]*'
+ VERSIONDIR=/usr/local/opnsense/version
+ WORKPREFIX=/var/cache/opnsense-update
+ REPOSDIR=/usr/local/etc/pkg/repos
+ DEBUGDIR=/usr/lib/debug
+ KERNELDIR=/boot/kernel
+ TEE='/usr/bin/tee -a'
+ PRODUCT=OPNsense
+ PKG=pkg-static
+ RELEASE=24.7.1
+ PENDINGDIR=/var/cache/opnsense-update/.sets.pending
+ PIPEFILE=/var/cache/opnsense-update/.upgrade.pipe
+ LOGFILE=/var/cache/opnsense-update/.upgrade.log
+ ORIGIN=/usr/local/etc/pkg/repos/OPNsense.conf
+ WORKDIR=/var/cache/opnsense-update/47615
+ sysctl -n kern.ident
+ IDENT=SMP
+ uname -p
+ ARCH=amd64
+ INSTALLED_BASE=''
+ [ -f /usr/local/opnsense/version/base ]
+ cat /usr/local/opnsense/version/base
+ INSTALLED_BASE=24.7.1
+ LOCKED_BASE=''
+ [ -f /usr/local/opnsense/version/base.lock ]
+ INSTALLED_PKGS=''
+ [ -f /usr/local/opnsense/version/pkgs ]
+ cat /usr/local/opnsense/version/pkgs
+ INSTALLED_PKGS=24.7
+ LOCKED_PKGS=''
+ [ -f /usr/local/opnsense/version/pkgs.lock ]
+ INSTALLED_KERNEL=''
+ [ -f /usr/local/opnsense/version/kernel ]
+ cat /usr/local/opnsense/version/kernel
+ INSTALLED_KERNEL=24.7.1
+ LOCKED_KERNEL=''
+ [ -f /usr/local/opnsense/version/kernel.lock ]
+ DO_ABI=''
+ DO_BASE=''
+ DO_CHECK=''
+ DO_CLEAN=''
+ DO_DEFAULTS=''
+ DO_DEVICE=''
+ DO_EMPTY=''
+ DO_FORCE=''
+ DO_INSECURE=''
+ DO_KERNEL=''
+ DO_LOCAL=''
+ DO_LOCK=''
+ DO_LOGFILE=''
+ DO_MIRROR=''
+ DO_MIRRORABI=''
+ DO_MIRRORDIR=''
+ DO_MIRRORURL=''
+ DO_ORIGIN=''
+ DO_PKGS=''
+ DO_RELEASE=''
+ DO_SIZE=''
+ DO_SKIP=''
+ DO_SNAPSHOT=''
+ DO_TEST=''
+ DO_TYPE=''
+ DO_UNLOCK=''
+ DO_UPGRADE=''
+ DO_VERBOSE=''
+ DO_VERSION=''
+ [ SMP '!=' SMP ]
+ getopts <redacted> OPT
+ DO_PKGS=-p
+ getopts <redacted> OPT
+ shift 1
+ [ -n '' ]
+ [ -n '' ]
+ [ '' ]
+ [ '' '=' -R ]
+ [ -n '' ]
+ [ -n '' ]
+ [ -n '' ]
+ [ ! -f /usr/local/etc/pkg/repos/OPNsense.conf ]
+ [ -n '' ]
+ [ -n '' ]
+ [ -n '' ]
+ [ '' '=' -M ]
+ [ '' '=' -x ]
+ [ '' '=' -X ]
+ [ -n '' ]
+ [ -n '' ]
+ [ -n '' ]
+ grep -q '^[[:space:]]*signature_type:[[:space:]]*"fingerprints"' /usr/local/etc/pkg/repos/OPNsense.conf
+ [ -n '' ]
+ [ -z -p ]
+ [ -n '' ]
+ [ -n '' ]
+ [ -z '' ]
+ [ -n '' -a -n '' -a -z '' ]
+ [ -n '' -a -n '' -a -z '' ]
+ [ -n -p -a -n '' -a -z '' ]
+ [ -n '' ]
+ [ '' '=' -K ]
+ [ '' '=' -B ]
+ [ -p '=' -P ]
+ [ -n '' ]
+ [ -p '=' -p -a -z '' ]
+ opnsense-version -n
+ CORE=opnsense
+ rm -rf '/var/cache/opnsense-update/.sets.pending/packages-*'
+ backup_origin
+ mkdir -p /var/cache/opnsense-update/47615
+ find /var/cache/opnsense-update/47615 -name '*.conf'
+ find /usr/local/etc/pkg/repos -name '*.conf'
+ cp /usr/local/etc/pkg/repos/SunnyValley.conf /var/cache/opnsense-update/47615
+ cp /usr/local/etc/pkg/repos/mimugmail.conf /var/cache/opnsense-update/47615
+ cp /usr/local/etc/pkg/repos/OPNsense.conf /var/cache/opnsense-update/47615
+ cp /usr/local/etc/pkg/repos/FreeBSD.conf /var/cache/opnsense-update/47615
+ pkg-static update
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
+ pkg-static upgrade -y
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
Updating SunnyValley repository catalogue...
SunnyValley repository is up to date.
Updating mimugmail repository catalogue...
mimugmail repository is up to date.
All repositories are up to date.
Checking for upgrades (10 candidates): 100%
Processing candidates (10 candidates): 100%
The following 19 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
        alsa-lib: 1.2.11 [mimugmail]
        brotli: 1.1.0,1 [SunnyValley]
        fontconfig: 2.15.0_2,1 [SunnyValley]
        freetype2: 2.13.2 [SunnyValley]
        giflib: 5.2.2 [SunnyValley]
        graphite2: 1.3.14 [mimugmail]
        jbigkit: 2.1_2 [SunnyValley]
        jpeg-turbo: 3.0.3 [SunnyValley]
        lcms2: 2.16_2 [mimugmail]
        lerc: 4.0.0 [OPNsense]
        libXext: 1.3.6,1 [mimugmail]
        libXfixes: 6.0.0_1 [mimugmail]
        libXi: 1.8_1,1 [mimugmail]
        libXrender: 0.9.10_2 [mimugmail]
        libdeflate: 1.20 [SunnyValley]
        libfontenc: 1.1.8 [SunnyValley]
        png: 1.6.43 [SunnyValley]
        tiff: 4.6.0 [OPNsense]
        zstd: 1.5.6 [SunnyValley]

Number of packages to be installed: 19

The process will require 18 MiB more space.
4 MiB to be downloaded.
[1/19] Fetching png-1.6.43.pkg: 100%  289 KiB 296.3kB/s    00:01
[2/19] Fetching freetype2-2.13.2.pkg: 100%  485 KiB 497.0kB/s    00:01
[3/19] Fetching jpeg-turbo-3.0.3.pkg: 100%  363 KiB 371.8kB/s    00:01
[4/19] Fetching lcms2-2.16_2.pkg: 100%  320 KiB 327.8kB/s    00:01
[5/19] Fetching libdeflate-1.20.pkg: 100%   85 KiB  87.2kB/s    00:01
[6/19] Fetching libXfixes-6.0.0_1.pkg: 100%   14 KiB  13.9kB/s    00:01
[7/19] Fetching giflib-5.2.2.pkg: 100%   70 KiB  72.0kB/s    00:01
[8/19] Fetching libXrender-0.9.10_2.pkg: 100%   28 KiB  28.4kB/s    00:01
[9/19] Fetching libXi-1.8_1,1.pkg: 100%  123 KiB 126.1kB/s    00:01
[10/19] Fetching graphite2-1.3.14.pkg: 100%   98 KiB  99.9kB/s    00:01
[11/19] Fetching alsa-lib-1.2.11.pkg: 100%  484 KiB 495.9kB/s    00:01
[12/19] Fetching libfontenc-1.1.8.pkg: 100%   21 KiB  21.6kB/s    00:01
[13/19] Fetching zstd-1.5.6.pkg: 100%  466 KiB 476.8kB/s    00:01
[14/19] Fetching brotli-1.1.0,1.pkg: 100%  327 KiB 334.6kB/s    00:01
[15/19] Fetching libXext-1.3.6,1.pkg: 100%   94 KiB  96.1kB/s    00:01
[16/19] Fetching fontconfig-2.15.0_2,1.pkg: 100%  319 KiB 326.5kB/s    00:01
[17/19] Fetching jbigkit-2.1_2.pkg: 100%   78 KiB  79.9kB/s    00:01
[18/19] Fetching tiff-4.6.0.pkg: 100%  437 KiB 447.3kB/s    00:01
[19/19] Fetching lerc-4.0.0.pkg: 100%  164 KiB 167.9kB/s    00:01
Checking integrity... done (0 conflicting)
[1/19] Installing png-1.6.43...
[1/19] Extracting png-1.6.43: 100%
[2/19] Installing jpeg-turbo-3.0.3...
[2/19] Extracting jpeg-turbo-3.0.3: 100%
[3/19] Installing libdeflate-1.20...
[3/19] Extracting libdeflate-1.20: 100%
[4/19] Installing zstd-1.5.6...
[4/19] Extracting zstd-1.5.6: 100%
[5/19] Installing brotli-1.1.0,1...
[5/19] Extracting brotli-1.1.0,1: 100%
[6/19] Installing jbigkit-2.1_2...
[6/19] Extracting jbigkit-2.1_2: 100%
[7/19] Installing lerc-4.0.0...
[7/19] Extracting lerc-4.0.0: 100%
[8/19] Installing freetype2-2.13.2...
[8/19] Extracting freetype2-2.13.2: 100%
[9/19] Installing libXfixes-6.0.0_1...
[9/19] Extracting libXfixes-6.0.0_1: 100%
[10/19] Installing libXext-1.3.6,1...
[10/19] Extracting libXext-1.3.6,1: 100%
[11/19] Installing tiff-4.6.0...
[11/19] Extracting tiff-4.6.0: 100%
[12/19] Installing lcms2-2.16_2...
[12/19] Extracting lcms2-2.16_2: 100%
[13/19] Installing giflib-5.2.2...
[13/19] Extracting giflib-5.2.2: 100%
[14/19] Installing libXrender-0.9.10_2...
[14/19] Extracting libXrender-0.9.10_2: 100%
[15/19] Installing libXi-1.8_1,1...
[15/19] Extracting libXi-1.8_1,1: 100%
[16/19] Installing graphite2-1.3.14...
[16/19] Extracting graphite2-1.3.14: 100%
[17/19] Installing alsa-lib-1.2.11...
[17/19] Extracting alsa-lib-1.2.11: 100%
[18/19] Installing libfontenc-1.1.8...
[18/19] Extracting libfontenc-1.1.8: 100%
[19/19] Installing fontconfig-2.15.0_2,1...
[19/19] Extracting fontconfig-2.15.0_2,1: 100%
Running fc-cache to build fontconfig cache...
=====
Message from freetype2-2.13.2:

--
The 2.7.x series now uses the new subpixel hinting mode (V40 port's option) as
the default, emulating a modern version of ClearType. This change inevitably
leads to different rendering results, and you might change port's options to
adapt it to your taste (or use the new "FREETYPE_PROPERTIES" environment
variable).

The environment variable "FREETYPE_PROPERTIES" can be used to control the
driver properties. Example:

FREETYPE_PROPERTIES=truetype:interpreter-version=35 \
        cff:no-stem-darkening=1 \
        autofitter:warping=1

This allows to select, say, the subpixel hinting mode at runtime for a given
application.

If LONG_PCF_NAMES port's option was enabled, the PCF family names may include
the foundry and information whether they contain wide characters. For example,
"Sony Fixed" or "Misc Fixed Wide", instead of "Fixed". This can be disabled at
run time with using pcf:no-long-family-names property, if needed. Example:

FREETYPE_PROPERTIES=pcf:no-long-family-names=1

How to recreate fontconfig cache with using such environment variable,
if needed:
# env FREETYPE_PROPERTIES=pcf:no-long-family-names=1 fc-cache -fsv

The controllable properties are listed in the section "Controlling FreeType
Modules" in the reference's table of contents
(/usr/local/share/doc/freetype2/reference/index.html, if documentation was installed).
+ [ ! -f /usr/local/etc/pkg/repos/OPNsense.conf ]
+ diff -q /var/cache/opnsense-update/47615/OPNsense.conf /usr/local/etc/pkg/repos/OPNsense.conf
+ pkg-static autoremove -y
Checking integrity... done (0 conflicting)
Deinstallation has been requested for the following 19 packages:

Installed packages to be REMOVED:
        alsa-lib: 1.2.11
        brotli: 1.1.0,1
        fontconfig: 2.15.0_2,1
        freetype2: 2.13.2
        giflib: 5.2.2
        graphite2: 1.3.14
        jbigkit: 2.1_2
        jpeg-turbo: 3.0.3
        lcms2: 2.16_2
        lerc: 4.0.0
        libXext: 1.3.6,1
        libXfixes: 6.0.0_1
        libXi: 1.8_1,1
        libXrender: 0.9.10_2
        libdeflate: 1.20
        libfontenc: 1.1.8
        png: 1.6.43
        tiff: 4.6.0
        zstd: 1.5.6

Number of packages to be removed: 19

The operation will free 18 MiB.
[1/19] Deinstalling lcms2-2.16_2...
[1/19] Deleting files for lcms2-2.16_2: 100%
[2/19] Deinstalling fontconfig-2.15.0_2,1...
[2/19] Deleting files for fontconfig-2.15.0_2,1: 100%
[3/19] Deinstalling freetype2-2.13.2...
[3/19] Deleting files for freetype2-2.13.2: 100%
[4/19] Deinstalling libXi-1.8_1,1...
[4/19] Deleting files for libXi-1.8_1,1: 100%
[5/19] Deinstalling tiff-4.6.0...
[5/19] Deleting files for tiff-4.6.0: 100%
[6/19] Deinstalling png-1.6.43...
[6/19] Deleting files for png-1.6.43: 100%
[7/19] Deinstalling jpeg-turbo-3.0.3...
[7/19] Deleting files for jpeg-turbo-3.0.3: 100%
[8/19] Deinstalling libfontenc-1.1.8...
[8/19] Deleting files for libfontenc-1.1.8: 100%
[9/19] Deinstalling zstd-1.5.6...
[9/19] Deleting files for zstd-1.5.6: 100%
[10/19] Deinstalling brotli-1.1.0,1...
[10/19] Deleting files for brotli-1.1.0,1: 100%
[11/19] Deinstalling libdeflate-1.20...
[11/19] Deleting files for libdeflate-1.20: 100%
[12/19] Deinstalling libXext-1.3.6,1...
[12/19] Deleting files for libXext-1.3.6,1: 100%
[13/19] Deinstalling libXfixes-6.0.0_1...
[13/19] Deleting files for libXfixes-6.0.0_1: 100%
[14/19] Deinstalling giflib-5.2.2...
[14/19] Deleting files for giflib-5.2.2: 100%
[15/19] Deinstalling libXrender-0.9.10_2...
[15/19] Deleting files for libXrender-0.9.10_2: 100%
[16/19] Deinstalling jbigkit-2.1_2...
[16/19] Deleting files for jbigkit-2.1_2: 100%
[17/19] Deinstalling graphite2-1.3.14...
[17/19] Deleting files for graphite2-1.3.14: 100%
[18/19] Deinstalling alsa-lib-1.2.11...
[18/19] Deleting files for alsa-lib-1.2.11: 100%
[19/19] Deinstalling lerc-4.0.0...
[19/19] Deleting files for lerc-4.0.0: 100%
+ pkg-static check -yda
Checking all packages: 100%
+ pkg-static clean -ya
The following package files will be deleted:
        /var/cache/pkg/fontconfig-2.15.0_2,1~bf23c56c96.pkg
        /var/cache/pkg/tiff-4.6.0~03aee41964.pkg
        /var/cache/pkg/libXi-1.8_1,1~c75b3a3b76.pkg
        /var/cache/pkg/libXfixes-6.0.0_1~112ddedf00.pkg
        /var/cache/pkg/libXfixes-6.0.0_1.pkg
        /var/cache/pkg/jpeg-turbo-3.0.3~2b2514f810.pkg
        /var/cache/pkg/lcms2-2.16_2~d0fd020876.pkg
        /var/cache/pkg/libfontenc-1.1.8~c32e4188e2.pkg
        /var/cache/pkg/libXext-1.3.6,1.pkg
        /var/cache/pkg/tiff-4.6.0.pkg
        /var/cache/pkg/jbigkit-2.1_2.pkg
        /var/cache/pkg/libdeflate-1.20.pkg
        /var/cache/pkg/lcms2-2.16_2.pkg
        /var/cache/pkg/libXi-1.8_1,1.pkg
        /var/cache/pkg/freetype2-2.13.2~76fa19cd6b.pkg
        /var/cache/pkg/lerc-4.0.0.pkg
        /var/cache/pkg/jpeg-turbo-3.0.3.pkg
        /var/cache/pkg/libXrender-0.9.10_2.pkg
        /var/cache/pkg/alsa-lib-1.2.11.pkg
        /var/cache/pkg/giflib-5.2.2~61b06a0d8a.pkg
        /var/cache/pkg/zstd-1.5.6~e14bb59e2e.pkg
        /var/cache/pkg/libfontenc-1.1.8.pkg
        /var/cache/pkg/brotli-1.1.0,1.pkg
        /var/cache/pkg/graphite2-1.3.14.pkg
        /var/cache/pkg/zstd-1.5.6.pkg
        /var/cache/pkg/libdeflate-1.20~1df5782c2a.pkg
        /var/cache/pkg/png-1.6.43.pkg
        /var/cache/pkg/fontconfig-2.15.0_2,1.pkg
        /var/cache/pkg/libXext-1.3.6,1~30005c79a9.pkg
        /var/cache/pkg/brotli-1.1.0,1~8e55295843.pkg
        /var/cache/pkg/freetype2-2.13.2.pkg
        /var/cache/pkg/jbigkit-2.1_2~4b5c73fda2.pkg
        /var/cache/pkg/giflib-5.2.2.pkg
        /var/cache/pkg/libXrender-0.9.10_2~020f4558f9.pkg
        /var/cache/pkg/graphite2-1.3.14~d2a11600d5.pkg
        /var/cache/pkg/alsa-lib-1.2.11~67ac8ae257.pkg
        /var/cache/pkg/png-1.6.43~e10fcb01ca.pkg
        /var/cache/pkg/lerc-4.0.0~c20e4a3f69.pkg
The cleanup will free 4 MiB
Deleting files: 100%
All done
+ [ -n '' ]
+ exit 0
root@OPNsense:/home/admin #


Thanks for the output. To me it looks normal in the sense that each opnsense-update command does exactly what it is supposed to do.

However, there seems to be a circular dependency between "pkg upgrade" and "pkg autoremove". Since it's not on the main mirror I'm not sure what causes it, but my guess is that the problem gets exaggerated when both mimugmail and sunnyvalley are plugged in. Try removing mimugmail for a moment to see if that helps...


Cheers,
Franco

Quote from: franco on August 19, 2024, 10:38:40 AM
Try removing mimugmail for a moment to see if that helps...

Since I'm an OPNsense and FreeBSD newbie I want to make sure that I'm doing that correctly. Isrm /usr/local/etc/pkg/repos/mimugmail.conf the correct shell command or do I need something else (or something more)?


I ran the command and immediately afterwards clicked the "Update" button in System: Firmware: Status. The output in the update tab looks okay:

***GOT REQUEST TO CHECK FOR UPDATES***
Currently running OPNsense 24.7.1 at Mon Aug 19 02:28:14 PDT 2024
Fetching changelog information, please wait... done
Updating OPNsense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: .......... done
Processing entries: .......... done
OPNsense repository update completed. 838 packages processed.
Updating SunnyValley repository catalogue...
Waiting for another process to update repository SunnyValley
All repositories are up to date.
Checking integrity... done (0 conflicting)
Your packages are up to date.
Checking for upgrades (2 candidates): .. done
Processing candidates (2 candidates): .. done
Checking integrity... done (0 conflicting)
Your packages are up to date.
***DONE***


So your suspicion of a bad interaction of the two repositories is indeed on the money. Is there any way to find the culprit? I'm happy to assist as much as I'm able to.

Hmm, I'm not sure when Michael did the last rebuild. Maybe package versions and dependencies have gone out of sync between the two. In that case a package rebuild is all it needs to stop acting weirdly.


Cheers,
Franco

Quote from: franco on August 19, 2024, 11:44:14 AM
Hmm, I'm not sure when Michael did the last rebuild. Maybe package versions and dependencies have gone out of sync between the two. In that case a package rebuild is all it needs to stop acting weirdly.

I filed an issue on Michael's github opn-repo to make him aware of this problem: https://github.com/mimugmail/opn-repo/issues/234

Please let me know, if there is anything else I can do.

Thanks and best regards,
Bernhard