OPNsense aarch64 firmware repository

[franco]

Yay. all the tags in place. Thanks for your work! 

[Maurice]

OPNsense 23.7.9 aarch64 packages and sets released.

[viumden]

Thanks for the awesome work!
I downloaded 23.7.9 image and it runs under proxmox arm64 with my RK3399 board!
But after a while I noticed below issue for Plugins I installed: it shows missing packages, and after doing the "Resolve Plugin Conficts> Run the automatic resolver", I got below error messages still:

Code: [Select]

***GOT REQUEST TO SYNC***
Currently running OPNsense 23.7.9 at Wed Nov 29 17:39:57 CST 2023
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 1  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libyaml' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libyaml' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'openssl111' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'openssl111' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libffi' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 6  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 6  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libffi' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libedit' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing SELECT p.name, p.origin, p.version, 0  FROM packages AS p    INNER JOIN deps AS d ON (p.id = d.package_id)  WHERE d.name = 'libedit' in file pkgdb_iterator.c:412: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 15  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 15  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing END TRANSACTION; in file pkgdb.c:2333: database disk image is malformed
Checking integrity...pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 6  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
Assertion failed: (p != NULL), function pkg_conflicts_check_local_path, file pkg_jobs_conflicts.c, line 313.
Child process pid=19708 terminated abnormally: Abort trap
Updating OPNsense repository catalogue...
OPNsense repository is up to date.
All repositories are up to date.
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 1  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing END TRANSACTION; in file pkgdb.c:2333: database disk image is malformed
Checking integrity... done (0 conflicting)
The following 2 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
os-wireguard: 2.5_1
wireguard-kmod: 0.0.20220615_1

Number of packages to be installed: 2
[1/2] Installing wireguard-kmod-0.0.20220615_1...
pkg: sqlite error while executing INSERT OR REPLACE INTO packages( origin, name, version, comment, desc, message, arch, maintainer, www, prefix, flatsize, automatic, licenselogic, time, manifestdigest, dep_formula, vital)VALUES( 'net/wireguard-kmod', 'wireguard-kmod', '0.0.20220615_1', 'WireGuard implementation for the FreeBSD kernel', 'Kernel module for FreeBSD to support Wireguard.

At this time this code is new, unvetted, possibly buggy, and should be
considered "experimental". It might contain security issues. We gladly
welcome your testing and bug reports, but do keep in mind that this code
is new, so some caution should be exercised at the moment for using it
in mission critical environments.', '[{"message":"At this time this code is new, unvetted, possibly buggy, and should be\nconsidered \"experimental\". It might contain security issues. We gladly\nwelcome your testing and bug reports, but do keep in mind that this code\nis new, so some caution should be exercised at the moment for using it\nin mission critical environments.","type":"install"},{"message":"===>   NOTICE:\n\nThis port is deprecated; you may wish to reconsider installing it:\n\nOnly useful for FreeBSD 12 which is EoL soon.\n\nIt is scheduled to be removed on or after 2023-12-31."}]', 'FreeBSD:13:aarch64', 'decke@FreeBSD.org', 'https://git.zx2c4.com/wireguard-freebsd/', '/usr/local', 104803, 1, 1, NOW(), '2$2$yerp9xs6t9umh3ajk8pthp1ozapwaj9xse4a5gsp3tthgnrffxb99nka6738xqa4usgnyc4yq6rg51csew6ixu6pcujaawgui5kfmcb', NULL, 0 ) in file pkgdb.c:1633: database disk image is malformed
pkg: sqlite error while executing iterator in file pkgdb_iterator.c:1110: database disk image is malformed
pkg: sqlite error while executing SELECT k.annotation AS tag, v.annotation AS value  FROM pkg_annotation p    JOIN annotation k ON (p.tag_id = k.annotation_id)    JOIN annotation v ON (p.value_id = v.annotation_id)  WHERE p.package_id = 2  ORDER BY tag, value in file pkgdb_iterator.c:198: database disk image is malformed
pkg: sqlite error while executing END TRANSACTION; in file pkgdb.c:2333: database disk image is malformed
Checking integrity... done (0 conflicting)
Nothing to do.
***DONE***Any idea how to fix it?

[Maurice]

Not sure what's going on there. Wild guess: Disk image full? Did you expand it before first boot?

Cheers
Maurice

[viumden]

Not sure what's going on there. Wild guess: Disk image full? Did you expand it before first boot?

Cheers
Maurice

I deleted the sqlite file (/var/db/pkg/local.sqlite), then did an auto fix in webui, it seems then things get fixed.

But I have another confusing issue under proxmox for wan configuration, the lan seems work, while the wan cannot get DHCP ip address from upstream gateway:
1. I have only 1 ethernet port on my rockpi 4b (rk3399) board, so I created vlan aware vmbr0 in proxmox with parent port eth0 (the only ethernet port).
2. Then I created 2 virtio virtual nics for latest opnsense img virtual machine, one is just with pure vmbr0, the other one is with vlan tag = 10 on vmbr0, two nics have separate random mac address.
3. Both 2 nics appeared in opnsense, the one without vlan tag is vtnet0 and assigned to wan, while the one with vlan tag = 10 is vtnet1 and assigned to lan.
I messed around with all the configurations for a long time, just cannot get wan interface work with DHCP IP assinged from upstream gateway, by monitoring wan port on opnsense, I can see there is DHCP request sent, but no response received, and the strange thing is that when I changed the virtio to e1000 for the wan nic on proxmox, then restart the opnsense, then the DHCP assignment from upstream just worked...
Don't understand the reason here, maybe opnsense doesn't support to virtio nics in parallel, or there is something wrong in my proxmox settings?

[Maurice]

This doesn't seem to be a question specifically about OPNsense aarch64. Please look for threads about Proxmox or start a new one.

[viumden]

This doesn't seem to be a question specifically about OPNsense aarch64. Please look for threads about Proxmox or start a new one.

I guess it is somehow relevant to opnsense virtual version, since the same exact proxmox virtual nic configuration works well on a virtualized aarch64 openwrt, both wan and lab work as expected, there is no dhcp ip fetch issue on wan with virtio bridge, with lan working in parallel with another virtio bridge (vlan id = 10).
Not sure it is an opnsense aarch64 virtual version issue, or common for all virtualized aarch64 freebsd system.

[Maurice]

OPNsense 23.7.10 aarch64 packages and sets released. Includes hotfix 23.7.10_1.

[Update 2023-12-30]
openssh 9.6p1 released.

[Maurice]

OPNsense 23.7.11 aarch64 packages and sets released.

[Maurice]

OPNsense 23.7.12 aarch64 packages and sets released.

[Update 2024-01-30]
Hotfix 23.7.12_5 released.

[rdunkle84]

This is really good work!  I am now running on orange pi 5 plus.  There were no problems at all.

[Maurice]

Thanks for the feedback! And more good news:

OPNsense 24.1.r1 aarch64 packages and sets released.

If you want to test this release candidate, you can upgrade from 23.7.12:

opnsense-update -u -r 24.1.r1

My 24.1-aarch64 builds use a new signing key. The fingerprint is already included in 23.7.12. The new public key is:

Code: [Select]

-----BEGIN PUBLIC KEY-----
MIICIjANBgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAzMwX5pdTxFltQrLqv+rj
jictq2E0TqB3kCrsE4wZ2z7CxuXwqxNrv5Y/847MDWfycyPgxyZx5Iuu/5LapiT4
ilVXkx4hmrrdmpXYiUYgXpMXtRPtbYHIje0QN8YJI5lV1qFLErhkuhr5Ch1o3BYS
Schiq+f9D2/RQtgNp6wySV8wgsoE+71G1z4jJMNQK5Rhnz5s9LRtXLWepevsyYB2
nDBqtLIVckGvM/0ivZtTBj+AHkwRUoN5dBIXJigdU6VXnOJQMSWyNC7c1AwzEp5p
1vyKQVAcuK8Y8424SA1CgqxlKb/Z7s5SIn35DLuQd1JcoxYUKBvykzEJQksL6IsO
Of2KJcVn05l5YbyX3UorNam4De003Gx0UWRDFHRBzASVDktihfanWqyDvNty6/ob
yfhRj6rE9cAXKOYBkckTa0B/G4Fw1Qx2GX9oX6ZAqUphfmaBpBnGOt8nQ+8BxMtm
1J2kH4NQ3uOwxWJPkHx08JzPrAxhtFjjvSsQLYULEWM9yA/+nw3HyhDmOtTCbhMQ
o4qq5FV+g7T8g14jLx+ZkPA+W+ax+n46p3ujv2v4U3x5aZtBTGeBV7TadVwikqJ2
d5lSJU0O0F7pCYqwtPkOacK2w/BeYOwpLTXpBY5JlwC+f5kTKs/7gzc4FY3gfgGe
tsY4Z1KlXUh6KTBDhkKk2y0CAwEAAQ==
-----END PUBLIC KEY-----


[franco]

opnsense-update -u -r 24.1.r1

Keep in mind that upgrade sequence is not recommended for production use as it misses the pre-upgrade hook used by web proxy (squid) and unbound dns reporting (duckdb) migration scripts.


Cheers,
Franco

[Maurice]

Thanks for the heads-up, Franco!

I've successfully upgraded two systems, but neither of them use squid. Unbound DNS Reporting has indeed been reset, all entries before the upgrade are gone.

[franco]

I'm wondering what the best portable way is. I think at the moment the tooling requires /usr/local/etc/opnsense-update.conf to be set accordingly in order to use the console scripts (which don't support selecting an upgrade version in the menu for safety reasons).