unable to upgrade from 23.7.12_5 to 24.1

[genfoch01]

I attempted to upgrade from 23.7.12_5  to 24.1 but the upgrade crashes with an error with duckdb ??

I have always kept my firewall up to date so I'm not sure what this means.  How can i fix this ? What did I do wrong to get this error? 

I mean I can go to duckidb.org but I'm not sure how its being used with opnsense or how I would go about trying to import it into a new db since I'm guessing the new db version is part of the update so does not exist on my  23.7.12_5.   I'm not sure how to attack this problem.

any thoughts would be apricated!

GF

-----------   error message  -------------------

***GOT REQUEST TO UPGRADE***
Currently running OPNsense 23.7.12_5 at Tue Mar 19 16:43:04 EDT 2024
Fetching packages-24.1-amd64.tar: ... done
Fetching base-24.1-amd64.txz: ...................... done
Fetching kernel-24.1-amd64.txz: .......... done
Extracting packages-24.1-amd64.tar... done
Extracting base-24.1-amd64.txz... done
Extracting kernel-24.1-amd64.txz... done
Please reboot.
>>> Invoking upgrade script 'squid-plugin.php'
Squid web proxy is not active. Not installing replacement plugin.
>>> Invoking upgrade script 'unbound-duckdb.py'
Traceback (most recent call last):
  File "/usr/local/opnsense/site-python/duckdb_helper.py", line 65, in __enter__
    self.connection = duckdb.connect(database=self._path, read_only=self._read_only)
duckdb.IOException: IO Error: Trying to read a database file with version number 39, but we can only read version 51.
The database file was created with DuckDB version v0.6.0 or v0.6.1.

The storage of DuckDB is not yet stable; newer versions of DuckDB cannot read old database files and vice versa.
The storage will be stabilized when version 1.0 releases.

For now, we recommend that you load the database file in a supported version of DuckDB, and use the EXPORT DATABASE command followed by IMPORT DATABASE on the current version of DuckDB.

See the storage page for more information: https://duckdb.org/internals/storage

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/etc/rc.syshook.d/upgrade/20-unbound-duckdb.py", line 41, in <module>
    if export_database('/var/unbound/data/unbound.duckdb', '/var/cache/unbound.duckdb', 'unbound', 'unbound'):
  File "/usr/local/opnsense/site-python/duckdb_helper.py", line 147, in export_database
    with DbConnection(source, read_only=True) as db:
  File "/usr/local/opnsense/site-python/duckdb_helper.py", line 75, in __enter__
    raise StorageVersionException(str(e))
duckdb_helper.StorageVersionException: IO Error: Trying to read a database file with version number 39, but we can only read version 51.
The database file was created with DuckDB version v0.6.0 or v0.6.1.

The storage of DuckDB is not yet stable; newer versions of DuckDB cannot read old database files and vice versa.
The storage will be stabilized when version 1.0 releases.

For now, we recommend that you load the database file in a supported version of DuckDB, and use the EXPORT DATABASE command followed by IMPORT DATABASE on the current version of DuckDB.

See the storage page for more information: https://duckdb.org/internals/storage
>>> Error in upgrade script '20-unbound-duckdb.py'
***DONE***


-----------------------end message -------------------------------

[genfoch01]

well, I'm a bit disappointed no one was able to tell me how opnsense uses duckdb.  No I am not complaining about this forum or anyone who helps people on it. Just disappointed I got no response.  That said here is how I fixed my issue.

first I backed up the entire disk using DD then I backed up the configuration via the gui.
I then downloaded the older 23.7 installer and overwrote the original disk.

I set the wan/lan interfaces and set the lan ip  then upgraded from 23.7.x to 23.7.12_5
then I reapplied my configuration.
I had to manually reinstall my plugins but once installed the configs had been restored  (still need to test this)

once that was complete, I then ran the update to 24.1  which worked without issue.
then ran the update again to get to 24.1.6/freebsd 13.2-release-p11/opnssl 3.0.13

I'm not sure how the duckdb got messed up nor how opnsense uses it, but I hope this helps someone out if they end up with the same issue, I find it hard to believe I am the first person this has happened to.

-GF