Upgrade 23.7.3 -> 23.7.4 ERRORS

[gdur]

Just upgraded from 23.7.3 to 23.7.4 and following errors occurred:

>>> Invoking update script 'refresh'
*** OPNsense\OpenVPN\OpenVPN Migration failed, check log for details

Not clear in which log to look for details.
and from the Backend log:

2023-09-23T12:36:56   Error   configd.py   [0982ddac-13f7-4a49-9d4b-04b2649c4514] Script action failed with Command '/usr/local/opnsense/scripts/firmware/read.sh ' died with <Signals.SIGABRT: 6>. at Traceback (most recent call last): File "/usr/local/opnsense/service/modules/actions/script_output.py", line 44, in execute subprocess.check_call(script_command, env=self.config_environment, shell=True, File "/usr/local/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '/usr/local/opnsense/scripts/firmware/read.sh ' died with <Signals.SIGABRT: 6>.   
2023-09-23T12:35:40   Error   configd.py   Failed to connect to configd socket: while executing firmware status   
2023-09-23T12:35:30   Warning   configd.py   Stopping daemon.

Looks to me like something went wrong with a Python script related to OpenVPN migration error.
I've upgraded 2 servers and both show the same problem.
What to do???

[newsense]

Did everything come back as expected after a reboot ? Anything left to upgrade ? Did you do a health audit ?

[gdur]

Here are the worrying results of a health audit:

Checking packages: ............
hostapd-2.10_5 version mismatch, expected 2.10_8
Checking packages: .........
openssh-portable-9.3.p2,1 version mismatch, expected 9.3.p2_1,1
Checking packages: ..
opnsense-23.7.4 version mismatch, expected 23.7.5
Checking packages: .................
php82-phalcon-5.3.0 version mismatch, expected 5.3.1
Checking packages: .
php82-phpseclib-3.0.21 version mismatch, expected 3.0.23
Checking packages: ...........
py39-netaddr-0.8.0 version mismatch, expected 0.9.0
Checking packages: .............
suricata-6.0.13_1 version mismatch, expected 6.0.14
Checking packages: ...
wpa_supplicant-2.10_6 version mismatch, expected 2.10_9
Checking packages: . done

This was an OPNSense upgrade to version 23.7.4 and the health audit tells me it is expecting version 23.7.5()

How to proceed?

[newsense]

Check for updates again, post the full output here if seeing errors please

You should be landing on 23.7.5 now. Reboot after it's all done to have everything come up cleanly

[franco]

The health audit compares packages integrity to the latest release. It will show errors if you are not on it because that's what it is supposed to report.


Cheers,
Franco

[gdur]

Today I ran the upgrade to 23.7.5
Same error occurred.

>>> Invoking update script 'refresh'
*** OPNsense\OpenVPN\OpenVPN Migration failed, check log for details

and in the Backend log:

2023-09-27T12:47:45   Error   configd.py   Failed to connect to configd socket: while executing firmware status

Interesting observation from the heath audit:

***GOT REQUEST TO AUDIT HEALTH***
Currently running OPNsense 23.7.5 at Wed Sep 27 12:30:09 CEST 2023
>>> Check installed kernel version
Version 23.7.4 is correct.
>>> Check for missing or altered kernel files
No problems detected.

Specifically that version 23.7.5 is detected as running and than the statement that version 23.7.4 is correct().
This goes for both servers.
Systems seem to run fine however but I wonder what the issue is with OpenVPN. Any ideas?

[franco]

The OpenVPN migration error will not go away for sure... Can you post the system log error instead? You can force the issue by running:

# /usr/local/opnsense/mvc/script/run_migrations.php

23.7.4 base/kernel on 23.7.5 is correct as it states.


Cheers,
Franco

[gdur]

Hi Franco,
I executed the command "/usr/local/opnsense/mvc/script/run_migrations.php" in shell and the same error occurs which is obvious as the same error appeared during the upgrade.

root@OPNsense:~ # /usr/local/opnsense/mvc/script/run_migrations.php
*** OPNsense\OpenVPN\OpenVPN Migration failed, check log for details

These are the related general log entrees.

2023-09-27T16:18:00   Error   config   #2 {main} )   
2023-09-27T16:18:00   Error   config   #1 /usr/local/opnsense/mvc/script/run_migrations.php(54): OPNsense\Base\BaseModel->runMigrations()   
2023-09-27T16:18:00   Error   config   #0 /usr/local/opnsense/mvc/app/models/OPNsense/Base/BaseModel.php(710): OPNsense\Base\BaseModel->serializeToConfig()   
2023-09-27T16:18:00   Error   config   Stack trace:   
2023-09-27T16:18:00   Error   config   in /usr/local/opnsense/mvc/app/models/OPNsense/Base/BaseModel.php:586   
2023-09-27T16:18:00   Error   config   Model OPNsense\OpenVPN\OpenVPN can't be saved, skip ( OPNsense\Phalcon\Filter\Validation\Exception: [OPNsense\OpenVPN\OpenVPN:Overwrites.Overwrite.f15edaf9-5bba-4716-8d79-fd4d82a89263.servers] option not in list{1,7}   
2023-09-27T16:18:00   Error   config   [OPNsense\OpenVPN\OpenVPN:Overwrites.Overwrite.f15edaf9-5bba-4716-8d79-fd4d82a89263.servers] option not in list{1,7}

23.7.4 base/kernel on 23.7.5 is correct as it states. but this is a confusing message...

[gdur]

No suggestions as yet?

[newsense]

You have something unusual in your settings it seems, unsure what it is. You could try taking a backup of your config, deleting and recreating the OpenVPN - so any potential garbage is removed.

The other option is to open a ticket on GH with more details about what makes your configuration special to a point it throws that error.

[gdur]

I don't think there is something special about my OpenVPN settings and it has been functioning fine for at least 4 years. The only thing I can recall is that after the upgrade to 23.7.1_3 and that fixed IP addresses were lost due to the upgrade. See https://forum.opnsense.org/index.php?topic=35447.0.
On the other hand OpenVPN seems to work fine.
I could try to remove and recreate OpenVPN at some point but don't have time now to do so.
What is GH is I may ask?

[newsense]

GH is Github

[gdur]

Aha, I should have known...but thanks anyway!!!