Opnsense 26.7.5 hangs at boot

[QuisaZaderak]

I upgraded my OpnSense from latest 26.7.4_x to 26.7.5.
After couple of minutes after 26.7.5 upgrade it went unresponsive.
I rebooted with ctrl+alt+del, but now it hangs every time on following screen.
Second time soft rebooting same result.

Physical machine
AMD Ryzen 5700X with 16cores
ASRockRack X470D4U2-2T mainboard
32gb ram
2port Intel x550 (onboard)
4port Intel X710-T4L
4port Intel i350-T4 v2
256gb ssd

[newsense]

The attachment fails to load for me...

Where exactly does it die? Are you sure it doesn't continue after a while?

[QuisaZaderak]

I waited now for 45 Minutes and still the same line.

Configuring loopback interface .. 1o0: link state changed to UP
done.
Configuring kernel modules ... amdsmn0: <AMD Family 19h System Management Network> on hostb0
amdtemp0: <AMD Family 19h CPU On-Die Thermal Sensors> on hostb0
done
Setting up extended sysctls ... done.
Setting timezone: Europe/Berlin
Writing firmware settings:sh: opnsense-version: not found
Mirror ABI cannot be a subdirectory
OPNsense SunnyValley
Writing trust files. .. done.
sh: /usr/local/opnsense/scripts/system/certctl py: not found
Writing trust bundles ... done.
Setting hostname: OPNsense. ramses. internal
Generating /etc/resolv. conf ... done.
Generating /etc/hosts. . .done
Configuring system logging ... done
Configuring firewall . load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to accept, logging disabled
igb3: link state changed to UP
.


On the first reboot attempt it stopped 1 line earlier at ipfw2 line and then just a "dot"

[newsense]

Writing firmware settings:sh: opnsense-version: not found
Mirror ABI cannot be a subdirectory
OPNsense SunnyValley
Writing trust files. .. done.
sh: /usr/local/opnsense/scripts/system/certctl py: not found

Likely storage issues...

If you're on ZFS move to the previous snapshot, take another one for safety and try upgrading again.


Make sure there's enough space on disk too, maybe delete old snaps first 

[QuisaZaderak]

Unfortunately it is a very old installation which stated at OpnSense 19.x times without ZFS and was never reinstalled since, only upgraded.
All upgrades went smoothly since 7 years.

Any other options without ZFS?

[newsense]

Chances are it's the drive that needs replacement. Check out the smart data if you can...

Else you'll need the config file and whatever ZA recommendations are for a reinstall, and start from scratch

[QuisaZaderak]

SMART is status OK (from within BMC/UEFI).
I have password protected config backup with me.
Already downloading usb install image.

Where is a good reinstalltion guide documented?
And what kind of configurations are perhaps not backed up by the GUI backup feature?

[nero355]

SMART is status OK (from within BMC/UEFI).

Please simply boot a Linux or *BSD Live ISO from your favorite USB Stick and use 'smartctl -a /dev/<whatever>' to see the full S.M.A.R.T. output and post it here so we can double check for you before you reinstall :)

[newsense]

Where is a good reinstalltion guide documented?
And what kind of configurations are perhaps not backed up by the GUI backup feature?

1. Install on ZFS
2. Update ( do a minimal configuration to have internet access, it will be temporary)
3. Import configuration - machine will reboot
4. Check for updates - all official plugins will be reinstalled
   If using third party plugins you will need to add the repo manually and also the configuration file if you have it
5. One more reboot for everything to start properly

For ZA do your own research, I'm not using it.

[QuisaZaderak]

Please simply boot a Linux or *BSD Live ISO from your favorite USB Stick and use 'smartctl -a /dev/<whatever>' to see the full S.M.A.R.T. output and post it here so we can double check for you before you reinstall :)

I connected the Samsung Pro 830 SSD to my main pc and checked it with Samsung Magician, it says drive is OK, so I will reinstall on this drive.

[QuisaZaderak]

1. Install on ZFS
2. Update ( do a minimal configuration to have internet access, it will be temporary)
3. Import configuration - machine will reboot
4. Check for updates - all official plugins will be reinstalled
   If using third party plugins you will need to add the repo manually and also the configuration file if you have it
5. One more reboot for everything to start properly

For ZA do your own research, I'm not using it.

Reinstall was surprisingly smooth from usb drive. Installed 26.7 with ZFS file system. Nearly all configuration was restored/imported correctly (including Qfeed etc) and plugins were installed again. Update to 26.7.5 went through.
Only thing missing is ZA.

[pfry]

[...]the Samsung Pro 830 SSD[...]

Somewhat OT: Straight out of 2013. I have two in my current, waiting-to-be-retired DNS/web/mail server, running since 2014.

Reinstall was surprisingly smooth from usb drive.[...]

Nice.