Upgrade from 22.4_2 to 22.4.1 stuck on DEC3860

[franco]

I think your hard disk is playing tricks on you or slowly dying. It's either missing the "pf" kernel module or the script to load it on boot.. which is... odd... a health check would definitely reveal an issue.

Additionally can you list the files inside the directory where the stray "#!/usr/local/bin/php" is supposed to be coming from:

# ls -lah /usr/local/etc/rc.syshook.d/update

There is a bad script in there we don't have...


Cheers,
Franco

[Mbl]

Hope we're not having a hard disk issue here. The DEC3860 is from March 2021. So just litte over one year old (jung)...

Looks like the file "10-refresh" is readable and executable:

Code Select Expand

root@firewall:~ # cd /usr/local/etc/rc.syshook.d/
root@firewall:/usr/local/etc/rc.syshook.d # ll
total 28
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 backup/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 carp/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 early/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 monitor/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 start/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 stop/
drwxr-xr-x  2 root  wheel  512 Jul 13 08:30 update/
root@firewall:/usr/local/etc/rc.syshook.d # cd update/
root@firewall:/usr/local/etc/rc.syshook.d/update # ll
total 4
-rwxr-xr-x  1 root  wheel  351 Jul  6 15:42 10-refresh*
root@firewall:/usr/local/etc/rc.syshook.d/update # more 10-refresh
#!/bin/sh

# refresh relevant configuration files
/usr/local/etc/rc.configure_firmware

# create a unique timestamp for our asset caching
touch /usr/local/opnsense/www/index.php

# remove spurious .pkgsave files pkg may have created
for DIR in /boot /usr/libexec/bsdinstall /usr/local; do
        daemon -f find ${DIR} -type f -name "*.pkgsave" -delete
done
root@firewall:/usr/local/etc/rc.syshook.d/update # ./10-refresh
#!/usr/local/bin/php
Writing firmware setting...done.
Writing trust files...done.
Configuring login behaviour...done.
Configuring system logging...done.
root@firewall:/usr/local/etc/rc.syshook.d/update #



Healt check is giving the following output:

Code Select Expand

***GOT REQUEST TO AUDIT HEALTH***
Currently running OPNsense 22.4.2 (amd64/OpenSSL) at Wed Jul 13 12:26:36 CEST 2022
>>> Check installed kernel version
Version 22.1.9 is correct.
>>> Check for missing or altered kernel files
Error 2 ocurred.
boot/kernel/if_cxgbev.ko:
permissions (0555, 0550)
boot/kernel/linker.hints:
size (375104, 151924)
sha256digest (0xbc72238d15ac7afba505851dd89b7c301ba39bb39e463c48f4469074e4c0f957, 0xddce5690cf5a9c5acc319dabe7284ea914fe0f867420f6657adbe3bf8727dea4)
./boot/kernel/ads111x.ko missing
./boot/kernel/alias_dummy.ko missing
./boot/kernel/alias_ftp.ko missing
./boot/kernel/alias_irc.ko missing
./boot/kernel/alias_nbt.ko missing
./boot/kernel/alias_pptp.ko missing
./boot/kernel/alias_skinny.ko missing
./boot/kernel/alias_smedia.ko missing
./boot/kernel/alpm.ko missing
./boot/kernel/amdpm.ko missing
./boot/kernel/amdsmb.ko missing
./boot/kernel/at45d.ko missing
./boot/kernel/atp.ko missing
./boot/kernel/beastie_saver.ko missing
./boot/kernel/blank_saver.ko missing
./boot/kernel/ccr.ko missing
./boot/kernel/cfumass.ko missing
./boot/kernel/cp2112.ko missing
./boot/kernel/cxgbei.ko missing
./boot/kernel/cyapa.ko missing
./boot/kernel/daemon_saver.ko missing
./boot/kernel/dcons.ko missing
./boot/kernel/dcons_crom.ko missing
./boot/kernel/dpms.ko missing
./boot/kernel/dragon_saver.ko missing
./boot/kernel/ds1307.ko missing
./boot/kernel/ds13rtc.ko missing
./boot/kernel/ds1672.ko missing
./boot/kernel/ds3231.ko missing
./boot/kernel/dtaudit.ko missing
./boot/kernel/dtmalloc.ko missing
./boot/kernel/dtnfscl.ko missing
./boot/kernel/dtrace.ko missing
./boot/kernel/dtrace_test.ko missing
./boot/kernel/dtraceall.ko missing
./boot/kernel/dummynet.ko missing
./boot/kernel/efirt.ko missing
./boot/kernel/ehci.ko missing
./boot/kernel/esp.ko missing
./boot/kernel/evdev.ko missing
./boot/kernel/exca.ko missing
./boot/kernel/ext2fs.ko missing
./boot/kernel/fade_saver.ko missing
./boot/kernel/fasttrap.ko missing
./boot/kernel/fbt.ko missing
./boot/kernel/fdc.ko missing
./boot/kernel/fdescfs.ko missing
./boot/kernel/filemon.ko missing
./boot/kernel/fire_saver.ko missing
./boot/kernel/firewire.ko missing
./boot/kernel/firmware.ko missing
./boot/kernel/ftwd.ko missing
./boot/kernel/fusefs.ko missing
./boot/kernel/g_audio.ko missing
./boot/kernel/g_keyboard.ko missing
./boot/kernel/g_modem.ko missing
./boot/kernel/g_mouse.ko missing
./boot/kernel/geom_bde.ko missing
./boot/kernel/geom_cache.ko missing
./boot/kernel/geom_ccd.ko missing
./boot/kernel/geom_concat.ko missing
./boot/kernel/geom_eli.ko missing
./boot/kernel/geom_flashmap.ko missing
./boot/kernel/geom_gate.ko missing
./boot/kernel/geom_journal.ko missing
./boot/kernel/geom_label.ko missing
./boot/kernel/geom_linux_lvm.ko missing
./boot/kernel/geom_md.ko missing
./boot/kernel/geom_mirror.ko missing
./boot/kernel/geom_mountver.ko missing
./boot/kernel/geom_multipath.ko missing
./boot/kernel/geom_nop.ko missing
./boot/kernel/geom_part_apm.ko missing
./boot/kernel/geom_part_bsd.ko missing
./boot/kernel/geom_part_bsd64.ko missing
./boot/kernel/geom_part_ebr.ko missing
./boot/kernel/geom_part_gpt.ko missing
./boot/kernel/geom_part_ldm.ko missing
./boot/kernel/geom_part_mbr.ko missing
./boot/kernel/geom_part_vtoc8.ko missing
./boot/kernel/geom_raid.ko missing
./boot/kernel/geom_raid3.ko missing
./boot/kernel/geom_shsec.ko missing
./boot/kernel/geom_stripe.ko missing
./boot/kernel/geom_uzip.ko missing
./boot/kernel/geom_vinum.ko missing
./boot/kernel/geom_virstor.ko missing
./boot/kernel/geom_zero.ko missing
./boot/kernel/gpiobus.ko missing
./boot/kernel/gpioiic.ko missing
./boot/kernel/gpioled.ko missing
./boot/kernel/gpiospi.ko missing
./boot/kernel/gpioths.ko missing
./boot/kernel/green_saver.ko missing
./boot/kernel/h_ertt.ko missing
./boot/kernel/hconf.ko missing
./boot/kernel/hcons.ko missing
./boot/kernel/hgame.ko missing
./boot/kernel/hid.ko missing
./boot/kernel/hidbus.ko missing
./boot/kernel/hidmap.ko missing
./boot/kernel/hidquirk.ko missing
./boot/kernel/hidraw.ko missing
./boot/kernel/hifn.ko missing
./boot/kernel/hkbd.ko missing
./boot/kernel/hms.ko missing
./boot/kernel/hmt.ko missing
./boot/kernel/hpen.ko missing
./boot/kernel/hptiop.ko missing
./boot/kernel/hsctrl.ko missing
./boot/kernel/htu21.ko missing
./boot/kernel/hv_netvsc.ko missing
./boot/kernel/hv_sock.ko missing
./boot/kernel/hv_storvsc.ko missing
./boot/kernel/hv_utils.ko missing
./boot/kernel/hv_vmbus.ko missing
./boot/kernel/hwpmc.ko missing
./boot/kernel/ice_ddp.ko missing
./boot/kernel/icee.ko missing
./boot/kernel/ichsmb.ko missing
./boot/kernel/ichwd.ko missing
./boot/kernel/ida.ko missing
./boot/kernel/if_aue.ko missing
./boot/kernel/if_axe.ko missing
./boot/kernel/if_axge.ko missing
./boot/kernel/if_bridge.ko missing
./boot/kernel/if_ccv.ko missing
./boot/kernel/if_cdce.ko missing
./boot/kernel/if_cdceem.ko missing
./boot/kernel/if_cue.ko missing
./boot/kernel/if_cxlv.ko missing
./boot/kernel/if_dc.ko missing
./boot/kernel/if_disc.ko missing
./boot/kernel/if_edsc.ko missing
./boot/kernel/if_em.ko missing
./boot/kernel/if_ena.ko missing
./boot/kernel/if_enc.ko missing
./boot/kernel/if_epair.ko missing
./boot/kernel/if_et.ko missing
./boot/kernel/if_fwe.ko missing
./boot/kernel/if_fwip.ko missing
./boot/kernel/if_fxp.ko missing
./boot/kernel/if_gem.ko missing
./boot/kernel/if_gif.ko missing
./boot/kernel/if_gre.ko missing
./boot/kernel/if_iavf.ko missing
./boot/kernel/if_ic.ko missing
./boot/kernel/if_ice.ko missing
./boot/kernel/if_igb.ko missing
./boot/kernel/if_igc.ko missing
./boot/kernel/if_infiniband.ko missing
./boot/kernel/if_ipheth.ko missing
./boot/kernel/if_ipw.ko missing
./boot/kernel/if_iwi.ko missing
./boot/kernel/if_iwlwifi.ko missing
./boot/kernel/if_iwm.ko missing
./boot/kernel/if_iwn.ko missing
./boot/kernel/if_ix.ko missing
./boot/kernel/if_ixl.ko missing
./boot/kernel/if_ixlv.ko missing
./boot/kernel/if_ixv.ko missing
./boot/kernel/if_jme.ko missing
./boot/kernel/if_kue.ko missing
./boot/kernel/if_lagg.ko missing
./boot/kernel/if_le.ko missing
./boot/kernel/if_lge.ko missing
./boot/kernel/if_lio.ko missing
./boot/kernel/if_malo.ko missing
./boot/kernel/if_me.ko missing
./boot/kernel/if_mos.ko missing
./boot/kernel/if_msk.ko missing
./boot/kernel/if_muge.ko missing
./boot/kernel/if_mwl.ko missing
./boot/kernel/if_mxge.ko missing
./boot/kernel/if_my.ko missing
./boot/kernel/if_ndis.ko missing
./boot/kernel/if_nfe.ko missing
./boot/kernel/if_nge.ko missing
./boot/kernel/if_ntb.ko missing
./boot/kernel/if_oce.ko missing
./boot/kernel/if_otus.ko missing
./boot/kernel/if_qlnxe.ko missing
./boot/kernel/if_qlnxev.ko missing
./boot/kernel/if_qlxgb.ko missing
./boot/kernel/if_qlxgbe.ko missing
./boot/kernel/if_qlxge.ko missing
./boot/kernel/if_ral.ko missing
./boot/kernel/if_re.ko missing
./boot/kernel/if_rl.ko missing
./boot/kernel/if_rsu.ko missing
./boot/kernel/if_rtwn_pci.ko missing
./boot/kernel/if_rtwn_usb.ko missing
./boot/kernel/if_rue.ko missing
./boot/kernel/if_rum.ko missing
./boot/kernel/if_run.ko missing
./boot/kernel/if_sge.ko missing
./boot/kernel/if_sis.ko missing
./boot/kernel/if_sk.ko missing
./boot/kernel/if_smsc.ko missing
./boot/kernel/if_ste.ko missing
./boot/kernel/if_stf.ko missing
./boot/kernel/if_stge.ko missing
./boot/kernel/if_sume.ko missing
./boot/kernel/if_ti.ko missing
./boot/kernel/if_tuntap.ko missing
./boot/kernel/if_uath.ko missing
./boot/kernel/if_udav.ko missing
./boot/kernel/if_upgt.ko missing
./boot/kernel/if_ural.ko missing
./boot/kernel/if_ure.ko missing
./boot/kernel/if_urndis.ko missing
./boot/kernel/if_urtw.ko missing
./boot/kernel/if_vge.ko missing
./boot/kernel/if_vlan.ko missing
./boot/kernel/if_vmx.ko missing
./boot/kernel/if_vr.ko missing
./boot/kernel/if_vte.ko missing
./boot/kernel/if_vtnet.ko missing
./boot/kernel/if_vxlan.ko missing
./boot/kernel/if_wpi.ko missing
./boot/kernel/if_xl.ko missing
./boot/kernel/if_zyd.ko missing
./boot/kernel/iflib.ko missing
./boot/kernel/ig4.ko missing
./boot/kernel/iic.ko missing
./boot/kernel/iicbb.ko missing
./boot/kernel/iicbus.ko missing
./boot/kernel/iichid.ko missing
./boot/kernel/iicmux.ko missing
./boot/kernel/iicsmb.ko missing
./boot/kernel/iir.ko missing
./boot/kernel/imcsmb.ko missing
./boot/kernel/imgact_binmisc.ko missing
./boot/kernel/intelspi.ko missing
./boot/kernel/intpm.ko missing
./boot/kernel/io.ko missing
./boot/kernel/ioat.ko missing
./boot/kernel/ip6_mroute.ko missing
./boot/kernel/ip_mroute.ko missing
./boot/kernel/ipdivert.ko missing
./boot/kernel/ipfw.ko missing
./boot/kernel/ipfw_nat.ko missing
./boot/kernel/ipfw_nat64.ko missing
./boot/kernel/ipfw_nptv6.ko missing
./boot/kernel/ipfw_pmod.ko missing
./boot/kernel/ipmi.ko missing
./boot/kernel/ipmi_linux.ko missing
./boot/kernel/ips.ko missing
./boot/kernel/ipsec.ko missing
./boot/kernel/ipw_bss.ko missing
./boot/kernel/ipw_ibss.ko missing
./boot/kernel/ipw_monitor.ko missing
./boot/kernel/isci.ko missing
./boot/kernel/iscsi.ko missing
./boot/kernel/iscsi_initiator.ko missing
./boot/kernel/isl.ko missing
./boot/kernel/isl12xx.ko missing
./boot/kernel/ismt.ko missing
./boot/kernel/isp.ko missing
./boot/kernel/isp_2400.ko missing
./boot/kernel/isp_2500.ko missing
./boot/kernel/ispfw.ko missing
./boot/kernel/itwd.ko missing
./boot/kernel/iwi_bss.ko missing
./boot/kernel/iwi_ibss.ko missing
./boot/kernel/iwi_monitor.ko missing
./boot/kernel/iwlwifi-3160-17.ucode.ko missing
./boot/kernel/iwlwifi-3168-29.ucode.ko missing
./boot/kernel/iwlwifi-7260-17.ucode.ko missing
./boot/kernel/iwlwifi-7265-17.ucode.ko missing
./boot/kernel/iwlwifi-7265D-29.ucode.ko missing
./boot/kernel/iwlwifi-8000C-36.ucode.ko missing
./boot/kernel/iwlwifi-8265-36.ucode.ko missing
./boot/kernel/iwlwifi-9000-pu-b0-jf-b0-46.ucode.ko missing
./boot/kernel/iwlwifi-9260-th-b0-jf-b0-46.ucode.ko missing
./boot/kernel/iwlwifi-Qu-b0-hr-b0-63.ucode.ko missing
./boot/kernel/iwlwifi-Qu-b0-jf-b0-63.ucode.ko missing
./boot/kernel/iwlwifi-Qu-c0-hr-b0-63.ucode.ko missing
./boot/kernel/iwlwifi-Qu-c0-jf-b0-63.ucode.ko missing
./boot/kernel/iwlwifi-QuZ-a0-hr-b0-67.ucode.ko missing
./boot/kernel/iwlwifi-QuZ-a0-jf-b0-63.ucode.ko missing
./boot/kernel/iwlwifi-cc-a0-67.ucode.ko missing
./boot/kernel/iwlwifi-so-a0-gf-a0-67.ucode.ko missing
./boot/kernel/iwlwifi-so-a0-gf4-a0-67.ucode.ko missing
./boot/kernel/iwlwifi-so-a0-hr-b0-64.ucode.ko missing
./boot/kernel/iwlwifi-so-a0-jf-b0-64.ucode.ko missing
./boot/kernel/iwlwifi-ty-a0-gf-a0-67.ucode.ko missing
./boot/kernel/iwlwifi-ty-a0-gf-a0.pnvm.ko missing
./boot/kernel/iwm3160fw.ko missing
./boot/kernel/iwm3168fw.ko missing
./boot/kernel/iwm7260fw.ko missing
./boot/kernel/iwm7265Dfw.ko missing
./boot/kernel/iwm7265fw.ko missing
./boot/kernel/iwm8000Cfw.ko missing
./boot/kernel/iwm8265fw.ko missing
./boot/kernel/iwm9000fw.ko missing
./boot/kernel/iwm9260fw.ko missing
./boot/kernel/iwn1000fw.ko missing
./boot/kernel/iwn100fw.ko missing
./boot/kernel/iwn105fw.ko missing
./boot/kernel/iwn135fw.ko missing
./boot/kernel/iwn2000fw.ko missing
./boot/kernel/iwn2030fw.ko missing
./boot/kernel/iwn4965fw.ko missing
./boot/kernel/iwn5000fw.ko missing
./boot/kernel/iwn5150fw.ko missing
./boot/kernel/iwn6000fw.ko missing
./boot/kernel/iwn6000g2afw.ko missing
./boot/kernel/iwn6000g2bfw.ko missing
./boot/kernel/iwn6050fw.ko missing
./boot/kernel/jedec_dimm.ko missing
./boot/kernel/kbdmux.ko missing
./boot/kernel/kgssapi.ko missing
./boot/kernel/kgssapi_krb5.ko missing
./boot/kernel/krpc.ko missing
./boot/kernel/ksyms.ko missing
./boot/kernel/ktls_ocf.ko missing
./boot/kernel/libalias.ko missing
./boot/kernel/libiconv.ko missing
./boot/kernel/libmchain.ko missing
./boot/kernel/lindebugfs.ko missing
./boot/kernel/linprocfs.ko missing
./boot/kernel/linsysfs.ko missing
./boot/kernel/linux.ko missing
./boot/kernel/linux64.ko missing
./boot/kernel/linux_common.ko missing
./boot/kernel/linuxkpi.ko missing
./boot/kernel/linuxkpi_wlan.ko missing
./boot/kernel/logo_saver.ko missing
./boot/kernel/lpbb.ko missing
./boot/kernel/lpt.ko missing
./boot/kernel/ltc430x.ko missing
./boot/kernel/mac_biba.ko missing
./boot/kernel/mac_bsdextended.ko missing
./boot/kernel/mac_ifoff.ko missing
./boot/kernel/mac_lomac.ko missing
./boot/kernel/mac_mls.ko missing
./boot/kernel/mac_none.ko missing
./boot/kernel/mac_ntpd.ko missing
./boot/kernel/mac_partition.ko missing
./boot/kernel/mac_portacl.ko missing
./boot/kernel/mac_priority.ko missing
./boot/kernel/mac_seeotheruids.ko missing
./boot/kernel/mac_stub.ko missing
./boot/kernel/mac_test.ko missing
./boot/kernel/max44009.ko missing
./boot/kernel/mdio.ko missing
./boot/kernel/mem.ko missing
./boot/kernel/mfi.ko missing
./boot/kernel/mfi_linux.ko missing
./boot/kernel/mfip.ko missing
./boot/kernel/miibus.ko missing
./boot/kernel/mlx.ko missing
./boot/kernel/mlx4.ko missing
./boot/kernel/mlx4en.ko missing
./boot/kernel/mlx5.ko missing
./boot/kernel/mlx5en.ko missing
./boot/kernel/mlxfw.ko missing
./boot/kernel/mly.ko missing
./boot/kernel/mmc.ko missing
./boot/kernel/mmcsd.ko missing
./boot/kernel/mpr.ko missing
./boot/kernel/mps.ko missing
./boot/kernel/mpt.ko missing
./boot/kernel/mqueuefs.ko missing
./boot/kernel/mrsas.ko missing
./boot/kernel/mrsas_linux.ko missing
./boot/kernel/msdosfs.ko missing
./boot/kernel/msdosfs_iconv.ko missing
./boot/kernel/mvs.ko missing
./boot/kernel/mw88W8363fw.ko missing
./boot/kernel/mx25l.ko missing
./boot/kernel/mxge_eth_z8e.ko missing
./boot/kernel/mxge_ethp_z8e.ko missing
./boot/kernel/mxge_rss_eth_z8e.ko missing
./boot/kernel/mxge_rss_ethp_z8e.ko missing
./boot/kernel/nctgpio.ko missing
./boot/kernel/ndis.ko missing
./boot/kernel/netgraph.ko missing
./boot/kernel/nfscl.ko missing
./boot/kernel/nfscommon.ko missing
./boot/kernel/nfsd.ko missing
./boot/kernel/nfslockd.ko missing
./boot/kernel/nfsmb.ko missing
./boot/kernel/nfssvc.ko missing
./boot/kernel/ng_UI.ko missing
./boot/kernel/ng_async.ko missing
./boot/kernel/ng_atmllc.ko missing
./boot/kernel/ng_bluetooth.ko missing
./boot/kernel/ng_bpf.ko missing
./boot/kernel/ng_bridge.ko missing
./boot/kernel/ng_btsocket.ko missing
./boot/kernel/ng_car.ko missing
./boot/kernel/ng_ccatm.ko missing
./boot/kernel/ng_checksum.ko missing
./boot/kernel/ng_cisco.ko missing
./boot/kernel/ng_deflate.ko missing
./boot/kernel/ng_device.ko missing
./boot/kernel/ng_echo.ko missing
./boot/kernel/ng_eiface.ko missing
./boot/kernel/ng_etf.ko missing
./boot/kernel/ng_ether.ko missing
./boot/kernel/ng_ether_echo.ko missing
./boot/kernel/ng_frame_relay.ko missing
./boot/kernel/ng_gif.ko missing
./boot/kernel/ng_gif_demux.ko missing
./boot/kernel/ng_hci.ko missing
./boot/kernel/ng_hole.ko missing
./boot/kernel/ng_hub.ko missing
./boot/kernel/ng_iface.ko missing
./boot/kernel/ng_ip_input.ko missing
./boot/kernel/ng_ipfw.ko missing
./boot/kernel/ng_ksocket.ko missing
./boot/kernel/ng_l2cap.ko missing
./boot/kernel/ng_l2tp.ko missing
./boot/kernel/ng_lmi.ko missing
./boot/kernel/ng_macfilter.ko missing
./boot/kernel/ng_mppc.ko missing
./boot/kernel/ng_nat.ko missing
./boot/kernel/ng_netflow.ko missing
./boot/kernel/ng_one2many.ko missing
./boot/kernel/ng_patch.ko missing
./boot/kernel/ng_pipe.ko missing
./boot/kernel/ng_ppp.ko missing
./boot/kernel/ng_pppoe.ko missing
./boot/kernel/ng_pptpgre.ko missing
./boot/kernel/ng_pred1.ko missing
./boot/kernel/ng_rfc1490.ko missing
./boot/kernel/ng_socket.ko missing
./boot/kernel/ng_source.ko missing
./boot/kernel/ng_split.ko missing
./boot/kernel/ng_sppp.ko missing
./boot/kernel/ng_sscfu.ko missing
./boot/kernel/ng_sscop.ko missing
./boot/kernel/ng_tag.ko missing
./boot/kernel/ng_tcpmss.ko missing
./boot/kernel/ng_tee.ko missing
./boot/kernel/ng_tty.ko missing
./boot/kernel/ng_ubt.ko missing
./boot/kernel/ng_uni.ko missing
./boot/kernel/ng_vjc.ko missing
./boot/kernel/ng_vlan.ko missing
./boot/kernel/ng_vlan_rotate.ko missing
./boot/kernel/ngatmbase.ko missing
./boot/kernel/nmdm.ko missing
./boot/kernel/ntb.ko missing
./boot/kernel/ntb_hw_amd.ko missing
./boot/kernel/ntb_hw_intel.ko missing
./boot/kernel/ntb_hw_plx.ko missing
./boot/kernel/ntb_tool.ko missing
./boot/kernel/ntb_transport.ko missing
./boot/kernel/nullfs.ko missing
./boot/kernel/nvd.ko missing
./boot/kernel/nvdimm.ko missing
./boot/kernel/nvme.ko missing
./boot/kernel/nvram.ko missing
./boot/kernel/nxprtc.ko missing
./boot/kernel/ocs_fc.ko missing
./boot/kernel/ohci.ko missing
./boot/kernel/opensolaris.ko missing
./boot/kernel/ossl.ko missing
./boot/kernel/otusfw_init.ko missing
./boot/kernel/otusfw_main.ko missing
./boot/kernel/ow.ko missing
./boot/kernel/ow_temp.ko missing
./boot/kernel/owc.ko missing
./boot/kernel/padlock.ko missing
./boot/kernel/padlock_rng.ko missing
./boot/kernel/pca954x.ko missing
./boot/kernel/pccard.ko missing
./boot/kernel/pcf.ko missing
./boot/kernel/pcf8574.ko missing
./boot/kernel/pcf8591.ko missing
./boot/kernel/pchtherm.ko missing
./boot/kernel/pf.ko missing
./boot/kernel/pflog.ko missing
./boot/kernel/pfsync.ko missing
./boot/kernel/plasma_saver.ko missing
./boot/kernel/plip.ko missing
./boot/kernel/pmspcv.ko missing
./boot/kernel/ppbus.ko missing
./boot/kernel/ppc.ko missing
./boot/kernel/ppi.ko missing
./boot/kernel/pps.ko missing
./boot/kernel/procfs.ko missing
./boot/kernel/profile.ko missing
./boot/kernel/proto.ko missing
./boot/kernel/prototype.ko missing
./boot/kernel/ps4dshock.ko missing
./boot/kernel/pseudofs.ko missing
./boot/kernel/pty.ko missing
./boot/kernel/puc.ko missing
./boot/kernel/pvscsi.ko missing
./boot/kernel/pwmbus.ko missing
./boot/kernel/pwmc.ko missing
./boot/kernel/qat.ko missing
./boot/kernel/qat_c2xxxfw.ko missing
./boot/kernel/qat_c3xxxfw.ko missing
./boot/kernel/qat_c62xfw.ko missing
./boot/kernel/qat_d15xxfw.ko missing
./boot/kernel/qat_dh895xccfw.ko missing
./boot/kernel/qlnxr.ko missing
./boot/kernel/rain_saver.ko missing
./boot/kernel/random_OTHER.ko missing
./boot/kernel/random_fortuna.ko missing
./boot/kernel/rc4.ko missing
./boot/kernel/rdrand_rng.ko missing
./boot/kernel/rsu-rtl8712fw.ko missing
./boot/kernel/rt2561fw.ko missing
./boot/kernel/rt2561sfw.ko missing
./boot/kernel/rt2661fw.ko missing
./boot/kernel/rt2860fw.ko missing
./boot/kernel/rtc8583.ko missing
./boot/kernel/rtsx.ko missing
./boot/kernel/rtwn-rtl8188eefw.ko missing
./boot/kernel/rtwn-rtl8188eufw.ko missing
./boot/kernel/rtwn-rtl8192cfwE.ko missing
./boot/kernel/rtwn-rtl8192cfwE_B.ko missing
./boot/kernel/rtwn-rtl8192cfwT.ko missing
./boot/kernel/rtwn-rtl8192cfwU.ko missing
./boot/kernel/rtwn-rtl8192eufw.ko missing
./boot/kernel/rtwn-rtl8812aufw.ko missing
./boot/kernel/rtwn-rtl8821aufw.ko missing
./boot/kernel/rtwn.ko missing
./boot/kernel/runfw.ko missing
./boot/kernel/s3.ko missing
./boot/kernel/s35390a.ko missing
./boot/kernel/safe.ko missing
./boot/kernel/safexcel.ko missing
./boot/kernel/sbp.ko missing
./boot/kernel/sbp_targ.ko missing
./boot/kernel/scc.ko missing
./boot/kernel/sctp.ko missing
./boot/kernel/sdhci.ko missing
./boot/kernel/sdhci_acpi.ko missing
./boot/kernel/sdhci_pci.ko missing
./boot/kernel/sdio.ko missing
./boot/kernel/sdt.ko missing
./boot/kernel/sem.ko missing
./boot/kernel/send.ko missing
./boot/kernel/sfxge.ko missing
./boot/kernel/sgx.ko missing
./boot/kernel/sgx_linux.ko missing
./boot/kernel/siftr.ko missing
./boot/kernel/siis.ko missing
./boot/kernel/smartpqi.ko missing
./boot/kernel/smb.ko missing
./boot/kernel/smbfs.ko missing
./boot/kernel/smbus.ko missing
./boot/kernel/snake_saver.ko missing
./boot/kernel/snd_ad1816.ko missing
./boot/kernel/snd_als4000.ko missing
./boot/kernel/snd_atiixp.ko missing
./boot/kernel/snd_cmi.ko missing
./boot/kernel/snd_cs4281.ko missing
./boot/kernel/snd_csa.ko missing
./boot/kernel/snd_driver.ko missing
./boot/kernel/snd_ds1.ko missing
./boot/kernel/snd_emu10k1.ko missing
./boot/kernel/snd_emu10kx.ko missing
./boot/kernel/snd_envy24.ko missing
./boot/kernel/snd_envy24ht.ko missing
./boot/kernel/snd_es137x.ko missing
./boot/kernel/snd_ess.ko missing
./boot/kernel/snd_fm801.ko missing
./boot/kernel/snd_hda.ko missing
./boot/kernel/snd_hdspe.ko missing
./boot/kernel/snd_ich.ko missing
./boot/kernel/snd_maestro.ko missing
./boot/kernel/snd_maestro3.ko missing
./boot/kernel/snd_mss.ko missing
./boot/kernel/snd_neomagic.ko missing
./boot/kernel/snd_sb16.ko missing
./boot/kernel/snd_sb8.ko missing
./boot/kernel/snd_sbc.ko missing
./boot/kernel/snd_solo.ko missing
./boot/kernel/snd_spicds.ko missing
./boot/kernel/snd_t4dwave.ko missing
./boot/kernel/snd_uaudio.ko missing
./boot/kernel/snd_via8233.ko missing
./boot/kernel/snd_via82c686.ko missing
./boot/kernel/snd_vibes.ko missing
./boot/kernel/snp.ko missing
./boot/kernel/sound.ko missing
./boot/kernel/speaker.ko missing
./boot/kernel/spibus.ko missing
./boot/kernel/spigen.ko missing
./boot/kernel/splash_bmp.ko missing
./boot/kernel/splash_pcx.ko missing
./boot/kernel/splash_txt.ko missing
./boot/kernel/sppp.ko missing
./boot/kernel/star_saver.ko missing
./boot/kernel/superio.ko missing
./boot/kernel/sym.ko missing
./boot/kernel/systrace.ko missing
./boot/kernel/systrace_freebsd32.ko missing
./boot/kernel/systrace_linux.ko missing
./boot/kernel/systrace_linux32.ko missing
./boot/kernel/sysvmsg.ko missing
./boot/kernel/sysvsem.ko missing
./boot/kernel/sysvshm.ko missing
./boot/kernel/t4_tom.ko missing
./boot/kernel/t4fw_cfg.ko missing
./boot/kernel/t5fw_cfg.ko missing
./boot/kernel/t6fw_cfg.ko missing
./boot/kernel/tmpfs.ko missing
./boot/kernel/toecore.ko missing
./boot/kernel/tpm.ko missing
./boot/kernel/twa.ko missing
./boot/kernel/twe.ko missing
./boot/kernel/tws.ko missing
./boot/kernel/u3g.ko missing
./boot/kernel/uacpi.ko missing
./boot/kernel/uark.ko missing
./boot/kernel/uart.ko missing
./boot/kernel/ubsa.ko missing
./boot/kernel/ubser.ko missing
./boot/kernel/ubtbcmfw.ko missing
./boot/kernel/uchcom.ko missing
./boot/kernel/ucom.ko missing
./boot/kernel/ucycom.ko missing
./boot/kernel/udbp.ko missing
./boot/kernel/udf.ko missing
./boot/kernel/udf_iconv.ko missing
./boot/kernel/udl.ko missing
./boot/kernel/uep.ko missing
./boot/kernel/uether.ko missing
./boot/kernel/ufoma.ko missing
./boot/kernel/ufs.ko missing
./boot/kernel/uftdi.ko missing
./boot/kernel/ugensa.ko missing
./boot/kernel/ugold.ko missing
./boot/kernel/uhci.ko missing
./boot/kernel/uhid.ko missing
./boot/kernel/uhid_snes.ko missing
./boot/kernel/uhso.ko missing
./boot/kernel/uinput.ko missing
./boot/kernel/uipaq.ko missing
./boot/kernel/ukbd.ko missing
./boot/kernel/uled.ko missing
./boot/kernel/ulpt.ko missing
./boot/kernel/umass.ko missing
./boot/kernel/umcs.ko missing
./boot/kernel/umct.ko missing
./boot/kernel/umodem.ko missing
./boot/kernel/umoscom.ko missing
./boot/kernel/ums.ko missing
./boot/kernel/unionfs.ko missing
./boot/kernel/uplcom.ko missing
./boot/kernel/urio.ko missing
./boot/kernel/usb.ko missing
./boot/kernel/usb_quirk.ko missing
./boot/kernel/usb_template.ko missing
./boot/kernel/usbhid.ko missing
./boot/kernel/usfs.ko missing
./boot/kernel/usie.ko missing
./boot/kernel/uslcom.ko missing
./boot/kernel/uvisor.ko missing
./boot/kernel/uvscom.ko missing
./boot/kernel/vesa.ko missing
./boot/kernel/viapm.ko missing
./boot/kernel/viawd.ko missing
./boot/kernel/videomode.ko missing
./boot/kernel/virtio.ko missing
./boot/kernel/virtio_balloon.ko missing
./boot/kernel/virtio_blk.ko missing
./boot/kernel/virtio_console.ko missing
./boot/kernel/virtio_pci.ko missing
./boot/kernel/virtio_random.ko missing
./boot/kernel/virtio_scsi.ko missing
./boot/kernel/vkbd.ko missing
./boot/kernel/vmci.ko missing
./boot/kernel/vmd.ko missing
./boot/kernel/vmm.ko missing
./boot/kernel/warp_saver.ko missing
./boot/kernel/wbwd.ko missing
./boot/kernel/wlan.ko missing
./boot/kernel/wlan_acl.ko missing
./boot/kernel/wlan_amrr.ko missing
./boot/kernel/wlan_ccmp.ko missing
./boot/kernel/wlan_rssadapt.ko missing
./boot/kernel/wlan_tkip.ko missing
./boot/kernel/wlan_wep.ko missing
./boot/kernel/wlan_xauth.ko missing
./boot/kernel/wmt.ko missing
./boot/kernel/wpifw.ko missing
./boot/kernel/wsp.ko missing
./boot/kernel/x86bios.ko missing
./boot/kernel/xb360gp.ko missing
./boot/kernel/xdr.ko missing
./boot/kernel/xhci.ko missing
./boot/kernel/xz.ko missing
./boot/kernel/zfs.ko missing
./boot/kernel/zlib.ko missing
>>> Check installed base version
Version 22.1.9 is correct.
>>> Check for missing or altered base files
No problems detected.
>>> Check installed repositories
SunnyValley
OPNsense
>>> Check installed plugins
os-OPNBEcore 1.0.2_2
os-acme-client 3.11
os-ddclient 1.7_2
os-etpro-telemetry 1.6_1
os-net-snmp 1.5_1
os-nut 1.8.1
os-sensei 1.11.3
os-sensei-agent 1.11.3
os-sensei-updater 1.11
os-sunnyvalley 1.2_2
os-tor 1.8_3
>>> Check locked packages
No locks found.
>>> Check for missing package dependencies
Checking all packages: .......... done
>>> Check for missing or altered package files
Checking all packages: .......... done
>>> Check for core packages consistency
Core package "opnsense-business" has 66 dependencies to check.
Checking packages: .................................................................... done
***DONE***

[Mbl]

@franco, anything I could / should do to bring back the DEC3860 back life?

Currently there is no traffic passed (unless DNS from unbound) trought the firewall...

[franco]

If you manage to get it to connect to the Internet:

# opnsense-update -fbk

Otherwise it needs a reinstall as vital kernel files are missing. Strangely these are the only ones missing.


Cheers,
Franco

[Mbl]

 8) straight forward and easy - all up and running again!

Is there any chance to the check the local disc without installing anything?

This was actuallt the third time I had issues with an upgrade and I would like to understand the why around this...

[franco]

You can install os-smart and see if that comes up with anything. You have to be most careful when "kernel" package is being updated as that seems to end up being discarded from the disk.

BTW, is this UFS or ZFS? Might also be an issue with power supply, maybe it crashes silently sometimes (check uptime every day without reboot).


Cheers,
Franco

[Mbl]

As far as I can see the disks look ok.

Code Select Expand

smartctl 7.3 2022-02-28 r5338 [FreeBSD 13.0-STABLE amd64] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     TS512GMTS952T
Serial Number:    G350760055
LU WWN Device Id: 5 7c3548 1b623b277
Firmware Version: 02J0S86A
User Capacity:    512,110,190,592 bytes [512 GB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
TRIM Command:     Available, deterministic, zeroed
Device is:        Not in smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu Jul 14 22:21:22 2022 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
was never started.
Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 241) Self-test routine in progress...
10% of test remaining.
Total time to complete Offline
data collection: (   60) seconds.
Offline data collection
capabilities: (0x71) SMART execute Offline immediate.
No Auto Offline data collection support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   1) minutes.
Extended self-test routine
recommended polling time: (   2) minutes.
Conveyance self-test routine
recommended polling time: (   1) minutes.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x0000   100   100   000    Old_age   Offline      -       0
  5 Reallocated_Sector_Ct   0x0000   100   100   000    Old_age   Offline      -       0
  9 Power_On_Hours          0x0000   100   100   000    Old_age   Offline      -       4951
12 Power_Cycle_Count       0x0000   100   100   000    Old_age   Offline      -       49
148 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       541850
149 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       5723
150 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       5590
151 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       5703
164 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       49880
165 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       43
166 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       20
167 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       27
159 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       0
160 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       0
161 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       123
163 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       24
168 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       3000
169 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       100
177 Wear_Leveling_Count     0x0000   100   100   050    Old_age   Offline      -       606
181 Program_Fail_Cnt_Total  0x0000   100   100   000    Old_age   Offline      -       0
182 Erase_Fail_Count_Total  0x0000   100   100   000    Old_age   Offline      -       0
192 Power-Off_Retract_Count 0x0000   100   100   000    Old_age   Offline      -       24
194 Temperature_Celsius     0x0000   100   100   000    Old_age   Offline      -       74
195 Hardware_ECC_Recovered  0x0000   100   100   000    Old_age   Offline      -       0
196 Reallocated_Event_Count 0x0000   100   100   016    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0000   100   100   050    Old_age   Offline      -       0
232 Available_Reservd_Space 0x0000   100   100   000    Old_age   Offline      -       100
241 Total_LBAs_Written      0x0000   100   100   000    Old_age   Offline      -       1212392
242 Total_LBAs_Read         0x0000   100   100   000    Old_age   Offline      -       4726
245 Unknown_Attribute       0x0000   100   100   000    Old_age   Offline      -       399040

SMART Error Log Version: 1
Warning: ATA error count 0 inconsistent with error log pointer 2

ATA Error Count: 0
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error -1 occurred at disk power-on lifetime: 0 hours (0 days + 0 hours)
  When the command that caused the error occurred, the device was in an unknown state.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  00 ec 00 00 00 00 00  Device Fault

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  c8 00 00 00 00 00 00 00      00:00:00.000  READ DMA

SMART Self-test log structure revision number 0
Warning: ATA Specification requires self-test log structure revision number = 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
    6        0    65535  Read_scanning was never started
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

It's still on ufs, never chnaged this:

Code Select Expand

root@firewall:~ # gpart show
=>        40  1000215136  ada0  GPT  (477G)
          40      409600     1  efi  (200M)
      409640        1024     2  freebsd-boot  (512K)
      410664   981467136     3  freebsd-ufs  (468G)
   981877800    18337376     4  freebsd-swap  (8.7G)

=>       63  121208769  da0  MBR  (58G)
         63     257217       - free -  (126M)
     257280  120951552    1  fat32lba  [active]  (58G)


Any advice on how to convert to zfs without messing up the current configuration? I have seen plenty of forum posts about this, but could not find a clear procedure

[franco]

Could also attempt to disable trim, maybe it's buggy here causing this.

As for ZFS reinstall... the procedure is pretty simple: make installer image, boot from it, in installer select "config import" and your disk. After successful completion install ZFS and your settings are retained (except logs and manual modifications).

Still: proceed with care. Don't take my word for it.  ;)


Cheers,
Franco

[Mbl]

Had some time to reinstalled the system from USB live environment. It was pretty straight forward as franco mentioned in his previous post.

• Take backup from system (including Zenarmour)
• Boot from USB and import config from local disc
• login as root and start opnsense-installer
• write live system to disk (use ZFS)
• login to web gui and (re-)install plugins
• Apply license to Zenarmour
• Import Zenarmour config
• reinstall custom cron scripts
• reboot

Thanks for your support franco!

Happy weekend

[franco]

I think you meant opnsense-installer instead of opnsense-update there?


Cheers,
Franco

[Mbl]

Yes correct franco

[franco]

Best to edit the post then before someone complains below it doesn't work.

Otherwise thanks for posting the steps and happy to help :)


Cheers,
Franco

[Mbl]

Yep, done!
Could not find the ,,edit" option on mobile view...