[Work In Progress] OPNsense Ported into ARM Devices

[abal]

Hi yrzr,

I'm trying to deploy your image on RPI4 (Model B 4GB), but unfortunately it is not booting. It stops at point:

Code: [Select]

Using DTB provided by EFI at 0x7ef0000.
EFI framebuffer information:
addr, size     0x3eac2000, 0x103000
dimensions     592 x 448
stride         592
masks          0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000

No other messages ... Can you or someone give me any info, what to check or how to continue?
I'm using the following config (connected through UART):

Code: [Select]

arm_64bit=1
dtoverlay=disable-bt
dtoverlay=mmc
device_tree_address=0x4000
kernel=u-boot.bin
armstub=armstub8-gic.bin
hdmi_safe=1
enable_uart=1
uart_2ndstage=1

I've also attached the whole boot log.

Thanks!

@chemlud Thanks for your great news.

I have figured out that the problem of boot failure after the second boot issue is caused by the `hw.uart.console` configuration in /boot/loader.conf. As it is auto-generated by opnsense, modification on /boot/loader.conf will be flushed. You can add `hw.uart.console=""` in /boot/loader.conf.local as a temporarily solution.

I have recently built a version 21.1 test image for rpi3 (may also work on rpi4).

Feel free to try it, and don't forget to modify config.txt before the first run .

Edited config.txt and opnsense up and running, but no Interfaces detected, not the built-in RJ45, not the wifi, not the USB2-RJ45. All hardware OK, as everything works as expected with opensuse Leap on the raspi 3b (not 3b+). I tried with raspi 3 config.txt, with 64bit version etc. and added uart=1 to have serial consol over GPIO.

Did anybody get this running?

PS: some info

Code: [Select]

dmesg
---<<BOOT>>---
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 2013-2019 The HardenedBSD Project.
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.1-RELEASE-p13-HBSD #0  5a4151730(stable/21.1)-dirty: Fri Jan  8 01:33:30 UTC 2021
    root@generic:/usr/obj/usr/src/arm64.aarch64/sys/SMP-ARM arm64
FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1)
VT(efifb): resolution 656x416
HardenedBSD: initialize and check features (__HardenedBSD_version 1200059 __FreeBSD_version 1201000).
Starting CPU 1 (1)
Starting CPU 2 (2)
Starting CPU 3 (3)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
random: unblocking device.
random: entropy device external interface
MAP 39f47000 mode 2 pages 1
MAP 39f4b000 mode 2 pages 3
MAP 39f4f000 mode 2 pages 4
MAP 3b360000 mode 2 pages 16
MAP 3f100000 mode 1 pages 1
000.000021 [4336] netmap_init               netmap: loaded module
kbd0 at kbdmux0
ofwbus0: <Open Firmware Device Tree>
simplebus0: <Flattened device tree simple bus> on ofwbus0
ofw_clkbus0: <OFW clocks bus> on ofwbus0
clk_fixed0: <Fixed clock> on ofw_clkbus0
clk_fixed1: <Fixed clock> on ofw_clkbus0
regfix0: <Fixed Regulator> on ofwbus0
regfix1: <Fixed Regulator> on ofwbus0
simple_mfd0: <Simple MFD (Multi-Functions Device)> on simplebus0
ofw_clkbus1: <OFW clocks bus> on simple_mfd0
psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
lintc0: <BCM2836 Interrupt Controller> mem 0x40000000-0x400000ff on simplebus0
intc0: <BCM2835 Interrupt Controller> mem 0x7e00b200-0x7e00b3ff irq 39 on simplebus0
gpio0: <BCM2708/2835 GPIO controller> mem 0x7e200000-0x7e2000b3 irq 7,8 on simplebus0
gpiobus0: <OFW GPIO bus> on gpio0
generic_timer0: <ARMv7 Generic Timer> irq 1,2,3,4 on ofwbus0
Timecounter "ARM MPCore Timecounter" frequency 19200000 Hz quality 1000
Event timer "ARM MPCore Eventtimer" frequency 19200000 Hz quality 1000
usb_nop_xceiv0: <USB NOP PHY> on ofwbus0
mbox0: <BCM2835 VideoCore Mailbox> mem 0x7e00b880-0x7e00b8bf irq 6 on simplebus0
gpioc0: <GPIO controller> on gpio0
uart0: <PrimeCell UART (PL011)> mem 0x7e201000-0x7e2011ff irq 9 on simplebus0
uart0: console (115200,n,8,1)
spi0: <BCM2708/2835 SPI controller> mem 0x7e204000-0x7e2041ff irq 11 on simplebus0
spibus0: <OFW SPI bus> on spi0
spibus0: <unknown card> at cs 0 mode 0
spibus0: <unknown card> at cs 1 mode 0
iichb0: <BCM2708/2835 BSC controller> mem 0x7e804000-0x7e804fff irq 19 on simplebus0
bcm283x_dwcotg0: <DWC OTG 2.0 integrated USB controller (bcm283x)> mem 0x7e980000-0x7e98ffff,0x7e006000-0x7e006fff irq 21,20
usbus0 on bcm283x_dwcotg0
bcm_dma0: <BCM2835 DMA Controller> mem 0x7e007000-0x7e007eff irq 23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38 on simpleb0
bcmwd0: <BCM2708/2835 Watchdog> mem 0x7e100000-0x7e100113,0x7e00a000-0x7e00a023 on simplebus0
bcmrng0: <Broadcom BCM2835 RNG> mem 0x7e104000-0x7e10400f irq 40 on simplebus0
sdhci_bcm0: <Broadcom 2708 SDHCI controller> mem 0x7e300000-0x7e3000ff irq 48 on simplebus0
mmc0: <MMC/SD bus> on sdhci_bcm0
fb0: <BCM2835 VT framebuffer driver> on simplebus0
fbd0 on fb0
VT: Replacing driver "efifb" with new "fb".
fb0: 656x416(656x416@0,0) 24bpp
fb0: fbswap: 1, pitch 1968, base 0x3eb33000, screen_size 818688
pmu0: <Performance Monitoring Unit> irq 0 on ofwbus0
cpulist0: <Open Firmware CPU Group> on ofwbus0
cpu0: <Open Firmware CPU> on cpulist0
bcm2835_cpufreq0: <CPU Frequency Control> on cpu0
cpu1: <Open Firmware CPU> on cpulist0
cpu2: <Open Firmware CPU> on cpulist0
cpu3: <Open Firmware CPU> on cpulist0
gpioled0: <GPIO LEDs> on ofwbus0
gpioled0: <led0> failed to map pin
gpioled0: <led1> failed to map pin
cryptosoft0: <software crypto>
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
iicbus0: <OFW I2C bus> on iichb0
iic0: <I2C generic I/O> on iicbus0
ugen0.1: <DWCOTG OTG Root HUB> at usbus0
uhub0: <DWCOTG OTG Root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
mmcsd0: 16GB <SDHC SL16G 8.0 SN 682835FD MFG 04/2016 by 3 SD> at mmc0 50.0MHz/4bit/65535-block
bcm2835_cpufreq0: ARM 600MHz, Core 250MHz, SDRAM 400MHz, Turbo OFF
uhub0: 1 port with 1 removable, self powered
Release APs...done
CPU  0: ARM Cortex-A53 r0p4 affinity:  0
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
 Instruction Set Attributes 0 = <CRC32>
 Instruction Set Attributes 1 = <>
         Processor Features 0 = <AdvSIMD,Float,EL3 32,EL2 32,EL1 32,EL0 32>
         Processor Features 1 = <0>
      Memory Model Features 0 = <4k Granule,64k Granule,S/NS Mem,MixedEndian,16bit ASID,1TB PA>
      Memory Model Features 1 = <>
      Memory Model Features 2 = <32b CCIDX,48b VA>
             Debug Features 0 = <2 CTX Breakpoints,4 Watchpoints,6 Breakpoints,PMUv3,Debug v8>
             Debug Features 1 = <0>
         Auxiliary Features 0 = <0>
         Auxiliary Features 1 = <0>
CPU  1: ARM Cortex-A53 r0p4 affinity:  1
CPU  2: ARM Cortex-A53 r0p4 affinity:  2
CPU  3: ARM Cortex-A53 r0p4 affinity:  3
Warning: no time-of-day clock registered, system time will not be set accurately
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
and

Code: [Select]

usbconfig
ugen0.1: <DWCOTG OTG Root HUB> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)

Fun fact: If you choose "reboot" the install never comes back (tried about 20 times), but stops before booting

Code: [Select]

*** OPNsense.localdomain: OPNsense 21.1_25 (aarch64/OpenSSL) ***

        No network interfaces are assigned.

  0) Logout                              7) Ping host
  1) Assign interfaces                   8) Shell
  2) Set interface IP address            9) pfTop
  3) Reset the root password            10) Firewall log
  4) Reset to factory defaults          11) Reload all services
  5) Power off system                   12) Update from console
  6) Reboot system                      13) Restore a backup

Enter an option: 6

The system will reboot. Do you want to proceed? [y/N]: y

>>> Invoking stop script 'beep'
>>> Invoking stop script 'freebsd'
>>> Invoking stop script 'backup'
>>> Invoking backup script 'captiveportal'
>>> Invoking backup script 'dhcpleases'
>>> Invoking backup script 'duid'
>>> Invoking backup script 'netflow'
>>> Invoking backup script 'rrd'
>>> Invoking stop script 'config'
shutdown: [pid 9305]
Shutdown NOW!
Consoles: EFI console 
    Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p1:
FreeBSD/arm64 EFI loader, Revision 1.1
(Thu Jan  7 07:14:48 UTC 2021 root@releng1.nyi.freebsd.org)

   Command line arguments: loader.efi
   Image base: 0x39e16000
   EFI version: 2.80
   EFI Firmware: Das U-Boot (rev 8224.4096)
   Console: comconsole (0)
   Load Path: /efi\boot\bootaa64.efi
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(1,0x01,0,0x800,0x10000)
Trying ESP: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(1,0x01,0,0x800,0x10000)
Setting currdev to disk0p1:
Trying: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(2,0x01,0,0x10800,0x3ef800)
Setting currdev to disk0p2:
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.local
[H[J[4;46H uKOS2qsmkfe38kEuXLimP+7XoBiuIt5k[5;46H BMHardenedBSDxfOL9QwvfA6yxGHkNMG[6;46H 2I7ADmw7Mp/P8Y4wjnBFDNKvNzdZa/uu[5
[25;0H[23;4HAutoboot in 2 seconds, hit [Enter] to boot or any other key to stop     
[25;0H[23;4HAutoboot in 1 seconds, hit [Enter] to boot or any other key to stop     
[25;0H[23;4HAutoboot in 0 seconds, hit [Enter] to boot or any other key to stop     
[25;0HLoading kernel...
/boot/kernel/kernel text=0x9857d0 data=0x19b1f0+0x7a3084 syms=[0x8+0x142260+0x8+0x12dbac]
Loading configured modules...
/boot/kernel/pflog.ko text=0xfb0 text=0x830 data=0x10148 syms=[0x8+0x9f0+0x8+0x716]
loading required module 'pf'
/boot/kernel/pf.ko text=0x6061 text=0x2cb90 data=0x10490+0xfd38 syms=[0x8+0x4170+0x8+0x308c]
/boot/kernel/if_enc.ko text=0x1602 text=0x8d0 data=0x10168 syms=[0x8+0xc90+0x8+0xb66]
/boot/kernel/pfsync.ko text=0x2e14 text=0x6ad0 data=0x102e8+0xfd20 syms=[0x8+0x1758+0x8+0x10f0]
/boot/kernel/carp.ko text=0x34c0 text=0x63d0 data=0x10258+0xfdf0 syms=[0x8+0x1980+0x8+0x121f]
/boot/kernel/if_bridge.ko text=0x351e text=0x69a0 data=0x10428+0xfbe0 syms=[0x8+0x1a40+0x8+0x14a3]
loading required module 'bridgestp'
/boot/kernel/bridgestp.ko text=0xe44 text=0x402c data=0x170 data=0x158+0x28 syms=[0x8+0xb10+0x8+0x690]
/boot/kernel/if_tap.ko text=0x2613 text=0x2b90 data=0x10160+0xff18 syms=[0x8+0x1260+0x8+0xbc4]
/boot/kernel/if_lagg.ko text=0x35c0 text=0x7c30 data=0x10440+0xfbc8 syms=[0x8+0x1a70+0x8+0x1325]
/boot/kernel/if_gre.ko text=0x2458 text=0x4640 data=0x10228+0xfe18 syms=[0x8+0x1668+0x8+0xf17]
/boot/entropy size=0x1000
Using DTB provided by EFI at 0x7ef5000.
EFI framebuffer information:
addr, size     0x3eaf0000, 0x10a800
dimensions     656 x 416
stride         656
masks          0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000

[chemlud]

@yrzr

https://ftp.yrzr.tk/opnsense/build/21.1/aarch64/images/

latest image is a vm thingy (vmdk.lzo), how to make an .img out of this? ;-)

[korhojoa]

@yrzr

https://ftp.yrzr.tk/opnsense/build/21.1/aarch64/images/

latest image is a vm thingy (vmdk.lzo), how to make an .img out of this? ;-)

I just run it on ESXi. Works nice on a Pi4. Use vmkfstools -i image-in.vmdk -d thin image-out.vmdk to make esxi happy.

If you want to convert it to something else,qemu-img is helpful.

[chemlud]

No esxi, no pi4 :-p

[abal]

@korhojoa,

I just run it on ESXi. Works nice on a Pi4. Use vmkfstools -i image-in.vmdk -d thin image-out.vmdk to make esxi happy.

If you want to convert it to something else,qemu-img is helpful.

Do you have a working image for PI4? Can you share your config file? Or any steps, how to make it working on it? My image is just not booting

Thanks!

[abal]

Unfortunately I do not have VMWare on my machine, only HyperV. I've tried to convert the vmdk to img (raw) using qemu-img, but it failed right at the beginning

qemu-img: error while writing sector 0: Input/output error

@korhojoa, if you could share your img file, that could help me a lot!

Thanks!

[korhojoa]

Unfortunately I do not have VMWare on my machine, only HyperV. I've tried to convert the vmdk to img (raw) using qemu-img, but it failed right at the beginning

qemu-img: error while writing sector 0: Input/output error

@korhojoa, if you could share your img file, that could help me a lot!

Thanks!

Hyper-V doesn't run on Windows on the Pi4, afaik, so are you trying to run a aarch64 os on a non-aarch64-platform or do you have a actual ARM device you're trying to run Hyper-V on?
I'm not going to put it anywhere, but just doing

Code: [Select]

$ qemu-img -V
qemu-img version 5.2.0 (Debian 1:5.2+dfsg-6)
Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
$ qemu-img convert OPNsense-21.1.3-OpenSSL-vm-aarch64.vmdk -O raw OPNsense-21.1.3-OpenSSL-vm-aarch64.img worked fine for me. Again, note: not running it on a Pi natively, but virtualized.

ESXi that I'm running it on is the arm fling for Pi 4: https://flings.vmware.com/esxi-arm-edition

Important note though, if you downloaded the compressed version and are trying to use it without decompressing it first, well, you're going to have a problem.
hint:

Code: [Select]

lzop -d file.lzo

[abal]

@korhojoa,

Thank you for your answer. I'm having a PI4 (real device), for what I would like to create an image, what I can then copy to SD card and boot my PI from it. So, I need to convert the VMDK somehow to a format, I can copy to SD card.

I'm running on a win10 machine, so my qemu-img was also for win64 (v2.3). Ok, then I'll try to convert it on a linux machine (I already have a debian vm), hopefully it will work.

BTW: I've downloaded the VMDK directly, not the compressed one.

[yrzr]

Hi abal,

Sorry to tell you that RPI4 is not supported yet. You can find the reason here.

Hi yrzr,

I'm trying to deploy your image on RPI4 (Model B 4GB), but unfortunately it is not booting. It stops at point:

Code: [Select]

Using DTB provided by EFI at 0x7ef0000.
EFI framebuffer information:
addr, size     0x3eac2000, 0x103000
dimensions     592 x 448
stride         592
masks          0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000

No other messages ... Can you or someone give me any info, what to check or how to continue?
I'm using the following config (connected through UART):

Code: [Select]

arm_64bit=1
dtoverlay=disable-bt
dtoverlay=mmc
device_tree_address=0x4000
kernel=u-boot.bin
armstub=armstub8-gic.bin
hdmi_safe=1
enable_uart=1
uart_2ndstage=1

I've also attached the whole boot log.

Thanks!

@chemlud Thanks for your great news.

I have figured out that the problem of boot failure after the second boot issue is caused by the `hw.uart.console` configuration in /boot/loader.conf. As it is auto-generated by opnsense, modification on /boot/loader.conf will be flushed. You can add `hw.uart.console=""` in /boot/loader.conf.local as a temporarily solution.

I have recently built a version 21.1 test image for rpi3 (may also work on rpi4).

Feel free to try it, and don't forget to modify config.txt before the first run .

Edited config.txt and opnsense up and running, but no Interfaces detected, not the built-in RJ45, not the wifi, not the USB2-RJ45. All hardware OK, as everything works as expected with opensuse Leap on the raspi 3b (not 3b+). I tried with raspi 3 config.txt, with 64bit version etc. and added uart=1 to have serial consol over GPIO.

Did anybody get this running?

PS: some info

Code: [Select]

dmesg
---<<BOOT>>---
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 2013-2019 The HardenedBSD Project.
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.1-RELEASE-p13-HBSD #0  5a4151730(stable/21.1)-dirty: Fri Jan  8 01:33:30 UTC 2021
    root@generic:/usr/obj/usr/src/arm64.aarch64/sys/SMP-ARM arm64
FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1)
VT(efifb): resolution 656x416
HardenedBSD: initialize and check features (__HardenedBSD_version 1200059 __FreeBSD_version 1201000).
Starting CPU 1 (1)
Starting CPU 2 (2)
Starting CPU 3 (3)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
random: unblocking device.
random: entropy device external interface
MAP 39f47000 mode 2 pages 1
MAP 39f4b000 mode 2 pages 3
MAP 39f4f000 mode 2 pages 4
MAP 3b360000 mode 2 pages 16
MAP 3f100000 mode 1 pages 1
000.000021 [4336] netmap_init               netmap: loaded module
kbd0 at kbdmux0
ofwbus0: <Open Firmware Device Tree>
simplebus0: <Flattened device tree simple bus> on ofwbus0
ofw_clkbus0: <OFW clocks bus> on ofwbus0
clk_fixed0: <Fixed clock> on ofw_clkbus0
clk_fixed1: <Fixed clock> on ofw_clkbus0
regfix0: <Fixed Regulator> on ofwbus0
regfix1: <Fixed Regulator> on ofwbus0
simple_mfd0: <Simple MFD (Multi-Functions Device)> on simplebus0
ofw_clkbus1: <OFW clocks bus> on simple_mfd0
psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
lintc0: <BCM2836 Interrupt Controller> mem 0x40000000-0x400000ff on simplebus0
intc0: <BCM2835 Interrupt Controller> mem 0x7e00b200-0x7e00b3ff irq 39 on simplebus0
gpio0: <BCM2708/2835 GPIO controller> mem 0x7e200000-0x7e2000b3 irq 7,8 on simplebus0
gpiobus0: <OFW GPIO bus> on gpio0
generic_timer0: <ARMv7 Generic Timer> irq 1,2,3,4 on ofwbus0
Timecounter "ARM MPCore Timecounter" frequency 19200000 Hz quality 1000
Event timer "ARM MPCore Eventtimer" frequency 19200000 Hz quality 1000
usb_nop_xceiv0: <USB NOP PHY> on ofwbus0
mbox0: <BCM2835 VideoCore Mailbox> mem 0x7e00b880-0x7e00b8bf irq 6 on simplebus0
gpioc0: <GPIO controller> on gpio0
uart0: <PrimeCell UART (PL011)> mem 0x7e201000-0x7e2011ff irq 9 on simplebus0
uart0: console (115200,n,8,1)
spi0: <BCM2708/2835 SPI controller> mem 0x7e204000-0x7e2041ff irq 11 on simplebus0
spibus0: <OFW SPI bus> on spi0
spibus0: <unknown card> at cs 0 mode 0
spibus0: <unknown card> at cs 1 mode 0
iichb0: <BCM2708/2835 BSC controller> mem 0x7e804000-0x7e804fff irq 19 on simplebus0
bcm283x_dwcotg0: <DWC OTG 2.0 integrated USB controller (bcm283x)> mem 0x7e980000-0x7e98ffff,0x7e006000-0x7e006fff irq 21,20
usbus0 on bcm283x_dwcotg0
bcm_dma0: <BCM2835 DMA Controller> mem 0x7e007000-0x7e007eff irq 23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38 on simpleb0
bcmwd0: <BCM2708/2835 Watchdog> mem 0x7e100000-0x7e100113,0x7e00a000-0x7e00a023 on simplebus0
bcmrng0: <Broadcom BCM2835 RNG> mem 0x7e104000-0x7e10400f irq 40 on simplebus0
sdhci_bcm0: <Broadcom 2708 SDHCI controller> mem 0x7e300000-0x7e3000ff irq 48 on simplebus0
mmc0: <MMC/SD bus> on sdhci_bcm0
fb0: <BCM2835 VT framebuffer driver> on simplebus0
fbd0 on fb0
VT: Replacing driver "efifb" with new "fb".
fb0: 656x416(656x416@0,0) 24bpp
fb0: fbswap: 1, pitch 1968, base 0x3eb33000, screen_size 818688
pmu0: <Performance Monitoring Unit> irq 0 on ofwbus0
cpulist0: <Open Firmware CPU Group> on ofwbus0
cpu0: <Open Firmware CPU> on cpulist0
bcm2835_cpufreq0: <CPU Frequency Control> on cpu0
cpu1: <Open Firmware CPU> on cpulist0
cpu2: <Open Firmware CPU> on cpulist0
cpu3: <Open Firmware CPU> on cpulist0
gpioled0: <GPIO LEDs> on ofwbus0
gpioled0: <led0> failed to map pin
gpioled0: <led1> failed to map pin
cryptosoft0: <software crypto>
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
iicbus0: <OFW I2C bus> on iichb0
iic0: <I2C generic I/O> on iicbus0
ugen0.1: <DWCOTG OTG Root HUB> at usbus0
uhub0: <DWCOTG OTG Root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
mmcsd0: 16GB <SDHC SL16G 8.0 SN 682835FD MFG 04/2016 by 3 SD> at mmc0 50.0MHz/4bit/65535-block
bcm2835_cpufreq0: ARM 600MHz, Core 250MHz, SDRAM 400MHz, Turbo OFF
uhub0: 1 port with 1 removable, self powered
Release APs...done
CPU  0: ARM Cortex-A53 r0p4 affinity:  0
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
 Instruction Set Attributes 0 = <CRC32>
 Instruction Set Attributes 1 = <>
         Processor Features 0 = <AdvSIMD,Float,EL3 32,EL2 32,EL1 32,EL0 32>
         Processor Features 1 = <0>
      Memory Model Features 0 = <4k Granule,64k Granule,S/NS Mem,MixedEndian,16bit ASID,1TB PA>
      Memory Model Features 1 = <>
      Memory Model Features 2 = <32b CCIDX,48b VA>
             Debug Features 0 = <2 CTX Breakpoints,4 Watchpoints,6 Breakpoints,PMUv3,Debug v8>
             Debug Features 1 = <0>
         Auxiliary Features 0 = <0>
         Auxiliary Features 1 = <0>
CPU  1: ARM Cortex-A53 r0p4 affinity:  1
CPU  2: ARM Cortex-A53 r0p4 affinity:  2
CPU  3: ARM Cortex-A53 r0p4 affinity:  3
Warning: no time-of-day clock registered, system time will not be set accurately
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
and

Code: [Select]

usbconfig
ugen0.1: <DWCOTG OTG Root HUB> at usbus0, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=SAVE (0mA)

Fun fact: If you choose "reboot" the install never comes back (tried about 20 times), but stops before booting

Code: [Select]

*** OPNsense.localdomain: OPNsense 21.1_25 (aarch64/OpenSSL) ***

        No network interfaces are assigned.

  0) Logout                              7) Ping host
  1) Assign interfaces                   8) Shell
  2) Set interface IP address            9) pfTop
  3) Reset the root password            10) Firewall log
  4) Reset to factory defaults          11) Reload all services
  5) Power off system                   12) Update from console
  6) Reboot system                      13) Restore a backup

Enter an option: 6

The system will reboot. Do you want to proceed? [y/N]: y

>>> Invoking stop script 'beep'
>>> Invoking stop script 'freebsd'
>>> Invoking stop script 'backup'
>>> Invoking backup script 'captiveportal'
>>> Invoking backup script 'dhcpleases'
>>> Invoking backup script 'duid'
>>> Invoking backup script 'netflow'
>>> Invoking backup script 'rrd'
>>> Invoking stop script 'config'
shutdown: [pid 9305]
Shutdown NOW!
Consoles: EFI console 
    Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p1:
FreeBSD/arm64 EFI loader, Revision 1.1
(Thu Jan  7 07:14:48 UTC 2021 root@releng1.nyi.freebsd.org)

   Command line arguments: loader.efi
   Image base: 0x39e16000
   EFI version: 2.80
   EFI Firmware: Das U-Boot (rev 8224.4096)
   Console: comconsole (0)
   Load Path: /efi\boot\bootaa64.efi
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(1,0x01,0,0x800,0x10000)
Trying ESP: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(1,0x01,0,0x800,0x10000)
Setting currdev to disk0p1:
Trying: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(2)/SD(0)/HD(2,0x01,0,0x10800,0x3ef800)
Setting currdev to disk0p2:
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.local
[H[J[4;46H uKOS2qsmkfe38kEuXLimP+7XoBiuIt5k[5;46H BMHardenedBSDxfOL9QwvfA6yxGHkNMG[6;46H 2I7ADmw7Mp/P8Y4wjnBFDNKvNzdZa/uu[5
[25;0H[23;4HAutoboot in 2 seconds, hit [Enter] to boot or any other key to stop     
[25;0H[23;4HAutoboot in 1 seconds, hit [Enter] to boot or any other key to stop     
[25;0H[23;4HAutoboot in 0 seconds, hit [Enter] to boot or any other key to stop     
[25;0HLoading kernel...
/boot/kernel/kernel text=0x9857d0 data=0x19b1f0+0x7a3084 syms=[0x8+0x142260+0x8+0x12dbac]
Loading configured modules...
/boot/kernel/pflog.ko text=0xfb0 text=0x830 data=0x10148 syms=[0x8+0x9f0+0x8+0x716]
loading required module 'pf'
/boot/kernel/pf.ko text=0x6061 text=0x2cb90 data=0x10490+0xfd38 syms=[0x8+0x4170+0x8+0x308c]
/boot/kernel/if_enc.ko text=0x1602 text=0x8d0 data=0x10168 syms=[0x8+0xc90+0x8+0xb66]
/boot/kernel/pfsync.ko text=0x2e14 text=0x6ad0 data=0x102e8+0xfd20 syms=[0x8+0x1758+0x8+0x10f0]
/boot/kernel/carp.ko text=0x34c0 text=0x63d0 data=0x10258+0xfdf0 syms=[0x8+0x1980+0x8+0x121f]
/boot/kernel/if_bridge.ko text=0x351e text=0x69a0 data=0x10428+0xfbe0 syms=[0x8+0x1a40+0x8+0x14a3]
loading required module 'bridgestp'
/boot/kernel/bridgestp.ko text=0xe44 text=0x402c data=0x170 data=0x158+0x28 syms=[0x8+0xb10+0x8+0x690]
/boot/kernel/if_tap.ko text=0x2613 text=0x2b90 data=0x10160+0xff18 syms=[0x8+0x1260+0x8+0xbc4]
/boot/kernel/if_lagg.ko text=0x35c0 text=0x7c30 data=0x10440+0xfbc8 syms=[0x8+0x1a70+0x8+0x1325]
/boot/kernel/if_gre.ko text=0x2458 text=0x4640 data=0x10228+0xfe18 syms=[0x8+0x1668+0x8+0xf17]
/boot/entropy size=0x1000
Using DTB provided by EFI at 0x7ef5000.
EFI framebuffer information:
addr, size     0x3eaf0000, 0x10a800
dimensions     656 x 416
stride         656
masks          0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000

[yrzr]

I have updated the images. You can find them in https://ftp.yrzr.tk/opnsense/FreeBSD%3A12%3Aaarch64/21.1/images/.

@yrzr

https://ftp.yrzr.tk/opnsense/build/21.1/aarch64/images/

latest image is a vm thingy (vmdk.lzo), how to make an .img out of this? ;-)

[chemlud]

I have updated the images. You can find them in https://ftp.yrzr.tk/opnsense/FreeBSD%3A12%3Aaarch64/21.1/images/.

@yrzr

https://ftp.yrzr.tk/opnsense/build/21.1/aarch64/images/

latest image is a vm thingy (vmdk.lzo), how to make an .img out of this? ;-)

Many thanks! Will give it a try and report back :-)

[chemlud]

As I wrote above, I can only boot from USB-stick (SD-slot broken), this works fine for the first boot, but after importing the config.xml via GUI the reboot fails completely:

Code: [Select]

Raspberry Pi Bootcode
Read File: config.txt, 171
Read File: start.elf, 2857060 (bytes)
Read File: fixup.dat, 6666 (bytes)
MESS:00:00:09.099525:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:09.103786:0: brfs: File read: 171 bytes
MESS:00:00:09.146340:0: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.152417:0: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.158661:0: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.164911:0: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.171161:0: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.177412:0: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.183661:0: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.189911:0: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.196162:0: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.202411:0: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.208424:0: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.296678:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:09.300808:0: HDMI:Setting property pixel encoding to Default
MESS:00:00:09.306887:0: HDMI:Setting property pixel clock type to PAL
MESS:00:00:09.313050:0: HDMI:Setting property content type flag to No data
MESS:00:00:09.319647:0: HDMI:Setting property fuzzy format match to enabled
MESS:00:00:09.326423:0: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
MESS:00:00:09.529779:0: gpioman: gpioman_get_pin_num: pin DISPLAY_DSI_PORT not defined
MESS:00:00:09.537232:0: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
MESS:00:00:09.543495:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.551983:0: hdmi: HDMI:>>>>>>>>>>>>>Rx sensed, reading EDID<<<<<<<<<<<<<
MESS:00:00:09.559728:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.567461:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.574227:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.580997:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.587769:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.594540:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.601309:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.608080:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.614852:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.621623:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.628156:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.633671:0: hdmi: HDMI: No lookup table for resolution group 0
MESS:00:00:09.640256:0: hdmi: HDMI: hotplug attached with DVI support
MESS:00:00:09.646433:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.655467:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.663202:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.669974:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.676745:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.683514:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.690285:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.697057:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.703827:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.710599:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.717370:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.723904:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.729675:0: hdmi: HDMI: hotplug deassert
MESS:00:00:09.734090:0: hdmi: HDMI: HDMI is currently off
MESS:00:00:09.739211:0: hdmi: HDMI: changing mode to unplugged
MESS:00:00:09.744776:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.754204:0: *** Restart logging
MESS:00:00:09.757451:0: brfs: File read: 171 bytes
MESS:00:00:09.820882:0: Failed to open command line file 'cmdline.txt'
MESS:00:00:09.952018:0: brfs: File read: /mfs/sd/armstub8.bin
MESS:00:00:09.956065:0: Loading 'armstub8.bin' to 0x0 size 0x1700
MESS:00:00:09.961909:0: brfs: File read: 5888 bytes
MESS:00:00:10.161173:0: brfs: File read: /mfs/sd/u-boot.bin
MESS:00:00:10.165050:0: Loading 'u-boot.bin' to 0x80000 size 0x78b50
MESS:00:00:10.175460:0: No kernel trailer - assuming DT-capable
MESS:00:00:10.179702:0: brfs: File read: 494416 bytes
MESS:00:00:10.254058:0: brfs: File read: /mfs/sd/bcm2710-rpi-3-b.dtb
MESS:00:00:10.258712:0: Loading 'bcm2710-rpi-3-b.dtb' to 0xf8b50 size 0x62df
MESS:00:00:10.404699:0: brfs: File read: 25311 bytes
MESS:00:00:10.450208:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:10.454102:0: dtparam: audio=on
MESS:00:00:10.476678:0: dtparam: i2c_arm=on
MESS:00:00:10.495792:0: dtparam: spi=on
MESS:00:00:10.512405:0: brfs: File read: 171 bytes
MESS:00:00:10.847009:0: brfs: File read: /mfs/sd/overlays/mmc.dtbo
MESS:00:00:10.868936:0: Loaded overlay 'mmc'
MESS:00:00:10.919659:0: brfs: File read: 1099 bytes
MESS:00:00:11.397723:0: brfs: File read: /mfs/sd/overlays/pwm.dtbo
MESS:00:00:11.414949:0: Loaded overlay 'pwm'
MESS:00:00:11.452197:0: brfs: File read: 946 bytes
MESS:00:00:11.719752:0: brfs: File read: /mfs/sd/overlays/disable-bt.dtbo
MESS:00:00:11.743774:0: dterror: can't find symbol 'bt'
MESS:00:00:11.747305:0: Failed to resolve overlay 'disable-bt'
MESS:00:00:12.908149:0: gpioman: gpioman_get_pin_num: pin EMMC_ENABLE not defined
MESS:00:00:13.029436:0: Device tree loaded to 0x4000 (size 0x67aa)
MESS:00:00:13.035094:0: uart: Set PL011 baud rate to 103448.300000 Hz
MESS:00:00:13.041628:0: uart: Baud rate change done...
MESS:00:00:13.045056:0: uart: Baud rateMMC:   mmc@7e300000: 1
Loading Environment from FAT... Card did not respond to voltage select!
In:    serial
Out:   vidconsole
Err:   vidconsole
Net:   No ethernet found.
starting USB...
Bus usb@7e980000: scanning bus usb@7e980000 for devices... unable to get device descriptor (error=-110)
3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
MMC Device 0 not found
no mmc device at slot 0
Card did not respond to voltage select!

Device 0: unknown device
missing environment variable: pxeuuid
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/01-b8-27-eb-16-56-a8
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x-rpi
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default
Config file not found
U-Boot>   

[yrzr]

Well, It seems to be some booting problem. Did you change anything else in the first partition?

The booting sequence should be on-chip ROM -> firmware(bootcode.bin -> start.elf) -> u-boot.bin (defined in config.txt,"kernel=u-boot.bin") -> EFI (efi/boot/bootaa64.efi) -> OPNsense kernel (/boot/kernel/kernel).

I think you get some problems between u-boot.bin -> EFI.

Here is the entire boot log for my RPI3+:

Code: [Select]

Raspberry Pi Bootcode
Read File: config.txt, 171
Read File: start.elf, 2857060 (bytes)
Read File: fixup.dat, 6666 (bytes)
MESS:00:00:01.056002:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:01.060264:0: brfs: File read: 171 bytes
MESS:00:00:01.074138:0: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:01.080209:0: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:01.086459:0: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:01.092709:0: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:01.098959:0: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:01.105209:0: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:01.111459:0: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:01.117709:0: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:01.123959:0: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:01.130209:0: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:01.136222:0: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:01.156338:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:01.160469:0: HDMI:Setting property pixel encoding to Default
MESS:00:00:01.166548:0: HDMI:Setting property pixel clock type to PAL
MESS:00:00:01.172711:0: HDMI:Setting property content type flag to No data
MESS:00:00:01.179308:0: HDMI:Setting property fuzzy format match to enabled
MESS:00:00:01.407853:0: gpioman: gpioman_get_pin_num: pin DISPLAY_DSI_PORT not defined
MESS:00:00:01.415330:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:01.422845:0: hdmi: HDMI:>>>>>>>>>>>>>Rx sensed, reading EDID<<<<<<<<<<<<<
MESS:00:00:01.430591:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:01.438324:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:01.445089:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:01.451860:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:01.458632:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:01.465402:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:01.472172:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:01.478944:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:01.485714:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:01.492485:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:01.499019:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:01.504534:0: hdmi: HDMI: No lookup table for resolution group 0
MESS:00:00:01.511118:0: hdmi: HDMI: hotplug attached with DVI support
MESS:00:00:01.517297:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:01.526330:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:01.534065:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:01.540836:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:01.547606:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:01.554378:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:01.561148:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:01.567919:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:01.574690:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:01.581461:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:01.588232:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:01.594767:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:01.600286:0: hdmi: HDMI: hotplug deassert
MESS:00:00:01.604952:0: hdmi: HDMI: HDMI is currently off
MESS:00:00:01.610073:0: hdmi: HDMI: changing mode to unplugged
MESS:00:00:01.615639:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:01.625853:0: *** Restart logging
MESS:00:00:01.628343:0: brfs: File read: 171 bytes
MESS:00:00:01.634030:0: Failed to open command line file 'cmdline.txt'
MESS:00:00:01.643603:0: brfs: File read: /mfs/sd/armstub8.bin
MESS:00:00:01.647652:0: Loading 'armstub8.bin' to 0x0 size 0x1700
MESS:00:00:01.653495:0: brfs: File read: 5888 bytes
MESS:00:00:01.690171:0: brfs: File read: /mfs/sd/u-boot.bin

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Load Path: /efi\boot\bootaa64.efi
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(1)/SD(0)/HD(1,0x01,0,0x800,0x10000)
   Probing 3 block devices.....* done
    ZFS found no pools
    UFS found 1 partition
    command args: -S115200 -D

Consoles: EFI console 
console comconsole is invalid!
Available consoles:
    efi
FreeBSD/arm64 EFI loader, Revision 1.1
(Sun Mar 21 06:55:21 HKT 2021 root@freebsd12)

   Command line arguments: loader.efi -S115200 -D
   EFI version: 2.70
   EFI Firmware: Das U-Boot (rev 8217.1792)
   Console: efi comconsole (0x20000000)
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(1)/SD(0)/HD(2,0x01,0,0x10800,0x3b61800)
Trying ESP: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(1)/SD(0)/HD(2,0x01,0,0x10800,0x3b61800)
Setting currdev to disk0p2:
Loading /boot/defaults/loader.conf
console vidconsole is invalid!
console comconsole is invalid!
no valid consoles!
Available consoles:
    efi
/boot/kernel/kernel text=0x97f068 data=0x19b1f0+0x7a3084 syms=[0x8+0x141c48+0x8+0x12dbbb]
/boot/entropy size=0x1000
/boot/kernel/carp.ko text=0x34c0 text=0x63d0 data=0x10258+0xfdf0 syms=[0x8+0x1980+0x8+0x121f]
/boot/kernel/if_bridge.ko text=0x351e text=0x69a0 data=0x10428+0xfbe0 syms=[0x8+0x1a40+0x8+0x14a3]
/boot/kernel/if_enc.ko text=0x1602 text=0x8d0 data=0x10168 syms=[0x8+0xc90+0x8+0xb66]
/boot/kernel/if_gre.ko text=0x2458 text=0x4640 data=0x10228+0xfe18 syms=[0x8+0x1668+0x8+0xf17]
/boot/kernel/if_lagg.ko text=0x35c0 text=0x7c30 data=0x10440+0xfbc8 syms=[0x8+0x1a70+0x8+0x1325]
/boot/kernel/if_tap.ko text=0x2613 text=0x2b90 data=0x10160+0xff18 syms=[0x8+0x1260+0x8+0xbc4]
/boot/kernel/pf.ko text=0x6061 text=0x2cb90 data=0x10490+0xfd38 syms=[0x8+0x4170+0x8+0x308c]
/boot/kernel/pflog.ko text=0xfb0 text=0x830 data=0x10148 syms=[0x8+0x9f0+0x8+0x716]
/boot/kernel/pfsync.ko text=0x2e14 text=0x6ad0 data=0x102e8+0xfd20 syms=[0x8+0x1758+0x8+0x10f0]

Hit [Enter] to boot immediately, or any other key for command prompt.
Booting [/boot/kernel/kernel]...               
Using DTB provided by EFI at 0x7ef6000.
EFI framebuffer information:
addr, size     0x3eaf0000, 0x10a800
dimensions     656 x 416
stride         656
masks          0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000
---<<BOOT>>---
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 2013-2019 The HardenedBSD Project.
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.1-RELEASE-p14-HBSD #0  e10a7efce(stable/21.1)-dirty: Sun Mar 21 08:00:57 HKT 2021
    root@freebsd12:/usr/obj/usr/src/arm64.aarch64/sys/SMP-ARM arm64
FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1)
VT(efifb): resolution 656x416
HardenedBSD: initialize and check features (__HardenedBSD_version 1200059 __FreeBSD_version 1201000).
KLD file if_bridge.ko is missing dependencies
Starting CPU 1 (1)
Starting CPU 2 (2)
Starting CPU 3 (3)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
random: unblocking device.
random: entropy device external interface
MAP 39f4a000 mode 2 pages 1
MAP 39f4f000 mode 2 pages 1
MAP 3b350000 mode 2 pages 16
MAP 3f100000 mode 1 pages 1
000.000021 [4336] netmap_init               netmap: loaded module
kbd0 at kbdmux0
ofwbus0: <Open Firmware Device Tree>
simplebus0: <Flattened device tree simple bus> on ofwbus0
ofw_clkbus0: <OFW clocks bus> on ofwbus0
clk_fixed0: <Fixed clock> on ofw_clkbus0
clk_fixed1: <Fixed clock> on ofw_clkbus0
regfix0: <Fixed Regulator> on ofwbus0
regfix1: <Fixed Regulator> on ofwbus0
psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
lintc0: <BCM2836 Interrupt Controller> mem 0x40000000-0x400000ff on simplebus0
intc0: <BCM2835 Interrupt Controller> mem 0x7e00b200-0x7e00b3ff irq 20 on simplebus0
gpio0: <BCM2708/2835 GPIO controller> mem 0x7e200000-0x7e2000b3 irq 23,24 on simplebus0
gpiobus0: <OFW GPIO bus> on gpio0
generic_timer0: <ARMv7 Generic Timer> irq 0,1,2,3 on ofwbus0
Timecounter "ARM MPCore Timecounter" frequency 19200000 Hz quality 1000
Event timer "ARM MPCore Eventtimer" frequency 19200000 Hz quality 1000
usb_nop_xceiv0: <USB NOP PHY> on ofwbus0
bcm_dma0: <BCM2835 DMA Controller> mem 0x7e007000-0x7e007eff irq 4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19 on simplebus0
bcmwd0: <BCM2708/2835 Watchdog> mem 0x7e100000-0x7e100027 on simplebus0
bcmrng0: <Broadcom BCM2835 RNG> mem 0x7e104000-0x7e10400f irq 21 on simplebus0
mbox0: <BCM2835 VideoCore Mailbox> mem 0x7e00b880-0x7e00b8bf irq 22 on simplebus0
gpioc0: <GPIO controller> on gpio0
uart0: <PrimeCell UART (PL011)> mem 0x7e201000-0x7e201fff irq 25 on simplebus0
spi0: <BCM2708/2835 SPI controller> mem 0x7e204000-0x7e204fff irq 27 on simplebus0
spibus0: <OFW SPI bus> on spi0
spibus0: <unknown card> at cs 0 mode 0
spibus0: <unknown card> at cs 1 mode 0
uart1: <BCM2835 Mini-UART> mem 0x7e215040-0x7e21507f irq 33 on simplebus0
uart1: console (115200,n,8,1)
iichb0: <BCM2708/2835 BSC controller> mem 0x7e804000-0x7e804fff irq 40 on simplebus0
bcm283x_dwcotg0: <DWC OTG 2.0 integrated USB controller (bcm283x)> mem 0x7e980000-0x7e98ffff,0x7e006000-0x7e006fff irq 46,47 on simplebus0
usbus0 on bcm283x_dwcotg0
sdhci_bcm0: <Broadcom 2708 SDHCI controller> mem 0x7e300000-0x7e3000ff irq 49 on simplebus0
mmc0: <MMC/SD bus> on sdhci_bcm0
fb0: <BCM2835 VT framebuffer driver> on simplebus0
fbd0 on fb0
VT: Replacing driver "efifb" with new "fb".
fb0: 656x416(656x416@0,0) 24bpp
fb0: fbswap: 1, pitch 1968, base 0x3eb33000, screen_size 818688
pmu0: <Performance Monitoring Unit> irq 53 on simplebus0
cpulist0: <Open Firmware CPU Group> on ofwbus0
cpu0: <Open Firmware CPU> on cpulist0
bcm2835_cpufreq0: <CPU Frequency Control> on cpu0
cpu1: <Open Firmware CPU> on cpulist0
cpu2: <Open Firmware CPU> on cpulist0
cpu3: <Open Firmware CPU> on cpulist0
gpioled0: <GPIO LEDs> on ofwbus0
gpioled0: <led1> failed to map pin
cryptosoft0: <software crypto>
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
iicbus0: <OFW I2C bus> on iichb0
iic0: <I2C generic I/O> on iicbus0
ugen0.1: <DWCOTG OTG Root HUB> at usbus0
uhub0: <DWCOTG OTG Root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
mmcsd0: 32GB <SDHC SC32G 8.0 SN 9DC03993 MFG 10/2018 by 3 SD> at mmc0 50.0MHz/4bit/65535-block
bcm2835_cpufreq0: ARM 600MHz, Core 250MHz, SDRAM 400MHz, Turbo OFF
mbox0: mbox response error
bcm2835_cpufreq0: can't set clock rate (id=4)
Release APs...done
CPU  0: ARM Cortex-A53 r0p4 affinity:  0
Trying to mount root from ufs:/dev/ufs/OPNsense [rw]...
 Instruction Set Attributes 0 = <CRC32>
 Instruction Set Attributes 1 = <>
         Processor Features 0 = <AdvSIMD,Float,EL3 32,EL2 32,EL1 32,EL0 32>
         Processor Features 1 = <0>
      Memory Model Features 0 = <4k Granule,64k Granule,S/NS Mem,MixedEndian,16bit ASID,1TB PA>
      Memory Model Features 1 = <>
      Memory Model Features 2 = <32b CCIDX,48b VA>
             Debug Features 0 = <2 CTX Breakpoints,4 Watchpoints,6 Breakpoints,PMUv3,Debug v8>
             Debug Features 1 = <0>
         Auxiliary Features 0 = <0>
         Auxiliary Features 1 = <0>
CPU  1: ARM Cortex-A53 r0p4 affinity:  1
CPU  2: ARM Cortex-A53 r0p4 affinity:  2
CPU  3: ARM Cortex-A53 r0p4 affinity:  3
Warning: no time-of-day clock registered, system time will not be set accurately
uhub0: 1 port with 1 removable, self powered
Mounting filesystems...
tunefs: soft updates remains unchanged as enabled
tunefs: file system reloaded
camcontrol: cam_ugen0.2: <vendor 0x0424 product 0x2514> at usbus0
uhub1 on uhub0
uhub1: <vendor 0x0424 product 0x2514, class 9/0, rev 2.00/b.b3, addr 2> on usbus0
uhub1: MTT enabled
lookup_pass: CAMGETPASSTHRU ioctl failed
cam_lookup_pass: No such file or directory
cam_lookup_pass: either the pass driver isn't in your kernel
cam_lookup_pass: or mmcsd0 doesn't exist
** /dev/ufs/OPNsense
FILE SYSTEM CLEAN; SKIPPING CHECKS
clean, 7101844 fuhub1: 4 ports with 3 removable, self powered
ree (220 frags, 887703 blocks, 0.0% fragmentation)
ugen0.3: <vendor 0x0424 product 0x2514> at usbus0
uhub2 on uhub1
uhub2: <vendor 0x0424 product 0x2514, class 9/0, rev 2.00/b.b3, addr 3> on usbus0
uhub2: MTT enabled
Setting hostuuid: 30303030-3030-3030-3139-663138353365.
Setting hostid: 0x56d89878.
Configurinuhub2: 3 ports with 2 removable, self powered
g vt: blanktime.
ugen0.4: <vendor 0x0424 product 0x7800> at usbus0
muge0 on uhub2
muge0: <vendor 0x0424 product 0x7800, rev 2.10/3.00, addr 4> on usbus0
muge0: Chip ID 0x7800 rev 0002
miibus0: <MII bus> on muge0
ukphy0: <Generic IEEE 802.3u media interface> PHY 1 on miibus0
ukphy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto
ue0: <USB Ethernet> on muge0
ue0: Ethernet address: b8:27:eb:f1:85:3e
Setting up memory disks...done.
Configuring crash dump device: /dev/null
.ELF ldconfig path: /lib /usr/lib /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/ipsec /usr/local/lib/perl5/5.32/mach/CORE
done.
>>> Invoking early script 'upgrade'
>>> Invoking early script 'configd'
Starting configd.
>>> Invoking early script 'templates'
Generating configuration: OK
>>> Invoking early script 'backup'
>>> Invoking backup script 'captiveportal'
>>> Invoking backup script 'dhcpleases'
>>> Invoking backup script 'duid'
>>> Invoking backup script 'netflow'
>>> Invoking backup script 'rrd'
>>> Invoking early script 'carp'
CARP event system: OK
Launching the init system...done.
Initializing...........done.
ue0: link state changed to UP
Starting device manager...done.
Configuring login behaviour...done.
Configuring looplo0: link state changed to UP
back interface...done.
Configuring kernel modules...done.
Setting up extended sysctls...done.
Setting timezone...done.
Writing firmware setting...done.
Writing trust files...done.
Setting hostname: opnsense.yrzr.tk
Generating /etc/hosts...done.
Configuring system logging...done.
Configuring loopback interface...done.
Creating wireless clone interfaces...donmuge0: Chip ID 0x7800 rev 0002
e.
Configuring WAN interface...done.
Creating IPsec VTI instances...done.
Generating /etc/resolv.conf...done.
Configuring firewall........done.
Starting PFLOG...done.
Configuring OpenSSH...done.
Starting web GUI...done.
Configuring CRON...done.
Setting up routes...done.
Generating /etc/hosts...done.
Starting Unbound DNS...done.
Setting up gateway monitors...done.
Configuring firewall........done.
Starting PFLOG...done.
Syncing OpenVPN settings...done.
Starting NTP service...deferred.
Starting Unbound DNS...done.
Generating RRD graphs...done.
Configuring system logging...done.
>>> Invoking start script 'newwanip'
Reconfiguring IPv4 on ue0: OK
Reconfiguring routes: OK
>>> Invoking start script 'freebsd'
Starting powerd.
>>> Invoking start script 'syslog-ng'
Stopping syslog_ng.
Waiting for PIDS: 31435.
Starting syslog_ng.
>>> Invoking start script 'wireguard'
Setting up routes...done.
Setting up gateway monitors...done.
Configuring firewall........done.
Starting PFLOG...done.
>>> Invoking start script 'carp'
>>> Invoking start script 'cron'
Starting Cron: OK
>>> Invoking start script 'beep'
Root file system: /dev/ufs/OPNsense
Fri Mar 26 20:11:52 HKT 2021

*** opnsense.yrzr.tk: OPNsense 21.1.3 (aarch64/OpenSSL) ***


As I wrote above, I can only boot from USB-stick (SD-slot broken), this works fine for the first boot, but after importing the config.xml via GUI the reboot fails completely:

Code: [Select]

Raspberry Pi Bootcode
Read File: config.txt, 171
Read File: start.elf, 2857060 (bytes)
Read File: fixup.dat, 6666 (bytes)
MESS:00:00:09.099525:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:09.103786:0: brfs: File read: 171 bytes
MESS:00:00:09.146340:0: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.152417:0: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.158661:0: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.164911:0: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.171161:0: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.177412:0: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.183661:0: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.189911:0: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.196162:0: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.202411:0: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.208424:0: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.296678:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:09.300808:0: HDMI:Setting property pixel encoding to Default
MESS:00:00:09.306887:0: HDMI:Setting property pixel clock type to PAL
MESS:00:00:09.313050:0: HDMI:Setting property content type flag to No data
MESS:00:00:09.319647:0: HDMI:Setting property fuzzy format match to enabled
MESS:00:00:09.326423:0: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
MESS:00:00:09.529779:0: gpioman: gpioman_get_pin_num: pin DISPLAY_DSI_PORT not defined
MESS:00:00:09.537232:0: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
MESS:00:00:09.543495:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.551983:0: hdmi: HDMI:>>>>>>>>>>>>>Rx sensed, reading EDID<<<<<<<<<<<<<
MESS:00:00:09.559728:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.567461:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.574227:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.580997:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.587769:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.594540:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.601309:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.608080:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.614852:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.621623:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.628156:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.633671:0: hdmi: HDMI: No lookup table for resolution group 0
MESS:00:00:09.640256:0: hdmi: HDMI: hotplug attached with DVI support
MESS:00:00:09.646433:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.655467:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 0
MESS:00:00:09.663202:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 1
MESS:00:00:09.669974:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 2
MESS:00:00:09.676745:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 3
MESS:00:00:09.683514:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 4
MESS:00:00:09.690285:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 5
MESS:00:00:09.697057:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 6
MESS:00:00:09.703827:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 7
MESS:00:00:09.710599:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 8
MESS:00:00:09.717370:0: hdmi: HDMI:EDID error reading EDID block 0 attempt 9
MESS:00:00:09.723904:0: hdmi: HDMI:EDID giving up on reading EDID block 0
MESS:00:00:09.729675:0: hdmi: HDMI: hotplug deassert
MESS:00:00:09.734090:0: hdmi: HDMI: HDMI is currently off
MESS:00:00:09.739211:0: hdmi: HDMI: changing mode to unplugged
MESS:00:00:09.744776:0: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
MESS:00:00:09.754204:0: *** Restart logging
MESS:00:00:09.757451:0: brfs: File read: 171 bytes
MESS:00:00:09.820882:0: Failed to open command line file 'cmdline.txt'
MESS:00:00:09.952018:0: brfs: File read: /mfs/sd/armstub8.bin
MESS:00:00:09.956065:0: Loading 'armstub8.bin' to 0x0 size 0x1700
MESS:00:00:09.961909:0: brfs: File read: 5888 bytes
MESS:00:00:10.161173:0: brfs: File read: /mfs/sd/u-boot.bin
MESS:00:00:10.165050:0: Loading 'u-boot.bin' to 0x80000 size 0x78b50
MESS:00:00:10.175460:0: No kernel trailer - assuming DT-capable
MESS:00:00:10.179702:0: brfs: File read: 494416 bytes
MESS:00:00:10.254058:0: brfs: File read: /mfs/sd/bcm2710-rpi-3-b.dtb
MESS:00:00:10.258712:0: Loading 'bcm2710-rpi-3-b.dtb' to 0xf8b50 size 0x62df
MESS:00:00:10.404699:0: brfs: File read: 25311 bytes
MESS:00:00:10.450208:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:10.454102:0: dtparam: audio=on
MESS:00:00:10.476678:0: dtparam: i2c_arm=on
MESS:00:00:10.495792:0: dtparam: spi=on
MESS:00:00:10.512405:0: brfs: File read: 171 bytes
MESS:00:00:10.847009:0: brfs: File read: /mfs/sd/overlays/mmc.dtbo
MESS:00:00:10.868936:0: Loaded overlay 'mmc'
MESS:00:00:10.919659:0: brfs: File read: 1099 bytes
MESS:00:00:11.397723:0: brfs: File read: /mfs/sd/overlays/pwm.dtbo
MESS:00:00:11.414949:0: Loaded overlay 'pwm'
MESS:00:00:11.452197:0: brfs: File read: 946 bytes
MESS:00:00:11.719752:0: brfs: File read: /mfs/sd/overlays/disable-bt.dtbo
MESS:00:00:11.743774:0: dterror: can't find symbol 'bt'
MESS:00:00:11.747305:0: Failed to resolve overlay 'disable-bt'
MESS:00:00:12.908149:0: gpioman: gpioman_get_pin_num: pin EMMC_ENABLE not defined
MESS:00:00:13.029436:0: Device tree loaded to 0x4000 (size 0x67aa)
MESS:00:00:13.035094:0: uart: Set PL011 baud rate to 103448.300000 Hz
MESS:00:00:13.041628:0: uart: Baud rate change done...
MESS:00:00:13.045056:0: uart: Baud rateMMC:   mmc@7e300000: 1
Loading Environment from FAT... Card did not respond to voltage select!
In:    serial
Out:   vidconsole
Err:   vidconsole
Net:   No ethernet found.
starting USB...
Bus usb@7e980000: scanning bus usb@7e980000 for devices... unable to get device descriptor (error=-110)
3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
MMC Device 0 not found
no mmc device at slot 0
Card did not respond to voltage select!

Device 0: unknown device
missing environment variable: pxeuuid
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/01-b8-27-eb-16-56-a8
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x-rpi
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default
Config file not found
U-Boot>   

[chemlud]

No matter if I copy over the DTB etc. from FeeBSD for raspi 3 or not the second boot fails

Difference to your boot start after

Code: [Select]

MESS:00:00:01.690171:0: brfs: File read: /mfs/sd/u-boot.bin
Your next linie is

Code: [Select]

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Load Path: /efi\boot\bootaa64.efi
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(1)/SD(0)/HD(1,0x01,0,0x800,0x10000)
   Probing 3 block devices.....* done
    ZFS found no pools
    UFS found 1 partition
    command args: -S115200 -D
...
while my USB-stick takes a swing to a parallel universe not meant to be used for production:

Code: [Select]

...
MESS:00:00:10.166426:0: Loading 'u-boot.bin' to 0x80000 size 0x78b50
MESS:00:00:10.176834:0: No kernel trailer - assuming DT-capable
MESS:00:00:10.181076:0: brfs: File read: 494416 bytes
MESS:00:00:10.242557:0: brfs: File read: /mfs/sd/bcm2710-rpi-3-b.dtb
MESS:00:00:10.247212:0: Loading 'bcm2710-rpi-3-b.dtb' to 0xf8b50 size 0x62df
MESS:00:00:10.393105:0: brfs: File read: 25311 bytes
MESS:00:00:10.438707:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:10.442600:0: dtparam: audio=on
MESS:00:00:10.465152:0: dtparam: i2c_arm=on
MESS:00:00:10.484265:0: dtparam: spi=on
MESS:00:00:10.500871:0: brfs: File read: 171 bytes
MESS:00:00:10.835383:0: brfs: File read: /mfs/sd/overlays/mmc.dtbo
MESS:00:00:10.857296:0: Loaded overlay 'mmc'
MESS:00:00:10.908017:0: brfs: File read: 1099 bytes
MESS:00:00:11.385221:0: brfs: File read: /mfs/sd/overlays/pwm.dtbo
MESS:00:00:11.402444:0: Loaded overlay 'pwm'
MESS:00:00:11.439702:0: brfs: File read: 946 bytes
MESS:00:00:11.707876:0: brfs: File read: /mfs/sd/overlays/disable-bt.dtbo
MESS:00:00:11.732142:0: dterror: can't find symbol 'bt'
MESS:00:00:11.735660:0: Failed to resolve overlay 'disable-bt'
MESS:00:00:12.883018:0: gpioman: gpioman_get_pin_num: pin EMMC_ENABLE not defined
MESS:00:00:13.004264:0: Device tree loaded to 0x4000 (size 0x67aa)
MESS:00:00:13.009938:0: uart: Set PL011 baud rate to 103448.300000 Hz
MESS:00:00:13.016456:0: uart: Baud rate change done...
MESS:00:00:13.019884:0: uart: Baud rateMMC:   mmc@7e300000: 1
Loading Environment from FAT... Card did not respond to voltage select!
In:    serial
Out:   vidconsole
Err:   vidconsole
Net:   No ethernet found.
starting USB...
Bus usb@7e980000: scanning bus usb@7e980000 for devices... unable to get device descriptor (error=-110)
3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
MMC Device 0 not found
no mmc device at slot 0
Card did not respond to voltage select!

Device 0: unknown device
missing environment variable: pxeuuid
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/01-b8-27-eb-16-56-a8
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x-rpi
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default
Config file not found

I thought this fix is included now:

Code: [Select]

I have figured out that the problem of boot failure after the second boot issue is caused by the `hw.uart.console` configuration in /boot/loader.conf. As it is auto-generated by opnsense, modification on /boot/loader.conf will be flushed. You can add `hw.uart.console=""` in /boot/loader.conf.local as a temporarily solution.

Or do I still have to add the loader.conf.local?

[yrzr]

`hw.uart.console=""`is to override the misconfiguration auto-generated by OPNsense in /boot/loader.conf. It is related to uart console after the kernel is booted.

While your problem is far before the kernel is booted. So I don't think these two problems are related. However, you could still have a try after deleting /boot/loader.conf.local.

My suggestion is to override your whole boot loader partition (the first partition) with my image except your config.txt, then boot again. Moreover, booting from USB may also affect but I have never tried.

No matter if I copy over the DTB etc. from FeeBSD for raspi 3 or not the second boot fails

Difference to your boot start after

Code: [Select]

MESS:00:00:01.690171:0: brfs: File read: /mfs/sd/u-boot.bin
Your next linie is

Code: [Select]

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Load Path: /efi\boot\bootaa64.efi
   Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/SD(1)/SD(0)/HD(1,0x01,0,0x800,0x10000)
   Probing 3 block devices.....* done
    ZFS found no pools
    UFS found 1 partition
    command args: -S115200 -D
...
while my USB-stick takes a swing to a parallel universe not meant to be used for production:

Code: [Select]

...
MESS:00:00:10.166426:0: Loading 'u-boot.bin' to 0x80000 size 0x78b50
MESS:00:00:10.176834:0: No kernel trailer - assuming DT-capable
MESS:00:00:10.181076:0: brfs: File read: 494416 bytes
MESS:00:00:10.242557:0: brfs: File read: /mfs/sd/bcm2710-rpi-3-b.dtb
MESS:00:00:10.247212:0: Loading 'bcm2710-rpi-3-b.dtb' to 0xf8b50 size 0x62df
MESS:00:00:10.393105:0: brfs: File read: 25311 bytes
MESS:00:00:10.438707:0: brfs: File read: /mfs/sd/config.txt
MESS:00:00:10.442600:0: dtparam: audio=on
MESS:00:00:10.465152:0: dtparam: i2c_arm=on
MESS:00:00:10.484265:0: dtparam: spi=on
MESS:00:00:10.500871:0: brfs: File read: 171 bytes
MESS:00:00:10.835383:0: brfs: File read: /mfs/sd/overlays/mmc.dtbo
MESS:00:00:10.857296:0: Loaded overlay 'mmc'
MESS:00:00:10.908017:0: brfs: File read: 1099 bytes
MESS:00:00:11.385221:0: brfs: File read: /mfs/sd/overlays/pwm.dtbo
MESS:00:00:11.402444:0: Loaded overlay 'pwm'
MESS:00:00:11.439702:0: brfs: File read: 946 bytes
MESS:00:00:11.707876:0: brfs: File read: /mfs/sd/overlays/disable-bt.dtbo
MESS:00:00:11.732142:0: dterror: can't find symbol 'bt'
MESS:00:00:11.735660:0: Failed to resolve overlay 'disable-bt'
MESS:00:00:12.883018:0: gpioman: gpioman_get_pin_num: pin EMMC_ENABLE not defined
MESS:00:00:13.004264:0: Device tree loaded to 0x4000 (size 0x67aa)
MESS:00:00:13.009938:0: uart: Set PL011 baud rate to 103448.300000 Hz
MESS:00:00:13.016456:0: uart: Baud rate change done...
MESS:00:00:13.019884:0: uart: Baud rateMMC:   mmc@7e300000: 1
Loading Environment from FAT... Card did not respond to voltage select!
In:    serial
Out:   vidconsole
Err:   vidconsole
Net:   No ethernet found.
starting USB...
Bus usb@7e980000: scanning bus usb@7e980000 for devices... unable to get device descriptor (error=-110)
3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
Hit any key to stop autoboot:  0
MMC Device 0 not found
no mmc device at slot 0
Card did not respond to voltage select!

Device 0: unknown device
missing environment variable: pxeuuid
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/01-b8-27-eb-16-56-a8
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/000
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/00
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/0
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x-rpi
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm-bcm283x
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default-arm
missing environment variable: bootfile
Retrieving file: pxelinux.cfg/default
Config file not found

I thought this fix is included now:

Code: [Select]

I have figured out that the problem of boot failure after the second boot issue is caused by the `hw.uart.console` configuration in /boot/loader.conf. As it is auto-generated by opnsense, modification on /boot/loader.conf will be flushed. You can add `hw.uart.console=""` in /boot/loader.conf.local as a temporarily solution.

Or do I still have to add the loader.conf.local?