How to build 22.x code base ?

Started by rackg, November 09, 2021, 03:04:42 AM

Previous topic - Next topic
I would like to build the beta code line 22.x. Kindly share the steps to follow. I have tried the existing method using FreeBSD 13.0 the build failed at make base itself. Any inputs are most welcome.
-RackG


Posting at least the error would help diagnose.


Cheers,
Franco

mimugmail I will try your post and let you know how it goes.
-RackG

Quote from: franco on November 09, 2021, 10:13:54 AM
Posting at least the error would help diagnose.


Cheers,
Franco

Sure after trying mimugmail guide.
-RackG

November 19, 2021, 04:11:11 AM #5 Last Edit: November 19, 2021, 05:28:35 AM by rackg
I have built an ISO finally. Had found an issue with following error

Issue1:
=====
DVD Create failed due to efi file copy issue no space left on device.

Logs:
------
+ UEFIBOOT=''
+ [ -n 'arm dvd serial vga vm' -a -z '' ]
+ UEFIBOOT='-o bootimage=i386;/usr/obj/usr/tools/config/22.1/OpenSSL:amd64/efiboot.img'
+ UEFIBOOT='-o bootimage=i386;/usr/obj/usr/tools/config/22.1/OpenSSL:amd64/efiboot.img -o no-emul-boot -o platformid=efi'
+ dd 'if=/dev/zero' 'of=/usr/obj/usr/tools/config/22.1/OpenSSL:amd64/efiboot.img' 'bs=4k' 'count=200'
200+0 records in
200+0 records out
819200 bytes transferred in 0.000977 secs (838207186 bytes/sec)
+ mdconfig -a -t vnode -f /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/efiboot.img
+ DEV=md0
+ newfs_msdos -F 12 -m 0xf8 /dev/md0
newfs_msdos: cannot get number of sectors per track: Operation not supported
newfs_msdos: cannot get number of heads: Operation not supported
/dev/md0: 1557 sectors in 1557 FAT12 clusters (512 bytes/cluster)
BytesPerSec=512 SecPerClust=1 ResSectors=1 FATs=2 RootDirEnts=512 Sectors=1600 Media=0xf8 FATsecs=5 SecPerTrack=63 Heads=1 HiddenSecs=0
+ mount -t msdosfs /dev/md0 /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/mnt
+ mkdir -p /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/mnt/efi/boot
+ cp /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/work/boot/loader.efi /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/mnt/efi/boot/bootx64.efi
cp: /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/mnt/efi/boot/bootx64.efi: No space left on device
*** Error code 1

After changed the count = 222 i was able to generate the ISO since the bootx64.efi size has gone beyond 4k x 200 count.

Issue 2:
=====

Really long time-consuming build process, most of my time spent on rust compilation. Note i have i5-9400 with 24G RAM but still it took long time build and i miserably failed to build ports or plugins at one shot (downloaded finally from pkg.opnsense web). Else i dont think i can get a DVD once this year. Earlier HBSD10 release i had not faced the issue like this. The issue  faced  was when a port/plugin build fails due to network error in downloading  source code or compile error it doesnt  create the pkg's build under sets. So every such  failure i  found nothing under the sets. It failed with error and i dont see the successfully built single port/plugin gets converted to sets packages.. Why it's so ?
-RackG

I'm still working on UEFI for 22.1 and had to revert a bit to the 21.7 state to make sure not to break anything there. It hasn't been very plug and play so far and it does't help that ISO and other images are using different FAT versions for whatever reason. This work is scheduled for December.

As for rust and other "build pollution": We try to provide a minimal build. Suricata then made the decision to make rust a hard dependency and it is the way it is really for us since a couple of years DAILY dealing with these shifts and decisions in the ports tree. You don't see me complaining about this very often. ;)


Cheers,
Franco

Franko,

I feel really bad for you and appreciate the build team for handling such tiresome work. KUDOS to you guys.. I understand RUST is hard requirement for suricata and RUST take time for compilation. Keep this appart i just wonder what was the issue with rest of the build infra.

To be very frank with you we compiled 10.x i think its 20.x OPNsense build a long time before and few attempts very successful.  My questions are as follows.

1. Why the pkg sets are not created for successfully compiled port for the plugins/ports when make dvd terminated due to network issue/delay or termination ?

2. I have seen RUST getting built twice in a single fresh run for make dvd (no packages under sets) Why so ?

That make me wondering something completely different the way the ports/plugins code works for 20.x codeline.
-RackG

November 19, 2021, 02:24:13 PM #8 Last Edit: November 19, 2021, 02:26:05 PM by franco
To avoid the issue in 1) there is a "make distfiles SETTINGS=22.1" target to cache all the required distfiles so no network required during the ports stage. Obviously this also speeds up subsequent builds a little.

For 2) I'm not sure as it should cache rust package for a single run as long as you don't build "packages" target which preps the target for mirror use removing go and rust in particular.

Our nightly build steps through the targets one by one instead of letting make(1) decide which dependency to build when is a little more reliable in the grand scheme of things, see

https://github.com/opnsense/tools/blob/master/composite/nightly.sh

If you do more than 1-2 builds I would highly recommend using the nightly target as a base for images since it also produces log files to skim through, see

https://nightly.opnsense.org/22.1/amd64/logs/202111191205/

As you can see we don't build images in nightly builds mostly because these builds are cheap when you have all the sets available via nightly. :)


Cheers,
Franco

Dear Franco,

As per your feedback i started running the nightly make. The results are no different than distfiles getting cache. Please find the logs attached. And you will find that no set (plugins/ports saved to the sets folder.)  This throws  me 1K miles aways to restart my journey again on build. Any help on fixing this.. More concerned about the plugins/ports sets not created for all the successfully built ones.

root@limestone:/usr/local/opnsense/build/22.1/amd64/logs/latest # tail -n 200 09-ports-OpenSSL.log
checking if cc supports -Werror=nonnull... yes
checking if cc supports -Werror=init-self... yes
checking if cc supports -Werror=main... yes
checking if cc supports -Werror=missing-braces... yes
checking if cc supports -Werror=sequence-point... yes
checking if cc supports -Werror=return-type... yes
checking if cc supports -Werror=trigraphs... yes
checking if cc supports -Werror=array-bounds... yes
checking if cc supports -Werror=write-strings... yes
checking if cc supports -Werror=address... yes
checking if cc supports -Werror=int-to-pointer-cast... yes
checking if cc supports -Werror=pointer-to-int-cast... yes
checking if cc supports -pedantic... yes
checking if cc supports -Werror... yes
checking if cc supports -Werror=attributes... yes
checking whether make supports nested variables... (cached) yes
checking for gzopen in -lz... yes
checking for vasprintf... (cached) yes
checking for MKFONTSCALE... yes
checking for X11... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating man/Makefile
config.status: creating config.h
config.status: executing depfiles commands
[20211126042817] ===> Building for mkfontscale-1.2.1
--- all ---
/usr/bin/make  all-recursive
--- all-recursive ---
Making all in man
--- mkfontdir.1 ---
--- mkfontscale.1 ---
--- mkfontdir.1 ---
/usr/bin/sed -e 's|__vendorversion__|"mkfontscale 1.2.1" "X Version 11"|'       -e 's|__xorgversion__|"mkfontscale 1.2.1" "X Version 11"|'      -e 's|__xservername__|Xorg|g'        -e 's|__xconfigfile__|xorg.conf|g'      -e 's|__projectroot__|/usr/local|g'     -e 's|__apploaddir__||g'        -e 's|__appmansuffix__|1|g'  -e 's|__drivermansuffix__|4|g'  -e 's|__adminmansuffix__|8|g'   -e 's|__libmansuffix__|3|g'     -e 's|__miscmansuffix__|7|g'    -e 's|__filemansuffix__|5|g' < mkfontdir.man > mkfontdir.1
--- mkfontscale.1 ---
/usr/bin/sed -e 's|__vendorversion__|"mkfontscale 1.2.1" "X Version 11"|'       -e 's|__xorgversion__|"mkfontscale 1.2.1" "X Version 11"|'      -e 's|__xservername__|Xorg|g'        -e 's|__xconfigfile__|xorg.conf|g'      -e 's|__projectroot__|/usr/local|g'     -e 's|__apploaddir__||g'        -e 's|__appmansuffix__|1|g'  -e 's|__drivermansuffix__|4|g'  -e 's|__adminmansuffix__|8|g'   -e 's|__libmansuffix__|3|g'     -e 's|__miscmansuffix__|7|g'    -e 's|__filemansuffix__|5|g' < mkfontscale.man > mkfontscale.1
--- constlist.o ---
--- hash.o ---
--- ident.o ---
--- list.o ---
--- constlist.o ---
cc -DHAVE_CONFIG_H -I.  -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/include/libpng16  -I/usr/local/include  -D_BSD_SOURCE   -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing -MT constlist.o -MD -MP -MF .deps/constlist.Tpo -c -o constlist.o constlist.c
--- hash.o ---
cc -DHAVE_CONFIG_H -I.  -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/include/libpng16  -I/usr/local/include  -D_BSD_SOURCE   -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing -MT hash.o -MD -MP -MF .deps/hash.Tpo -c -o hash.o hash.c
--- ident.o ---
cc -DHAVE_CONFIG_H -I.  -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/include/libpng16  -I/usr/local/include  -D_BSD_SOURCE   -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing -MT ident.o -MD -MP -MF .deps/ident.Tpo -c -o ident.o ident.c
--- list.o ---
cc -DHAVE_CONFIG_H -I.  -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/include/libpng16  -I/usr/local/include  -D_BSD_SOURCE   -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c
--- constlist.o ---
mv -f .deps/constlist.Tpo .deps/constlist.Po
--- mkfontscale.o ---
cc -DHAVE_CONFIG_H -I.  -I/usr/local/include -I/usr/local/include/freetype2 -I/usr/local/include/libpng16  -I/usr/local/include  -D_BSD_SOURCE   -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing -MT mkfontscale.o -MD -MP -MF .deps/mkfontscale.Tpo -c -o mkfontscale.o mkfontscale.c
--- hash.o ---
mv -f .deps/hash.Tpo .deps/hash.Po
--- mkfontscale.o ---
mkfontscale.c:779:66: warning: declaration shadows a variable in the global scope [-Wshadow]
doDirectory(const char *dirname_given, int numEncodings, ListPtr encodingsToDo)
                                                                 ^
mkfontscale.c:115:16: note: previous declaration is here
static ListPtr encodingsToDo;
               ^
mkfontscale.c:1293:23: warning: declaration shadows a variable in the global scope [-Wshadow]
readEncodings(ListPtr encodings, char *dirname)
                      ^
mkfontscale.c:92:21: note: previous declaration is here
static ConstListPtr encodings, extra_encodings;
                    ^
--- list.o ---
mv -f .deps/list.Tpo .deps/list.Po
--- mkfontdir ---
/usr/bin/sed -e 's|@bindir
  • |/usr/local/bin|g' < ./mkfontdir.in > mkfontdir
    --- ident.o ---
    mv -f .deps/ident.Tpo .deps/ident.Po
    --- mkfontscale.o ---
    2 warnings generated.
    mv -f .deps/mkfontscale.Tpo .deps/mkfontscale.Po
    --- mkfontscale ---
    cc -Wall -Wpointer-arith -Wmissing-declarations -Wformat=2 -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Wbad-function-cast -Wold-style-definition -Wdeclaration-after-statement -Wunused -Wuninitialized -Wshadow -Wmissing-noreturn -Wmissing-format-attribute -Wredundant-decls -Werror=implicit -Werror=nonnull -Werror=init-self -Werror=main -Werror=missing-braces -Werror=sequence-point -Werror=return-type -Werror=trigraphs -Werror=array-bounds -Werror=write-strings -Werror=address -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -fno-strict-aliasing -O2 -pipe  -fstack-protector-strong -fno-strict-aliasing  -fstack-protector-strong -o mkfontscale constlist.o hash.o  ident.o list.o mkfontscale.o -L/usr/local/lib -lfontenc -lfreetype -lz
    [20211126042818] ===> Staging for mkfontscale-1.2.1
    ===>   mkfontscale-1.2.1 depends on file: /usr/local/libdata/pkgconfig/fontenc.pc - found
    [20211126042818] ===> Generating temporary packing list
    Making install in man
    /bin/mkdir -p '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/man/man1'
    install  -m 0644 mkfontdir.1 mkfontscale.1 '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/man/man1'
    /bin/mkdir -p '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/bin'
      install  -s -m 555 mkfontscale '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/bin'
    /bin/mkdir -p '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/bin'
    install  -m 555 mkfontdir '/usr/obj/usr/ports/x11-fonts/mkfontscale/work/stage/usr/local/bin'
    [20211126042818] ====> Compressing man pages (compress-man)
    [20211126042818] ===> Installing for mkfontscale-1.2.1
    [20211126042818] ===> Checking if mkfontscale is already installed
    [20211126042818] ===> Registering installation for mkfontscale-1.2.1 as automatic
    Installing mkfontscale-1.2.1...
    ===>   urwfonts-1.0_8 depends on executable: mkfontscale - found
    ===>   Returning to build of urwfonts-1.0_8
    [20211126042818] ===> Generating temporary packing list
    install  -m 0644 /usr/obj/usr/ports/x11-fonts/urwfonts/work/URW/Fontmap /usr/obj/usr/ports/x11-fonts/urwfonts/work/stage/usr/local/share/fonts/urwfonts
    install  -m 0644 /usr/obj/usr/ports/x11-fonts/urwfonts/work/URW/*.pfb /usr/obj/usr/ports/x11-fonts/urwfonts/work/stage/usr/local/share/fonts/urwfonts
    install  -m 0644 /usr/obj/usr/ports/x11-fonts/urwfonts/work/URW/*.afm /usr/obj/usr/ports/x11-fonts/urwfonts/work/stage/usr/local/share/fonts/urwfonts
    install  -m 0644 /usr/obj/usr/ports/x11-fonts/urwfonts/work/URW/*.pfm /usr/obj/usr/ports/x11-fonts/urwfonts/work/stage/usr/local/share/fonts/urwfonts
    [20211126042818] ====> Compressing man pages (compress-man)
    [20211126042818] ===> Installing for urwfonts-1.0_8
    [20211126042818] ===> Checking if urwfonts is already installed
    [20211126042818] ===> Registering installation for urwfonts-1.0_8
    Installing urwfonts-1.0_8...
    You'll have to add /usr/local/share/fonts/urwfonts
    to your X font path by either:

    $ xset fp+ /usr/local/share/fonts/urwfonts
    $ xset fp rehash

    or by adding it to your X-server configuration file (usually
    /etc/X11/xorg.conf) and restarting the X-server.

    Creating package for expat-2.4.1
    expat-2.4.1 already packaged, skipping...
    Creating package for fontconfig-2.13.94_1,1
    fontconfig-2.13.94_1,1 already packaged, skipping...
    Creating package for freetype2-2.11.0
    freetype2-2.11.0 already packaged, skipping...
    Creating package for libfontenc-1.1.4
    Creating package for mkfontscale-1.2.1
    Creating package for pkg-1.16.3
    pkg-1.16.3 already packaged, skipping...
    Creating package for pkgconf-1.8.0,1
    pkgconf-1.8.0,1 already packaged, skipping...
    Creating package for png-1.6.37_1
    png-1.6.37_1 already packaged, skipping...
    Creating package for urwfonts-1.0_8
    Creating package for xorg-macros-1.19.3
    xorg-macros-1.19.3 already packaged, skipping...
    Creating package for xorgproto-2021.5
    xorgproto-2021.5 already packaged, skipping...
    >>> Locking package dependency: pkgconf
    >>> Locking package dependency: pkg
    >>> Locking package dependency: urwfonts
    Updating database digests format: .......... done
    Checking integrity... done (0 conflicting)
    Deinstallation has been requested for the following 2 packages:

    Installed packages to be REMOVED:
            xorg-macros: 1.19.3
            xorgproto: 2021.5

    Number of packages to be removed: 2

    The operation will free 1 MiB.
    [1/2] Deinstalling xorg-macros-1.19.3...
    [1/2] Deleting files for xorg-macros-1.19.3: ...... done
    [2/2] Deinstalling xorgproto-2021.5...
    [2/2] Deleting files for xorgproto-2021.5: .......... done
    >>> Saving runtime package: libfontenc
    >>> Saving runtime package: mkfontscale
    >>> Saving runtime package: urwfonts
    [20211126042823] ===> Cleaning for mkfontscale-1.2.1
    [20211126042824] ===> Cleaning for libfontenc-1.1.4
    [20211126042824] ===> Cleaning for urwfonts-1.0_8
    Checking integrity... done (0 conflicting)
    Deinstallation has been requested for the following 9 packages:

    Installed packages to be REMOVED:
            expat: 2.4.1
            fontconfig: 2.13.94_1,1
            freetype2: 2.11.0
            libfontenc: 1.1.4
            mkfontscale: 1.2.1
            pkg: 1.16.3
            pkgconf: 1.8.0,1
            png: 1.6.37_1
            urwfonts: 1.0_8

    Number of packages to be removed: 9

    The operation will free 21 MiB.
    [1/9] Deinstalling urwfonts-1.0_8...
    [1/9] Deleting files for urwfonts-1.0_8: .......... done
    [2/9] Deinstalling fontconfig-2.13.94_1,1...
    [2/9] Deleting files for fontconfig-2.13.94_1,1: .......... done
    [3/9] Deinstalling mkfontscale-1.2.1...
    [3/9] Deleting files for mkfontscale-1.2.1: ....... done
    [4/9] Deinstalling freetype2-2.11.0...
    [4/9] Deleting files for freetype2-2.11.0: .......... done
    [5/9] Deinstalling expat-2.4.1...
    [5/9] Deleting files for expat-2.4.1: .......... done
    [6/9] Deinstalling libfontenc-1.1.4...
    [6/9] Deleting files for libfontenc-1.1.4: ......... done
    [7/9] Deinstalling pkg-1.16.3...
    [7/9] Deleting files for pkg-1.16.3: .......... done
    [8/9] Deinstalling pkgconf-1.8.0,1...
    [8/9] Deleting files for pkgconf-1.8.0,1: .......... done
    [9/9] Deinstalling png-1.6.37_1...
    [9/9] Deleting files for png-1.6.37_1: .......... done
    pkg: No package files have been found
    Cannot create repository catalogue
    *** Error code 1

    Stop.
    make[1]: stopped in /usr/tools
        53412.08 real     77975.59 user      9445.60 sys
    root@limestone:/usr/local/opnsense/build/22.1/amd64/logs/latest #



-RackG

Some more logs strange behavior w.r.t file system space.

root@limestone:/usr/tools # mount
/dev/gpt/rootfs on / (ufs, local, soft-updates)
devfs on /dev (devfs)
/dev/gpt/efiesp on /boot/efi (msdosfs, local)
<below>:/usr/ports on /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/usr/ports (unionfs, local, soft-updates)
<below>:/usr/src on /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/usr/src (unionfs, local, soft-updates)
devfs on /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/dev (devfs)
<below>:/usr/ports on /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/usr/ports (unionfs, local, soft-updates)
<below>:/usr/src on /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/usr/src (unionfs, local, soft-updates)
devfs on /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/dev (devfs)
root@limestone:/usr/tools #
root@limestone:/usr/tools #
root@limestone:/usr/tools #
root@limestone:/usr/tools # df -h
Filesystem            Size    Used   Avail Capacity  Mounted on
/dev/gpt/rootfs        76G     48G     22G    69%    /
devfs                 1.0K    1.0K      0B   100%    /dev
/dev/gpt/efiesp        32M    878K     31M     3%    /boot/efi
<below>:/usr/ports    153G    125G     22G    85%    /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/usr/ports
<below>:/usr/src      153G    125G     22G    85%    /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/usr/src
devfs                 1.0K    1.0K      0B   100%    /usr/obj/usr/tools/config/22.1/LibreSSL:amd64/dev
<below>:/usr/ports    153G    125G     22G    85%    /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/usr/ports
<below>:/usr/src      153G    125G     22G    85%    /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/usr/src
devfs                 1.0K    1.0K      0B   100%    /usr/obj/usr/tools/config/22.1/OpenSSL:amd64/dev
root@limestone:/usr/tools #


-RackG

Any help ? Waiting for your update to fix this issue.
-RackG

I would try a fresh install, disable LibreSSL, dont touch anything else (like additional ports etc.) and start with make dvd. If this works then enlarge, if not, there's room to debug.

My guess is that pkg 1.17 installed in your build system breaks this. You can see the failing command with VERBOSE=yes and I suspect that pkg-repo looks for *.pkg files but we still have *.txz files.

Not a lot of care was taken by the FreeBSD ecosystem to keep the established system running with anything but cutting edge tools that do produce backwards compatible output, but that's obviously not our worry here since we can't get to that state where it produces anything. ;)


Cheers,
Franco

December 02, 2021, 01:43:35 AM #14 Last Edit: December 02, 2021, 05:38:33 PM by efetropy
Quote from: rackg on November 26, 2021, 06:00:53 AM
[...]
pkg: No package files have been found
Cannot create repository catalogue
*** Error code 1

Stop.
[...]

I am using a similar setup but cross compiling for aarch64 on a FreeBSD 13 host. Ran into the same issue twice.

Quote from: franco on December 01, 2021, 02:46:55 PM
My guess is that pkg 1.17 installed in your build system breaks this. You can see the failing command with VERBOSE=yes and I suspect that pkg-repo looks for *.pkg files but we still have *.txz files.


That's good to know. In that case, maybe pkg 1.16.3 is worth a try. I will give it a shot and am hoping for a successful build this time  ::)

BR,
efe

UPDATE: Franco's guess turned out to be the case here. In fact, the newer pkg version breaks the build. Using 1.16.3 worked out for me. Although some packages were not built (some of them require go as build dependency and we are not building go for arm, arm64 as per aux.conf). Will have a look later and see if I can build them separately.


[7/9] Deleting files for pkg-1.16.3: 100%
[8/9] Deinstalling pkgconf-1.8.0,1...
[8/9] Deleting files for pkgconf-1.8.0,1: 100%
[9/9] Deinstalling png-1.6.37_1...
[9/9] Deleting files for png-1.6.37_1: 100%
Creating repository in /usr/obj/usr/tools/config/22.1/OpenSSL:aarch64/.pkg-new/: 100%
Packing files for repository: 100%
>>> Running build step: clean
>>> Passing arguments: packages
>>> Removing packages set
>>> Creating package mirror set for 21.7.6_87-OpenSSL-aarch64... done
-rw-r--r--  1 root  wheel   338M Dec  2 12:32 packages-21.7.6_87-OpenSSL-aarch64.tar
>>> ERROR: The build encountered fatal issues!
>>> Aborted version 2.0.45 for dns/dnscrypt-proxy2
>>> Aborted version 1.31.0_1 for net-mgmt/netdata
>>> Aborted version 1.20.4 for net-mgmt/telegraf
>>> Aborted version 196.04 for net/realtek-re-kmod
>>> Aborted version 4.36.2 for net/v2ray
>>> Aborted version 2,1 for net/wireguard
>>> Aborted version 0.0.20211016,1 for net/wireguard-go
>>> Aborted version 0.0.20211105 for net/wireguard-kmod
>>> Aborted version 1.8.2 for security/vault
>>> Aborted version 4.1.1 for security/yara
>>> Aborted version 4.7.0 for sysutils/ansible@py38
>>> Aborted version 7.15.2 for sysutils/beats7
>>> Aborted version 1.10.3 for sysutils/consul
>>> Aborted version 1.2.2 for sysutils/node_exporter
*** Error code 1

Stop.
make: stopped in /usr/tools


UPDATE 2: Looks like cross compiling go doesn't work. Will try to build the remaining packages natively on the device