[SOLVED] Build OPNSense 16.7 failed ...

[Mohiuddin]

Hi Franco

I ran 'make distfiles' and then 'make ports' both completed successfully. Then I ran 'make cdrom' again, stuck again, here's the partial log:

...
...
...
Installing gettext-tools-0.19.8.1...
`-- Installing gettext-runtime-0.19.8.1...
`-- Extracting gettext-runtime-0.19.8.1: 100%
Extracting gettext-tools-0.19.8.1: 100%
>>> Locking packages in /usr/obj/usr/tools/config/16.7/OpenSSL:amd64: -a
>>> Setting up /usr/core clone in /usr/obj/usr/tools/config/16.7/OpenSSL:amd64
>>> Removing packages in /usr/obj/usr/tools/config/16.7/OpenSSL:amd64: opnsense
>>> Installing packages in /usr/obj/usr/tools/config/16.7/OpenSSL:amd64: beep bsdinstaller apinger bind910 bsnmp-regex bsnmp-ucd ca_root_nss choparp cpustats dhcp6 dhcpleases dnsmasq expiretable filterdns filterlog ifinfo flock flowd igmpproxy isc-dhcp43-client isc-dhcp43-relay isc-dhcp43-server lighttpd miniupnpd mpd5 ntp openssh-portable openvpn opnsense-lang opnsense-update pam_opnsense pecl-radius pftop phalcon php-suhosin php56-ctype php56-curl php56-dom php56-filter php56-gettext php56-hash php56-json php56-ldap php56-mcrypt php56-openssl php56-pdo php56-session php56-simplexml php56-sockets php56-sqlite3 php56-xml php56-zlib py27-Jinja2 py27-netaddr py27-requests py27-sqlite3 py27-ujson radvd rate relayd rrdtool12 samplicator squid sshlockout_pf strongswan sudo suricata syslogd unbound wol zip
Updating database digests format: 100%

ca_root_nss-3.27.1 is locked and may not be modified

curl-7.51.0_1 is locked and may not be modified

cvsps-2.1_2 is locked and may not be modified

expat-2.2.0 is locked and may not be modified

gettext-runtime-0.19.8.1 is locked and may not be modified

gettext-tools-0.19.8.1 is locked and may not be modified

git-2.10.2 is locked and may not be modified

indexinfo-0.2.6 is locked and may not be modified

libffi-3.2.1 is locked and may not be modified

openssl-1.0.2j_1,1 is locked and may not be modified

p5-Error-0.17024 is locked and may not be modified

pcre-8.39 is locked and may not be modified

perl5-5.24.1.r4 is locked and may not be modified

pkg-1.9.3_1 is locked and may not be modified

python27-2.7.12 is locked and may not be modified
Checking integrity... done (0 conflicting)
Nothing to do.
Installing pkg-1.9.3_1...
the most recent version of pkg-1.9.3_1 is already installed
Installing beep-1.0_1...
Extracting beep-1.0_1: 100%
Installing bsdinstaller-16.7_1...
`-- Installing cpdup-1.18...
`-- Extracting cpdup-1.18: 100%
Extracting bsdinstaller-16.7_1: 100%
Installing apinger-0.7...
Extracting apinger-0.7: 100%
Installing bind910-9.10.4P4...
`-- Installing libxml2-2.9.4...
`-- Extracting libxml2-2.9.4: 100%
`-- Installing idnkit-1.0_5...
`-- Extracting idnkit-1.0_5: 100%
`-- Installing libedit-3.1.20150325_2,1...
`-- Extracting libedit-3.1.20150325_2,1: 100%
Extracting bind910-9.10.4P4: 100%
Message from idnkit-1.0_5:
===>   NOTICE:

The idnkit port currently does not have a maintainer. As a result, it is
more likely to have unresolved issues, not be up-to-date, or even be removed in
the future. To volunteer to maintain this port, please create an issue at:

https://bugs.freebsd.org/bugzilla

More information about port maintainership is available at:

https://www.freebsd.org/doc/en/articles/contributing/ports-contributing.html#maintain-port
Message from bind910-9.10.4P4:
**********************************************************************
*            _  _____ _____ _____ _   _ _____ ___ ___  _   _         *
*           / \|_   _|_   _| ____| \ | |_   _|_ _/ _ \| \ | |        *
*          / _ \ | |   | | |  _| |  \| | | |  | | | | |  \| |        *
*         / ___ \| |   | | | |___| |\  | | |  | | |_| | |\  |        *
*        /_/   \_\_|   |_| |_____|_| \_| |_| |___\___/|_| \_|        *
*                                                                    *
*   BIND requires configuration of rndc, including a "secret" key.   *
*    The easiest, and most secure way to configure rndc is to run    *
*   'rndc-confgen -a' to generate the proper conf file, with a new   *
*            random key, and appropriate file permissions.           *
*                                                                    *
*     The /usr/local/etc/rc.d/named script will do that for you.     *
*                                                                    *
**********************************************************************
Could not find package: bsnmp-regex
*** Error code 1

Stop.
make: stopped in /usr/tools
root@brotecs:/usr/tools #
_________________________________________________________________


Also adding the current 'tar tf /tmp/sets/packages-*' output:

root@brotecs:/usr/tools # tar tf /tmp/sets/packages-*
./
./Latest/
./All/
./.plugins_done
./digests.txz
./meta.txz
./packagesite.txz
./All/acme-tiny-0.0.g.2016.08.18.txz
./All/apinger-0.7.txz
./All/autoconf-2.69_1.txz
./All/autoconf-wrapper-20131203.txz
./All/automake-1.15_1.txz
./All/automake-wrapper-20131203.txz
./All/beep-1.0_1.txz
./All/bind910-9.10.4P4.txz
./All/bison-2.7.1,1.txz
./All/bsdinstaller-16.7_1.txz
./All/ca_root_nss-3.27.1.txz
./All/clog-1.0.1_3.txz
./All/cmake-3.6.3.txz
./All/cmake-modules-3.6.3.txz
./All/cpdup-1.18.txz
./All/cpustats-0.1.txz
./All/curl-7.51.0_1.txz
./All/cvsps-2.1_2.txz
./All/cyrus-sasl-2.1.26_12.txz
./All/ddclient-3.8.3.txz
./All/dhcpleases-0.2.txz
./All/dnscrypt-proxy-1.7.0.txz
./All/dnsmasq-2.76,1.txz
./All/expat-2.2.0.txz
./All/filterdns-0.2.txz
./All/filterlog-0.2.txz
./All/freetype2-2.6.3.txz
./All/gettext-0.19.8.1.txz
./All/gettext-runtime-0.19.8.1.txz
./All/gettext-tools-0.19.8.1.txz
./All/git-2.10.2.txz
./All/glib-2.46.2_4.txz
./All/gmake-4.2.1_1.txz
./All/gmp-5.1.3_3.txz
./All/gnokii-0.6.31_7,1.txz
./All/help2man-1.43.3_1.txz
./All/icu-58.1,1.txz
./All/idnkit-1.0_5.txz
./All/ifinfo-10.1.txz
./All/indexinfo-0.2.6.txz
./All/iperf3-3.1.4.txz
./All/joe-4.2_1,1.txz
./All/jsoncpp-1.7.7.txz
./All/kermit-9.0.304.txz
./All/ldns-1.6.17_5.txz
./All/libarchive-3.2.2,1.txz
./All/libart_lgpl-2.3.21_2,1.txz
./All/libdnet-1.12_1.txz
./All/libedit-3.1.20150325_2,1.txz
./All/libevent2-2.0.22_1.txz
./All/libffi-3.2.1.txz
./All/libiconv-1.14_9.txz
./All/libidn-1.33_1.txz
./All/libltdl-2.4.6.txz
./All/liblz4-131.txz
./All/libsodium-1.0.11_1.txz
./All/libtool-2.4.6.txz
./All/libucl-0.8.0.txz
./All/libxml2-2.9.4.txz
./All/libyaml-0.1.6_2.txz
./All/lzo2-2.09.txz
./All/m4-1.4.17_1,1.txz
./All/maradns-2.0.13.txz
./All/nano-2.7.1.txz
./All/nettle-3.2.txz
./All/ngattach-1.2.txz
./All/open-vm-tools-nox11-1280544_16,1.txz
./All/p5-Socket-2.024.txz
./All/openldap-sasl-client-2.4.44.txz
./All/openldap-sasl-server-2.4.44.txz
./All/openssl-1.0.2j_1,1.txz
./All/opnsense-lang-16.7.7.txz
./All/opnsense-update-16.7.7_1.txz
./All/p5-Cpanel-JSON-XS-3.0225.txz
./All/p5-Error-0.17024.txz
./All/p5-IO-Socket-IP-0.38.txz
./All/p5-IO-Socket-SSL-2.038.txz
./All/p5-JSON-Any-1.39.txz
./All/p5-Mozilla-CA-20160104.txz
./All/p5-Net-SSLeay-1.78.txz
./All/pam_opnsense-16.7.txz
./All/patch-2.7.5.txz
./All/pcre-8.39.txz
./All/pear-1.10.1.txz
./All/pear-PHP_CodeSniffer-2.6.2.txz
./All/perl5-5.24.1.r4.txz
./All/php-xdebug-2.4.0_1.txz
./All/php56-5.6.28.txz
./All/php56-ctype-5.6.28.txz
./All/php56-curl-5.6.28.txz
./All/php56-dom-5.6.28.txz
./All/php56-gettext-5.6.28.txz
./All/php56-hash-5.6.28.txz
./All/php56-json-5.6.28.txz
./All/php56-mysql-5.6.28.txz
./All/php56-mysqli-5.6.28.txz
./All/php56-phar-5.6.28.txz
./All/php56-simplexml-5.6.28.txz
./All/php56-xml-5.6.28.txz
./All/php56-sqlite3-5.6.28.txz
./All/php56-tokenizer-5.6.28.txz
./All/php56-xmlwriter-5.6.28.txz
./All/php56-zlib-5.6.28.txz
./All/phpunit-5.6.3.txz
./All/pkg-1.9.3_1.txz
./All/pkgconf-1.0.2.txz
./All/png-1.6.26.txz
./All/py27-Babel-2.3.4.txz
./All/py27-Jinja2-2.8.txz
./All/py27-MarkupSafe-0.23.txz
./All/py27-fail2ban-0.9.5.txz
./All/py27-netaddr-0.7.18.txz
./All/py27-pytz-2016.7,1.txz
./All/py27-requests-2.11.1.txz
./All/py27-setuptools27-28.1.0.txz
./All/py27-sqlite3-2.7.12_7.txz
./All/py27-ujson-1.35.txz
./All/py35-Babel-2.3.4.txz
./All/py35-Jinja2-2.8.txz
./All/py35-MarkupSafe-0.23.txz
./All/py35-netaddr-0.7.18.txz
./All/py35-pytz-2016.7,1.txz
./All/py35-requests-2.11.1.txz
./All/py35-setuptools35-28.1.0.txz
./All/py35-sqlite3-3.5.2_7.txz
./All/py35-ujson-1.35.txz
./All/python27-2.7.12.txz
./All/python35-3.5.2.txz
./All/rrdtool12-1.2.30_7.txz
./All/ruby-2.3.3,1.txz
./All/sqlite3-3.15.1_1.txz
./All/sshlockout_pf-0.0.2_2.txz
./All/syslogd-11.0.txz
./All/uftp-4.9.2,1.txz
./All/unbound-1.5.10.txz
./All/vim-lite-8.0.0102.txz
./All/wget-1.18.txz
./All/zip-3.0_1.txz
./Latest/pkg.txz
root@brotecs:/usr/tools #


Thanks!

Mohiuddin.

[franco]

No, it aborted again... bsnmp packages not done... Rerun make ports and provide the output of it... We're running into an error we're not seeing. ;)

[Mohiuddin]

Hi Franco

I reran the 'make ports' it gave no error.

Then 'make cdrom', tstuck in the same bsnmp-regex.

Regards.

Mohiuddin.

[franco]

Hmm, have you updated tools.git recently? Specifically this commit...

https://github.com/opnsense/tools/commit/7def184ade5

If make ports still returns no error we'd still need to look at the output of the command to troubleshoot.


Thanks,
Franco

[Mohiuddin]

Hi Franco

A little further above I see a package make error for 'graphviz', here's the partial log:

LOG:
...
...
...
libtool: compile:  cc -DHAVE_CONFIG_H -I. -I../.. -I../../lib/common -I../.. -I../../lib/common -I../../lib/sparse -I../../lib/gvc -I../../lib/pathplan -I../../lib/sfdpgen -I../../lib/cgraph -I../../lib/cdt -I/usr/local/include -I/usr/local/include -O2 -pipe -fstack-protector -fno-strict-aliasing -Wstrict-prototypes -Wpointer-arith -Wall -ffast-math -MT lab.lo -MD -MP -MF .deps/lab.Tpo -c lab.c  -fPIC -DPIC -o .libs/lab.o
cc: error: unable to execute command: Killed
cc: error: clang frontend command failed due to signal (use -v to see invocation)
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
Target: x86_64-unknown-freebsd10.3
Thread model: posix
cc: note: diagnostic msg: PLEASE submit a bug report to https://bugs.freebsd.org/submit/ and include the crash backtrace, preprocessed source, and associated run script.
cc: note: diagnostic msg: Error generating preprocessed source(s).
gmake[4]: *** [Makefile:570: lab.lo] Error 1
gmake[4]: Leaving directory '/usr/obj/usr/ports/graphics/graphviz/work/graphviz-2.38.0/lib/edgepaint'
gmake[3]: *** [Makefile:536: all-recursive] Error 1
gmake[3]: Leaving directory '/usr/obj/usr/ports/graphics/graphviz/work/graphviz-2.38.0/lib'
gmake[2]: *** [Makefile:774: all-recursive] Error 1
gmake[2]: Leaving directory '/usr/obj/usr/ports/graphics/graphviz/work/graphviz-2.38.0'
gmake[1]: *** [Makefile:583: all] Error 2
gmake[1]: Leaving directory '/usr/obj/usr/ports/graphics/graphviz/work/graphviz-2.38.0'
===> Compilation failed unexpectedly.
Try to set MAKE_JOBS_UNSAFE=yes and rebuild before reporting the failure to
the maintainer.
*** Error code 1

Stop.
make: stopped in /usr/ports/graphics/graphviz
>>> Creating binary packages...
Updating database digests format: 100%

php56-ctype-5.6.28 is locked and may not be modified

php56-simplexml-5.6.28 is locked and may not be modified

php56-xml-5.6.28 is locked and may not be modified

php56-zlib-5.6.28 is locked and may not be modified
Checking integrity... done (0 conflicting)
Deinstallation has been requested for the following 8 packages:

Installed packages to be REMOVED:
   libgd-2.2.3_1,1
   fontconfig-2.12.1,1
   webp-0.5.1_1
   giflib-5.1.4
   tiff-4.0.7
   jbigkit-2.1_1
   jpeg-turbo-1.5.1
   nasm-2.11.08_1,1

Number of packages to be removed: 8

The operation will free 9 MiB.
[1/8] Deinstalling libgd-2.2.3_1,1...
[1/8] Deleting files for libgd-2.2.3_1,1: 100%
[2/8] Deinstalling webp-0.5.1_1...
[2/8] Deleting files for webp-0.5.1_1: 100%
[3/8] Deinstalling tiff-4.0.7...
[3/8] Deleting files for tiff-4.0.7: 100%
[4/8] Deinstalling fontconfig-2.12.1,1...
[4/8] Deleting files for fontconfig-2.12.1,1: 100%
[5/8] Deinstalling giflib-5.1.4...
[5/8] Deleting files for giflib-5.1.4: 100%
[6/8] Deinstalling jbigkit-2.1_1...
[6/8] Deleting files for jbigkit-2.1_1: 100%
[7/8] Deinstalling jpeg-turbo-1.5.1...
[7/8] Deleting files for jpeg-turbo-1.5.1: 100%
[8/8] Deinstalling nasm-2.11.08_1,1...
[8/8] Deleting files for nasm-2.11.08_1,1: 100%
Loading the package list...

...
...
...

Regards.

Mohiuddin.

[franco]

Maybe you are running low on RAM in the build box? Otherwise remove graphviz from config/16.7/ports.conf and rerun.

Not having this failure in my builds... here is a package from just yesterday... all went fine.

https://pkg.opnsense.org/FreeBSD:10:amd64/MINT/16.7.10/LibreSSL/All/graphviz-2.38.0_14.txz


Cheers,
Franco

[Mohiuddin]

Hi Franco

Build Success!!!

Here's the end logs:

...
...
...
Message from opnsense-17.1.a_808:
Thanks for all the fish...
>>> Begin extra: cdrom_hook
rc.loader: assembling banner
rc.loader: assembling brand
rc.loader: assembling misc
rc.loader: assembling modules
rc.loader: assembling netgraph
>>> End extra: cdrom_hook
>>> Creating mtree summary of files present...
>>> Setting up entropy in /usr/obj/usr/tools/config/16.7/OpenSSL:amd64/work
1+0 records in
1+0 records out
4096 bytes transferred in 0.000124 secs (33038210 bytes/sec)
1+0 records in
1+0 records out
4096 bytes transferred in 0.000117 secs (35060958 bytes/sec)
200+0 records in
200+0 records out
819200 bytes transferred in 0.030236 secs (27093526 bytes/sec)
newfs_msdos: cannot get number of sectors per track: Operation not supported
newfs_msdos: cannot get number of heads: Operation not supported
newfs_msdos: trim 25 sectors to adjust to a multiple of 63
/dev/md0: 1532 sectors in 1532 FAT12 clusters (512 bytes/cluster)
BytesPerSec=512 SecPerClust=1 ResSectors=1 FATs=2 RootDirEnts=512 Sectors=1575 Media=0xf8 FATsecs=5 SecPerTrack=63 Heads=1 HiddenSecs=0
>>> Building cdrom image... done
root@brotecs:/usr/tools #

___________________


I increased the ram but still was getting stuck in previous error. The issue was, I didn't run 'pkg update' after installing the FreeBSd 10.3 64bit VM. Seems it's a must after installing the OS to 'make cdrom' complete properly, You may say in details why! What I did is I deleted 'src' and 'ports' folder re-checkout them again, then ran 'git checkout stable/16.7' from src, 'make clean-obj' from 'tools', after that 'make cdrom is a success'. Thanks for All your help! I appreciate it! I will certainly knock again if I get stuck! Hopefully in some other topic of course! Till then Good Luck! :D ...

With Best Wishes!

Mohiuddin.