unable to build pkg (fetch - not found)

[Balazs Toth]

Hi,

I tried to build some package from ports and that depends on pkg. Unfortunately not possible to download the distfile (I guess regards to some git server change, or maybe I do something wrong?). Any advice?

The pkg build log attached

=> HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz doesn't seem to exist in /portdistfiles/.

=> Attempting to fetch https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz

fetch: https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: size unknown

fetch: https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: size of remote file is not know

HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.ta          50 kB  566 kBps    00s

=> Fetched file size mismatch (expected 3834627, actual 51755)

=> Trying next site

=> Attempting to fetch http://distcache.FreeBSD.org/ports-distfiles/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz

fetch: http://distcache.FreeBSD.org/ports-distfiles/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: Not Found

=> Couldn't fetch it - please try to retrieve this

=> port manually into /portdistfiles/ and try again.

*** Error code 1

B

[Shawn Webb]

> =>> Building ports-mgmt/pkg
> build started at Sat May 8 18:18:45 CEST 2021
> port directory: /usr/ports/ports-mgmt/pkg
> package name: pkg-1.16.3
> building for: FreeBSD myhbsd13-local-job-01 13.0--HBSD FreeBSD 13.0--HBSD 1300504 amd64
> maintained by: p...@FreeBSD.org
> Makefile ident:
> Poudriere version: 3.3.6
> Host OSVERSION: 1300504
> Jail OSVERSION: 1300504
> Job Id: 01
>
> ---Begin Environment---
> SHELL=/bin/csh
> OSVERSION=1300504
> UNAME_v=FreeBSD 13.0--HBSD 1300504
> UNAME_r=13.0--HBSD
> BLOCKSIZE=K
> MAIL=/var/mail/root
> MM_CHARSET=UTF-8
> LANG=C.UTF-8
> STATUS=1
> HOME=/root
> PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/root/bin
> LOCALBASE=/usr/local
> USER=root
> LIBEXECPREFIX=/usr/local/libexec/poudriere
> POUDRIERE_VERSION=3.3.6
> MASTERMNT=/poudriere/jails/data/.m/myhbsd13-local/ref
> POUDRIERE_BUILD_TYPE=bulk
> PACKAGE_BUILDING=yes
> SAVED_TERM=xterm-256color
> PWD=/poudriere/jails/data/.m/myhbsd13-local/ref/.p/pool
> P_PORTS_FEATURES=FLAVORS SELECTED_OPTIONS
> MASTERNAME=myhbsd13-local
> SCRIPTPREFIX=/usr/local/share/poudriere
> OLDPWD=/poudriere/jails/data/.m/myhbsd13-local/ref/.p
> SCRIPTPATH=/usr/local/share/poudriere/bulk.sh
> POUDRIEREPATH=/usr/local/bin/poudriere
> ---End Environment---
>
> ---Begin Poudriere Port Flags/Env---
> PORT_FLAGS=
> PKGENV=
> FLAVOR=
> DEPENDS_ARGS=
> MAKE_ARGS=
> ---End Poudriere Port Flags/Env---
>
> ---Begin OPTIONS List---
> ===> The following configuration options are available for pkg-1.16.3:
> DOCS=on: Build and/or install documentation
> ====> Options available for the group HARDENING
> PIE=off: Build as Position Independent Executable
> RELRO=on: Build with Relocation Read-Only + BIND_NOW
> SAFESTACK=off: Build with SafeStack
> CFI=off: Build with Control Flow Integrity
> RETPOLINE=on: Build with Retpoline
> SLH=off: Build with Speculative Load Hardening (large perf hit)
> STACKAUTOINIT=on: Stack Auto-Zero-Initialization
> ===> Use 'make config' to modify these settings
> ---End OPTIONS List---
>
> --MAINTAINER--
> p...@FreeBSD.org
> --End MAINTAINER--
>
> --CONFIGURE_ARGS--
> --mandir=/usr/local/man --prefix="/usr/local"
> --End CONFIGURE_ARGS--
>
> --CONFIGURE_ENV--
> CC_FOR_BUILD="cc" XDG_DATA_HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work XDG_CONFIG_HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work TMPDIR="/tmp" PATH=/wrkdirs/usr/ports/ports-mgmt/pkg/work/.bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/root/bin SHELL=/bin/sh CONFIG_SHELL=/bin/sh
> --End CONFIGURE_ENV--
>
> --MAKE_ENV--
> XDG_DATA_HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work XDG_CONFIG_HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work HOME=/wrkdirs/usr/ports/ports-mgmt/pkg/work TMPDIR="/tmp" PATH=/wrkdirs/usr/ports/ports-mgmt/pkg/work/.bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:/root/bin NO_PIE=yes MK_DEBUG_FILES=no MK_KERNEL_SYMBOLS=no SHELL=/bin/sh NO_LINT=YES PREFIX=/usr/local LOCALBASE=/usr/local CC="cc" CFLAGS="-O2 -pipe -DHARDENEDBSD -Wno-error -mretpoline -ftrivial-auto-var-init=zero -enable-trivial-auto-var-init-zero-knowing-it-will-be-removed-from-clang -fstack-protector-all -fno-strict-aliasing " CPP="cpp" CPPFLAGS="" LDFLAGS=" -Wl,-z,relro -Wl,-z,now -fstack-protector-all " LIBS="" CXX="c++" CXXFLAGS="-O2 -pipe -DHARDENEDBSD -Wno-error -mretpoline -ftrivial-auto-var-init=zero -enable-trivial-auto-var-init-zero-knowing-it-will-be-removed-from-clang -fstack-protector-all -fno-strict-aliasing -DHARDENEDBSD -mretpoline -ftrivial-auto-var-init=zero -enable-trivial-auto-var-init-zero-knowing-it-will-be-removed-from-clang " MANPREFIX="/usr/local" BSD_INSTALL_PROGRAM="install -s -m 555" BSD_INSTALL_LIB="install -s -m 0644" BSD_INSTALL_SCRIPT="install -m 555" BSD_INSTALL_DATA="install -m 0644" BSD_INSTALL_MAN="install -m 444"
> --End MAKE_ENV--
>
> --PLIST_SUB--
> PORTDOCS="" OSREL=13.0 PREFIX=%D LOCALBASE=/usr/local RESETPREFIX=/usr/local LIB32DIR=lib DOCSDIR="share/doc/pkg" EXAMPLESDIR="share/examples/pkg" DATADIR="share/pkg" WWWDIR="www/pkg" ETCDIR="etc/pkg"
> --End PLIST_SUB--
>
> --SUB_LIST--
> PREFIX=/usr/local LOCALBASE=/usr/local DATADIR=/usr/local/share/pkg DOCSDIR=/usr/local/share/doc/pkg EXAMPLESDIR=/usr/local/share/examples/pkg WWWDIR=/usr/local/www/pkg ETCDIR=/usr/local/etc/pkg
> --End SUB_LIST--
>
> ---Begin make.conf---
> USE_PACKAGE_DEPENDS=yes
> BATCH=yes
> WRKDIRPREFIX=/wrkdirs
> PORTSDIR=/usr/ports
> PACKAGES=/packages
> DISTDIR=/distfiles
> FORCE_PACKAGE=yes
> PACKAGE_BUILDING=yes
> PACKAGE_BUILDING_FLAVORS=yes
> #### /usr/ports/Mk/Scripts/ports_env.sh ####
> _CCVERSION_921dbbb2=FreeBSD clang version 11.0.1 (g...@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe) Target: x86_64-unknown-freebsd13.0 Thread model: posix InstalledDir: /usr/bin
> _ALTCCVERSION_921dbbb2=none
> _CXXINTERNAL_acaad9ca=FreeBSD clang version 11.0.1 (g...@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe) Target: x86_64-unknown-freebsd13.0 Thread model: posix InstalledDir: /usr/bin "/usr/bin/ld" "--eh-frame-hdr" "-dynamic-linker" "/libexec/ld-elf.so.1" "--hash-style=both" "--enable-new-dtags" "-o" "a.out" "/usr/lib/crt1.o" "/usr/lib/crti.o" "/usr/lib/crtbegin.o" "-L/usr/lib" "/dev/null" "-lc++" "-lm" "-lgcc" "--as-needed" "-lgcc_s" "--no-as-needed" "-lc" "-lgcc" "--as-needed" "-lgcc_s" "--no-as-needed" "/usr/lib/crtend.o" "/usr/lib/crtn.o"
> CC_OUTPUT_921dbbb2_58173849=yes
> CC_OUTPUT_921dbbb2_9bdba57c=yes
> CC_OUTPUT_921dbbb2_6a4fe7f5=yes
> CC_OUTPUT_921dbbb2_6bcac02b=yes
> CC_OUTPUT_921dbbb2_67d20829=yes
> CC_OUTPUT_921dbbb2_bfa62e83=yes
> CC_OUTPUT_921dbbb2_f0b4d593=yes
> CC_OUTPUT_921dbbb2_308abb44=yes
> CC_OUTPUT_921dbbb2_f00456e5=yes
> CC_OUTPUT_921dbbb2_65ad290d=yes
> CC_OUTPUT_921dbbb2_f2776b26=yes
> CC_OUTPUT_921dbbb2_b2657cc3=yes
> CC_OUTPUT_921dbbb2_380987f7=yes
> CC_OUTPUT_921dbbb2_160933ec=yes
> CC_OUTPUT_921dbbb2_fb62803b=yes
> _OBJC_CCVERSION_921dbbb2=FreeBSD clang version 11.0.1 (g...@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe) Target: x86_64-unknown-freebsd13.0 Thread model: posix InstalledDir: /usr/bin
> _OBJC_ALTCCVERSION_921dbbb2=none
> ARCH=amd64
> OPSYS=FreeBSD
> _OSRELEASE=13.0--HBSD
> OSREL=13.0
> OSVERSION=1300504
> LLD_IS_LD=yes
> LLVM_AR_IS_AR=yes
> LLVM_NM_IS_NM=yes
> LLVM_RANLIB_IS_RANLIB=yes
> LLVM_OBJDUMP_IS_OBJDUMP=yes
> PYTHONBASE=/usr/local
> _SMP_CPUS=6
> CONFIGURE_MAX_CMD_LEN=524288
> HAVE_PORTS_ENV=1
> #### Misc Poudriere ####
> GID=0
> UID=0
> ---End make.conf---
> --Resource limits--
> cpu time (seconds, -t) unlimited
> file size (512-blocks, -f) unlimited
> data seg size (kbytes, -d) 33554432
> stack size (kbytes, -s) 1048576
> core file size (512-blocks, -c) unlimited
> max memory size (kbytes, -m) unlimited
> locked memory (kbytes, -l) unlimited
> max user processes (-u) 12186
> open files (-n) 1024
> virtual mem size (kbytes, -v) unlimited
> swap limit (kbytes, -w) unlimited
> socket buffer size (bytes, -b) unlimited
> pseudo-terminals (-p) unlimited
> kqueues (-k) unlimited
> umtx shared locks (-o) unlimited
> --End resource limits--
> =======================<phase: check-sanity >============================
> ===> License BSD2CLAUSE accepted by the user
> ===========================================================================
> =======================<phase: pkg-depends >============================
> ===========================================================================
> =======================<phase: fetch-depends >============================
> ===========================================================================
> =======================<phase: fetch >============================
> ===> License BSD2CLAUSE accepted by the user

> => HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz doesn't seem to exist in /portdistfiles/.
> => Attempting to fetch https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz
> fetch: https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: size unknown

> fetch: https://git.hardenedbsd.org/HardenedBSD/pkg/repository/bd298b04d243ae8a16b8b933bd4b97904336be35/archive.tar.gz?dummy=/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: size of remote file is not known

> HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.ta 50 kB 566 kBps 00s
> => Fetched file size mismatch (expected 3834627, actual 51755)
> => Trying next site
> => Attempting to fetch http://distcache.FreeBSD.org/ports-distfiles/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz
> fetch: http://distcache.FreeBSD.org/ports-distfiles/HardenedBSD-pkg-bd298b04d243ae8a16b8b933bd4b97904336be35_GL0.tar.gz: Not Found
> => Couldn't fetch it - please try to retrieve this
> => port manually into /portdistfiles/ and try again.
> *** Error code 1
>

> Stop.
> make: stopped in /usr/ports/ports-mgmt/pkg
> =>> Cleaning up wrkdir
> ===> Cleaning for pkg-1.16.3
> build of ports-mgmt/pkg | pkg-1.16.3 ended at Sat May 8 18:18:48 CEST 2021
> build time: 00:00:03
> !!! build failure encountered !!!

It seems like the initial download from HardenedBSD's GitLab failed.
Can you do a clean build (including removing the distfile)?

For example, I just tried this and it worked:

cd /usr/ports/ports-mgmt/pkg
make clean distclean
make

Thanks,

--
Shawn Webb
Cofounder / Security Engineer
HardenedBSD

https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc

[Balazs Toth]

thanks for the swift response, works!