Massive ports build failure on 14-CURRENT/amd64

[Shawn Webb]

Hey all,

I need a bit of help here. I kicked off a new package build for
14-CURRENT/amd64. Two hours in, 11,753 ports have been skipped.
Something has gone really wrong. ${LIFE} is hitting me particularly
hard right now and I desparately need help from the community to
figure out and fix whatever major has gone wrong.

Here's the URL to the latest 14-CURRENT/amd64 package build:
http://ci-08.md.hardenedbsd.org/build.html?mastername=hardenedbsd-current_amd64-local&build=2022-08-17_20h01m01s

I appreciate all the help the community gives us. We need that help
more than anything right now.

Thanks,

--
Shawn Webb
Cofounder / Security Engineer
HardenedBSD

https://git.hardenedbsd.org/hardenedbsd/pubkeys/-/raw/master/Shawn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc

[The HardenedBSD Project]

I should have mentioned that the linux-* port failures can be ignored.

[Surly Badger]

I am not that familiar with poudriere, but I'm pretty familiar with build pipelines & failures - based on git logs, I'm assuming you're running against this commit? https://github.com/HardenedBSD/hardenedBSD/commit/6b956dbeb0fdfb3816b756e8763d2fd0dcfdb096#diff-ad9b1af459e52115b6b9dc3449962e564e22ee6c43e65f0c2ba4a3877f750211 ($HEAD)

I did some spot checking and saw a few potential issues, but will see if I can replicate the failure on my system once the jail finishes building.

[Surly Badger]

Digging into most of the failures, they're related to either Ninja being out of date (or not available?) or cmake being out of date. I attempted to do some local builds to replicate, but am not familiar enough with the build process to know for sure. I'd love to dig in deeper should you have some time to walk me through the setup steps (or point me to docs on how to?) - thanks for all you do!

[Loic F]

Hi,

If you want to reproduce a package building environment, a tutorial is available here :
https://git.hardenedbsd.org/hardenedbsd/HardenedBSD/-/wikis/2%5D-Building-Packages-in-HardenedBSD

I confirm, like you, a problem of detection of the versions of Ninja and cmake, but I can't reproduce it on my side (see attachment).

My poudriere jail is a bit less updated than my host , I will continue my tests on my side after updating my jail.

Thank you.

--

Loic
dev team
HardenedBSD

[Shawn Webb]

It appears that FreeBSD 14-CURRENT users encountered this problem,
too (there was a report on the freebsd...@freebsd.org mailing
list.)

FreeBSD committed this change earlier today, which is supposed to
address the failures:

https://git.hardenedbsd.org/hardenedbsd/HardenedBSD/-/commit/545db925c3d5408e71e21432895770cd49fd2cf3

I'll kick off a new 14-CURRENT/amd64 package build tomorrow and report
back.