qubes-builder / failed dependency for Phython?

[Sven Semmler]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

I was about to file a qubes-issue when I realized that the issue might
not be with the qubes-builder but my Fedora install. I tried going back
several commits until the beginning of May and the issue persisted.
Since I do a 'git pull' and build daily it appears that what changed
might not be the qubes-builder but my Fedora install ... maybe a recent
update broke a dependency?

**Qubes OS version**
R4.0

**Affected component(s) or functionality**
qubes-builder [bionic template]

**Brief summary**
building the bionic template fails at qubes-pdf-converter (details below)

**To Reproduce**
1. git pull
2. rm builder.conf
3. ./setup (R4.0, Stable, normal cloning, no pre-build packages, templates only, bionic, builder-rpm + builder-debian + mgmt-salt)
4. make clean
5. make install-deps && make get-sources
6. make qubes-vm

**Expected behavior**
build completes successfully

**Actual behavior**
build fails when entering /home/user/qubes-src/app-linux-pdf-converter (directory doesn't exist) with the following messages:

dh_install
dh_installdocs
dh_installchangelogs
dh_installman
dh_perl
dh_link
dh_strip_nondeterminism
dh_compress
dh_fixperms
dh_missing
dh_strip
dh_makeshlibs
dh_shlibdeps
dh_installdeb
debian/rules override_dh_gencontrol
make[1]: Entering directory '/home/user/qubes-src/app-linux-pdf-converter'
echo "pythonver:Depends=python" >> debian/qubes.pdf-converter.substvars
dh_gencontrol
dpkg-gencontrol: warning: Depends field of package qubes-pdf-converter: unknown substitution variable ${pythonver:Depends}
dpkg-gencontrol: warning: can't parse dependency -nautilus
dpkg-gencontrol: error: error occurred while parsing Depends field: poppler-utils, imagemagick, -nautilus,
dh_gencontrol: dpkg-gencontrol -pqubes-pdf-converter -ldebian/changelog -Tdebian/qubes-pdf-converter.substvars -Pdebian/qubes-pdf-converter -UMulti-Arch returned exit code 25
dh_gencontrol: Aborting due to earlier error
debian/rules:17: recipe for target 'override_dh_gencontrol' failed
make[1]: *** [override_dh_gencontrol] Error 25
make[1]: Leaving directory '/home/user/qubes-src/app-linux-pdf-converter'
debian/rules:10: recipe for target 'binary' failed
make: *** [binary] Error 2
dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
make[2]: *** [/home/user/qubes-builder/qubes-src/builder-debian//Makefile-legacy.debian:50: dist-package] Error 2
make[1]: *** [Makefile.generic:191: packages] Error 1
make: *** [Makefile:227: app-linux-pdf-converter-vm] Error 1

**Screenshots**
n/a

**Additional context**
n/a

**Solutions you've tried**

I tried going back several commits until the beginning of May and the issue persisted. Since I do a git pull and build daily it appears that what changed might not be the qubes-builder but my Fedora install ... maybe a recent update broke a dependency?

**Relevant [documentation](https://www.qubes-os.org/doc/) you've consulted**
n/a

**Related, [non-duplicate](https://www.qubes-os.org/doc/reporting-bugs/#new-issues-should-not-be-duplicates-of-existing-issues) issues**
none found


- --
public key: https://www.svensemmler.org/0x8F541FB6.asc
fingerprint: D7CA F2DB 658D 89BC 08D6 A7AA DA6E 167B 8F54 1FB6

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEE18ry22WNibwI1qeq2m4We49UH7YFAl7OosQACgkQ2m4We49U
H7aoWxAAoTm2aoE8pzLeCaTTzc0wrrsRA7jaeuWlbo9g2PXciXhkNMzg2a/flK+M
mtD18+MKr/FeBv7JJmZfbu/DBl0NbClfEtQG245jAUw0ch+PmtCqENOfRu+C79LV
suD1BYp8J7ZI4O02wmxExaGOHX+1Z7luOZc38k0Y2us50PcAlzG9IUz6v5yIXc3H
qD5qcjjbqkAEgdxk20+vJz9aU8l/t9y7SHcZremauH4teXCNFAd5JnRjLVvkZWrK
5QO7rVUnlfDBwUEXk2UUeec4BT9c/tdUHHtb0HSqd9DNZIkApacMiTGB8NLVupZv
vPca9cdJpj+kNrbsLWs4Aud1QdBdUYyJW6hAHCStJ1KJINEj7nSQRcfBVpoxfCAs
WJvfvUDvn+ChyrNYI8eSNCo0J7StxONEGBJadTrMaLqJJBDGaQeHyY53De9TmGMU
ZGBBxmSYI4Wl8zjqW2Z9BlBmag4dvlmImPyx0unIzXmx1zDmoEecjTMv29JWhxK/
PEZ0dFEqD7LIfDq0xbKqKsGhVz3kpqp3UPJT2lhitNQLJ+m0kShu1llkKQybl843
KQdCJly0G/fiHs4VNPHOzs1dvkR6JhiHxS9Vsj4VsSbad4ynR7zcmm/Mz2p6QOGw
U3rNm9tBvsBceTC3XbZ0WR6mXqzzPX+syunvzqLKMwtFqOnZtjU=
=oDVt
-----END PGP SIGNATURE-----

[Sven Semmler]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On Wed, May 27, 2020 at 12:26:28PM -0500, Sven Semmler wrote:
> echo "pythonver:Depends=python" >> debian/qubes.pdf-converter.substvars
> dh_gencontrol
> dpkg-gencontrol: warning: Depends field of package qubes-pdf-converter: unknown substitution variable ${pythonver:Depends}
> dpkg-gencontrol: warning: can't parse dependency -nautilus
> dpkg-gencontrol: error: error occurred while parsing Depends field: poppler-utils, imagemagick, -nautilus,
> dh_gencontrol: dpkg-gencontrol -pqubes-pdf-converter -ldebian/changelog -Tdebian/qubes-pdf-converter.substvars -Pdebian/qubes-pdf-converter -UMulti-Arch returned exit code 25
> dh_gencontrol: Aborting due to earlier error

I think this is the actual issue: unknown substitution variable ${pythonver:Depends}

Unfortunately I am obliviouos to all things Phython.

I have python2 and python3 installed as well as all the dependencies
listed on the Qubes website for qubes-builder. The build worked
perfectly yesterday and now it's broken regardless of the commit version
I try.

When I try to undo the last update I get this:

[user@app-qubes-builder qubes-builder]$ sudo dnf history undo 135
Last metadata expiration check: 2:12:17 ago on Wed May 27 10:29:21 2020.
Undoing transaction 135, from Tue May 26 12:44:00 2020
Upgrade json-c-0.13.1-12.fc30.x86_64 @updates
Upgraded json-c-0.13.1-11.fc30.x86_64 @@System
No package json-c-0.13.1-11.fc30.x86_64 available.
Error: no package matched

I guess I could restore the backup from two nights ago and just pull
from git but not update Fedora to see if this was it.

/Sven

- --
public key: https://www.svensemmler.org/0x8F541FB6.asc
fingerprint: D7CA F2DB 658D 89BC 08D6 A7AA DA6E 167B 8F54 1FB6

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEE18ry22WNibwI1qeq2m4We49UH7YFAl7Op7AACgkQ2m4We49U
H7YdGxAA25AJqJH8VLe1psdAuiL9jwn8GaeSU3wTeycswl2PfM9DtV+AFmqmwWls
cNAE7QamorsIpJv3gM+6eTHQYuW0a5gOL2Gbo4J136aP9JpFOI0CRzSdL5Zxbaca
tKKF8kn/gY4YDPG5AAjlmamyXFnbGh2uRSytLrdxmfulzpziLXfiaDuMKVHs5A1i
Rnen8EBWa0WYh9vbZzhW6h54t2E9CiwSsFRS4A+jbcDu6C6ZpjUs4IdUXpN9BVbQ
hDvu4SwP8aXkuClAVG6jtgGwLiyWyt8q6zDx6xlpJxQLCXDtynT0UAq3GNl+J8mq
Qx7YMi8Ad5uJks4au1Jkfb782b4N1VUMpeaGza74zdeY22Dyq+Eqj0JPobclP54Z
tJU/JNmOTudiCMCuq9YQOXo3wHzH15SM4KTGsim2QM1vuX9TfDZ1Rmyz1J9zHrm/
NgkVSTAsYN7uMxizS74btNaS8xjM8NhAY9cSguUg7WFjaAsxZE/PBAb1rs2F1U7V
u0abwX8SRucboyLDmXlh43sMWybCH2szaUCcWfBQ66apcC2FXHij0eyFPgf7aM1p
5u286vNST0PNeHX4Y2htqwr542oFUyP1kOxM+OobhWOtA93rHX8tww8Pub4HH1xY
VmAlzSvl64adBS0v51gYc9q1Na4fLKtiY/D9ZmvYrcvRz/AoF9c=
=57mW
-----END PGP SIGNATURE-----

[Frédéric Pierret]

On 2020-05-27 19:47, Sven Semmler wrote:
> On Wed, May 27, 2020 at 12:26:28PM -0500, Sven Semmler wrote:
>> echo "pythonver:Depends=python" >> debian/qubes.pdf-converter.substvars
>> dh_gencontrol
>> dpkg-gencontrol: warning: Depends field of package qubes-pdf-converter: unknown substitution variable ${pythonver:Depends}
>> dpkg-gencontrol: warning: can't parse dependency -nautilus
>> dpkg-gencontrol: error: error occurred while parsing Depends field: poppler-utils, imagemagick, -nautilus,
>> dh_gencontrol: dpkg-gencontrol -pqubes-pdf-converter -ldebian/changelog -Tdebian/qubes-pdf-converter.substvars -Pdebian/qubes-pdf-converter -UMulti-Arch returned exit code 25
>> dh_gencontrol: Aborting due to earlier error
>
> I think this is the actual issue: unknown substitution variable ${pythonver:Depends}

Those corresponds to freshly merged PR of components and notably qubes-pdf-converter. The problem is that we don't have tracking build for Ubuntu. I suggest you to checkout previous commits but this is related to python3 migration so maybe you will encounter python3 issues. I'll try to fix that soon.

[Sven Semmler]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On Wed, May 27, 2020 at 08:43:48PM +0200, Frédéric Pierret wrote:
> Those corresponds to freshly merged PR of components and notably
> qubes-pdf-converter. The problem is that we don't have tracking build
> for Ubuntu. I suggest you to checkout previous commits but this is
> related to python3 migration so maybe you will encounter python3
> issues. I'll try to fix that soon.

Thank you!

> > I guess I could restore the backup from two nights ago and just pull
> > from git but not update Fedora to see if this was it.

I am doing that right now just as an additional data point to make sure
whether it's the PR or not.

/Sven

- --
public key: https://www.svensemmler.org/0x8F541FB6.asc
fingerprint: D7CA F2DB 658D 89BC 08D6 A7AA DA6E 167B 8F54 1FB6

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEE18ry22WNibwI1qeq2m4We49UH7YFAl7OuC0ACgkQ2m4We49U
H7ZchQ//WQrk2LIztvVPvaf2d5eLH6wSOFwLOhHAZC0t1EIuFZNETOEKDyFAU7t2
s+Q4Asa2yAKRzZgya2xzKQ/Phk7DaoSU00sLnPbUDlMvsJUGkYoTpwiI+AhOz83l
xlamj6taath5qS6mxli4zhhTYiqKR30TX84ClpAkfdglE4TNLm/3uy3BYP9hstfK
B57arroTPznm38g5HhsUm8h0+9IU54FQ+nDQ9+NH9z33ndGinPt4JZ1avJGWnAh4
KVQeuYpfSHOqmmzYtveJYZ7RaYpwEo0nbdwfX2XGflEPxBLtYYCgDJvc8PXzouur
wRveblSxSxoKKVxT5n9TQoBC3RExHanAfN75hGOFBRCqRmPqEH0QIUHfUCRIrsoA
oyVuzp8PCJ/WAIZAYvs/vkePjpxBFkivz1c+PydBDfJEluGfUfkaP2JGELVNBHtv
zDJqAQp9sajeQkwtg/yKw6yv2iPIGOfxhAjNfW8jsj66Geb3cWuPAB7eLmBzsNhQ
cTctC5JTQCEol/VJ/lKPVfj9wYXoYVslBoAmTSbozJ971vDyQ3aBI36rtzX8KEJE
8ufdXWR6ldhL0R4RSHxIyxonYi6JTWCZVHxx6Fdg90MjFkTfzaicTJfVESCV9JCM
BQtCboZJrlKPbvirdkX7aFv36bAoXD8yeG+sUQAdGfkS6gOuirs=
=/6W9
-----END PGP SIGNATURE-----

[Sven Semmler]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On Wed, May 27, 2020 at 01:57:52PM -0500, Sven Semmler wrote:
> On Wed, May 27, 2020 at 08:43:48PM +0200, Frédéric Pierret wrote:
> > Those corresponds to freshly merged PR of components and notably
> > qubes-pdf-converter. The problem is that we don't have tracking build
> > for Ubuntu. I suggest you to checkout previous commits but this is
> > related to python3 migration so maybe you will encounter python3
> > issues. I'll try to fix that soon.
>
> Thank you!
>
> > > I guess I could restore the backup from two nights ago and just pull
> > > from git but not update Fedora to see if this was it.
>
> I am doing that right now just as an additional data point to make sure
> whether it's the PR or not.

Yep, I restored a 2 days old qubes-builder that I know worked before and
now it's broke too. So the change comes in when the qubes-pdf-converter
gets pulled.

I'll try and figure out how to have the build skip that one for now.

/Sven

- --
public key: https://www.svensemmler.org/0x8F541FB6.asc
fingerprint: D7CA F2DB 658D 89BC 08D6 A7AA DA6E 167B 8F54 1FB6

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEE18ry22WNibwI1qeq2m4We49UH7YFAl7OuWAACgkQ2m4We49U
H7ZFsBAAqRC9YmbLm8mCgcRFvj8A3eTICtfBNjRah1q2FFir1gqwca2XjEVf3z3m
NSd4sJb0a1IZHhOo3FH6wZMb7tTPLIMit0zg7vLfAlMYMcQrzOd0EFXqCoBqnGHr
xneXa9Xr8L0zJBjPDrcWZmRooXLbVTXiEoNm6d0EuraenOd3ngxtsQlnYIQ3u51g
9B2/FEVI1XeWLRNjwzsk/0Xxd4uQRTJlvZ2xoJHAWQ1mJInLjlumaE9vtl97NxUa
RKDBZapBGyUmzgyhb8PLHMhVh4bv6o1VaOzWq9DwS94Ib2jkBbJOEjiKRAmhu8CK
rBj048e7+n9/UBGMXbR3hxM0uW4UMqRalvHpTvzBwKvpqItSUXjedh5g+xP/ZoJt
gGDxONs86xsh4AS7y7LdDr1LO3ZKClGOHLY1njJDqKV6N4JTeGP13xhRwFWcLTLi
mM7hj4SkqaULo+gFcgb9abbpsoFTk1/mTqT7UQAdmQlVB9vdY6JDwQFSPhTLcCJa
SOGC0agvD9W1+5cElLKtgODTE4fL0ztI3NyVOd1D635pgNhFBKeJwEhJo7e6abFe
iVPMVZaxT77taqJcOKjDktGbRTP/Wc7MzkwHbCJSlAS/+PyXTspPK8uN7XNiSLQc
VB2XJXqoQz64KYU5AjlJ6NcevZeui3g7hy0IFTbS4UnAwjT+S3I=
=yoPv
-----END PGP SIGNATURE-----