Re: [qubes-project] Hosting for OpenQA instance
121 views
Skip to first unread message
Andrew David Wong
Jan 26, 2018, 8:31:12 PM1/26/18
to Marek Marczykowski-Górecki, qubes-project, Michael Carbone, qubes...@googlegroups.com, qubes...@googlegroups.com
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
On 2018-01-26 09:37, Marek Marczykowski-Górecki wrote:
> Hi,
>
> Manual testing of installation is a time consuming job, so I was looking
> for some tool to automate it. And found one:
>
> http://open.qa/
>
> This works by launching the system under test in KVM and then interact
> with it as user would do (mouse clicks, keyboard etc). Then compare
> screenshots (or parts of it).
> The nice thing is when using new new enough KVM, qemu and hardware with
> VT-x + EPT, Qubes installation works there! In theory KVM supports even
> nested virtualization, so HVM should works inside such setup, but in
> practice Xen and/or qemu crashes badly... But PV works fine, which is
> enough for installation testing.
>
> I've uploaded some basic tests here:
> https://github.com/marmarek/openqa-tests-qubesos
>
> The problem is we don't have a place to host it in long run. While I can
> launch it from time to time on one of my testing laptops, it doesn't
> scale well. And access to it is restricted, which limit who can work on
> this (and on issues found by tests).
>
> Does anyone have some place/recommendation where to look? Hardware we
> need:
> - CPU with VT-x + EPT, so KVM will work with reasonable performance (
> means a physical machine, not virtual one)
> - 6-8 GB RAM (4GB for KVM + something for OpenQA itself)
> - 50 GB of disk (preferably more)
>
> Does anyone have a spare machine running somewhere, and willing to
> share?
>
> Alternatively, it looks like we can get one for ~70 EUR/month. Andrew,
> Michael, could we use opencollective money for this?
>
The OpenCollective money is supposed to be used to pay developers to
work on the open-source version of Qubes. While this would not be a
direct payment to a developer, I can see how it would qualify, since
it's directly saving you and other devs time and work that would
otherwise have to be spent on testing. I think it would adhere to the
spirit of the rule, which is that the money should be spent on
improving the open-source version of Qubes. (Arguably, it would be
even more efficient than paying a developer directly, since Qubes
would probably benefit a lot more from the testing bought by that ~70
EUR/month than it would from the tiny amount of developer time ~70
EUR/month would pay for.)
However, I'd be surprised if there were no one in the Qubes community
willing to share a suitable machine for this purpose. My guess is that
there aren't as many readers on qubes-project as there are on
qubes-devel and qubes-users, so I'm CCing those other lists.
- --
Andrew David Wong (Axon)
Community Manager, Qubes OS
https://www.qubes-os.org
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEZQ7rCYX0j3henGH1203TvDlQMDAFAlpr1ioACgkQ203TvDlQ
MDBZaA/9HZWo8gZh5UsrKEAWIC4c4b4hnL2U0NZvqi508qbr65DmqW67y/QGXA0q
EI3VNHpNrhL99jpWGlsGnN3K1Dss+NKKEk82AVsqw6in9P1LA+9CyMjf3TQB1yLn
QkWyFc0E/+wN4ExpMgUuX7kqTv9TgjPrFki+KajpsIvQpXDOqMxM6vNdYitI8fer
B1cpIn0gS17ANcvlXJU2OhLKEradX6msZJdAYWlrZPpy7XEIPtnJTugsN5fm6kr/
ChsQtGH7OTHIJkd0pEr9YODhyr/Tpp6OYDwsQL1uWW4W8K03Mhmh5q+MuKg/scvG
nv8vINL0wo010GdiqsU/bvqB7pYkOFcdsghgM3gy1jBK8E7aR4KgNrafKn22D7eu
fC0Y2LlJmGZ6s+l//sfI6YIMi/iCj+6zUHXLdcGrLI9v+iYu23/9Lz6oyKl1Vedv
+6zh0PasElJXxAgdBGN7Se16ApC8/cTLeEcHhAQ1No/Tye3TaYE1U4ouj+9d6o1l
f7LLiSs1wxmBZcRdK09yK7zqcqi92NsgwBzmKwoz6fQFljo+G3/giar0xZ+8HPXN
HTnQ0von8o22yoK7x5H9jc+Fmq32zUvmYy2R3dAkY8PVmOgVEyf5z2OY3q0HEiEK
25kYJw9tdC7ZS6kI22l4tLGaAm6ntoM/ZbFUG0wrpESunWVrZOE=
=EIwB
-----END PGP SIGNATURE-----
Hash: SHA512
On 2018-01-26 09:37, Marek Marczykowski-Górecki wrote:
> Hi,
>
> Manual testing of installation is a time consuming job, so I was looking
> for some tool to automate it. And found one:
>
> http://open.qa/
>
> This works by launching the system under test in KVM and then interact
> with it as user would do (mouse clicks, keyboard etc). Then compare
> screenshots (or parts of it).
> The nice thing is when using new new enough KVM, qemu and hardware with
> VT-x + EPT, Qubes installation works there! In theory KVM supports even
> nested virtualization, so HVM should works inside such setup, but in
> practice Xen and/or qemu crashes badly... But PV works fine, which is
> enough for installation testing.
>
> I've uploaded some basic tests here:
> https://github.com/marmarek/openqa-tests-qubesos
>
> The problem is we don't have a place to host it in long run. While I can
> launch it from time to time on one of my testing laptops, it doesn't
> scale well. And access to it is restricted, which limit who can work on
> this (and on issues found by tests).
>
> Does anyone have some place/recommendation where to look? Hardware we
> need:
> - CPU with VT-x + EPT, so KVM will work with reasonable performance (
> means a physical machine, not virtual one)
> - 6-8 GB RAM (4GB for KVM + something for OpenQA itself)
> - 50 GB of disk (preferably more)
>
> Does anyone have a spare machine running somewhere, and willing to
> share?
>
> Alternatively, it looks like we can get one for ~70 EUR/month. Andrew,
> Michael, could we use opencollective money for this?
>
The OpenCollective money is supposed to be used to pay developers to
work on the open-source version of Qubes. While this would not be a
direct payment to a developer, I can see how it would qualify, since
it's directly saving you and other devs time and work that would
otherwise have to be spent on testing. I think it would adhere to the
spirit of the rule, which is that the money should be spent on
improving the open-source version of Qubes. (Arguably, it would be
even more efficient than paying a developer directly, since Qubes
would probably benefit a lot more from the testing bought by that ~70
EUR/month than it would from the tiny amount of developer time ~70
EUR/month would pay for.)
However, I'd be surprised if there were no one in the Qubes community
willing to share a suitable machine for this purpose. My guess is that
there aren't as many readers on qubes-project as there are on
qubes-devel and qubes-users, so I'm CCing those other lists.
- --
Andrew David Wong (Axon)
Community Manager, Qubes OS
https://www.qubes-os.org
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEZQ7rCYX0j3henGH1203TvDlQMDAFAlpr1ioACgkQ203TvDlQ
MDBZaA/9HZWo8gZh5UsrKEAWIC4c4b4hnL2U0NZvqi508qbr65DmqW67y/QGXA0q
EI3VNHpNrhL99jpWGlsGnN3K1Dss+NKKEk82AVsqw6in9P1LA+9CyMjf3TQB1yLn
QkWyFc0E/+wN4ExpMgUuX7kqTv9TgjPrFki+KajpsIvQpXDOqMxM6vNdYitI8fer
B1cpIn0gS17ANcvlXJU2OhLKEradX6msZJdAYWlrZPpy7XEIPtnJTugsN5fm6kr/
ChsQtGH7OTHIJkd0pEr9YODhyr/Tpp6OYDwsQL1uWW4W8K03Mhmh5q+MuKg/scvG
nv8vINL0wo010GdiqsU/bvqB7pYkOFcdsghgM3gy1jBK8E7aR4KgNrafKn22D7eu
fC0Y2LlJmGZ6s+l//sfI6YIMi/iCj+6zUHXLdcGrLI9v+iYu23/9Lz6oyKl1Vedv
+6zh0PasElJXxAgdBGN7Se16ApC8/cTLeEcHhAQ1No/Tye3TaYE1U4ouj+9d6o1l
f7LLiSs1wxmBZcRdK09yK7zqcqi92NsgwBzmKwoz6fQFljo+G3/giar0xZ+8HPXN
HTnQ0von8o22yoK7x5H9jc+Fmq32zUvmYy2R3dAkY8PVmOgVEyf5z2OY3q0HEiEK
25kYJw9tdC7ZS6kI22l4tLGaAm6ntoM/ZbFUG0wrpESunWVrZOE=
=EIwB
-----END PGP SIGNATURE-----
Yuraeitha
Jan 27, 2018, 6:36:13 PM1/27/18
to qubes-users
No one offered yet? Must be someone out there that keep some old desktops/laptops laying around.
Can an increase in subscription based donations be of use? For example if, say, 10 people each donate 10 euro (or alternatively expand any current donation subscription with 10 euro), then it should be sufficient to solve this issue?
Yethal
Jan 28, 2018, 12:38:17 PM1/28/18
to qubes-users
Frédéric Pierret (fepitre)
Jan 28, 2018, 1:03:09 PM1/28/18
to qubes-users
BePe
Jan 28, 2018, 1:23:22 PM1/28/18
to Andrew David Wong, Marek Marczykowski-Górecki, qubes-project, Michael Carbone, qubes...@googlegroups.com, qubes...@googlegroups.com
Hi All,
FYI, and it in case that it can help, I have succesfully installed Qubes 4.0 rc3 in KVM with nested virtualization and iommu enabled.
I had to hack a little bit the qemu intel_iommu.c, but now I have fully fonctional Qubes 4 (with all the VM in hvm mode).
The VM are not flying but they do work.
BePe - From BKO
FYI, and it in case that it can help, I have succesfully installed Qubes 4.0 rc3 in KVM with nested virtualization and iommu enabled.
I had to hack a little bit the qemu intel_iommu.c, but now I have fully fonctional Qubes 4 (with all the VM in hvm mode).
The VM are not flying but they do work.
BePe - From BKO
-- BePe
Marek Marczykowski-Górecki
Jan 28, 2018, 3:21:22 PM1/28/18
to Frédéric Pierret (fepitre), qubes-users
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
On Sun, Jan 28, 2018 at 10:03:09AM -0800, Frédéric Pierret (fepitre) wrote:
> Le samedi 27 janvier 2018 02:31:12 UTC+1, Andrew David Wong a écrit :
> > -----BEGIN PGP SIGNED MESSAGE-----
> > Hash: SHA512
> >
> > On 2018-01-26 09:37, Marek Marczykowski-Górecki wrote:
> > > Does anyone have some place/recommendation where to look? Hardware we
> > > need:
> > > - CPU with VT-x + EPT, so KVM will work with reasonable performance (
> > > means a physical machine, not virtual one)
> > > - 6-8 GB RAM (4GB for KVM + something for OpenQA itself)
> > > - 50 GB of disk (preferably more)
> > >
> > > Does anyone have a spare machine running somewhere, and willing to
> > > share?
> >
going to release. But I imagine most of the test builds can be done
locally, only downloading few packages from current-testing
repositories.
- --
Best Regards,
Marek Marczykowski-Górecki
Invisible Things Lab
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
-----BEGIN PGP SIGNATURE-----
iQEzBAEBCAAdFiEEhrpukzGPukRmQqkK24/THMrX1ywFAlpuMFcACgkQ24/THMrX
1yzv1wf/c+cM/VZTv+BZSRzMURq6LfWupd80usA7eMN9eDcQeUg2vao8zAuEkvlZ
OWvMJIq3KTT+NMMqPG92gC+3oeQRKdZCf4l5myZLPWdKSwkbEXytle2IH+gLuUYX
/EJslkR1JapgzgjKWuLdAhxl5VPBlpJwm3DsXN1CyDMVl4OAMkY2MRK+oVqC06eV
wznb+v203b3LrOjkFby4DG7hGgD4+Wkntt8pjYC6gScdHRc5ZmY53kV3XxXvkktZ
I/WJGCuX94NamyzXIeC5+V0En4PiFYIjyfeQVui0aEBJoW/4r4OyxEJCkZoQLLLo
zG72jdbOitSpIDDoMN3eyEkVr72k1w==
=IrJg
-----END PGP SIGNATURE-----
Hash: SHA256
On Sun, Jan 28, 2018 at 10:03:09AM -0800, Frédéric Pierret (fepitre) wrote:
> Le samedi 27 janvier 2018 02:31:12 UTC+1, Andrew David Wong a écrit :
> > -----BEGIN PGP SIGNED MESSAGE-----
> > Hash: SHA512
> >
> > On 2018-01-26 09:37, Marek Marczykowski-Górecki wrote:
> > > Does anyone have some place/recommendation where to look? Hardware we
> > > need:
> > > - CPU with VT-x + EPT, so KVM will work with reasonable performance (
> > > means a physical machine, not virtual one)
> > > - 6-8 GB RAM (4GB for KVM + something for OpenQA itself)
> > > - 50 GB of disk (preferably more)
> > >
> > > Does anyone have a spare machine running somewhere, and willing to
> > > share?
> >
> > However, I'd be surprised if there were no one in the Qubes community
> > willing to share a suitable machine for this purpose. My guess is that
> > there aren't as many readers on qubes-project as there are on
> > qubes-devel and qubes-users, so I'm CCing those other lists.
>
> > willing to share a suitable machine for this purpose. My guess is that
> > there aren't as many readers on qubes-project as there are on
> > qubes-devel and qubes-users, so I'm CCing those other lists.
>
> I guess it means to have a good bandwidth to download several times an ISO?
- From time to time, yes - we definitely want to test exact images we're
going to release. But I imagine most of the test builds can be done
locally, only downloading few packages from current-testing
repositories.
- --
Best Regards,
Marek Marczykowski-Górecki
Invisible Things Lab
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
-----BEGIN PGP SIGNATURE-----
iQEzBAEBCAAdFiEEhrpukzGPukRmQqkK24/THMrX1ywFAlpuMFcACgkQ24/THMrX
1yzv1wf/c+cM/VZTv+BZSRzMURq6LfWupd80usA7eMN9eDcQeUg2vao8zAuEkvlZ
OWvMJIq3KTT+NMMqPG92gC+3oeQRKdZCf4l5myZLPWdKSwkbEXytle2IH+gLuUYX
/EJslkR1JapgzgjKWuLdAhxl5VPBlpJwm3DsXN1CyDMVl4OAMkY2MRK+oVqC06eV
wznb+v203b3LrOjkFby4DG7hGgD4+Wkntt8pjYC6gScdHRc5ZmY53kV3XxXvkktZ
I/WJGCuX94NamyzXIeC5+V0En4PiFYIjyfeQVui0aEBJoW/4r4OyxEJCkZoQLLLo
zG72jdbOitSpIDDoMN3eyEkVr72k1w==
=IrJg
-----END PGP SIGNATURE-----
Marek Marczykowski-Górecki
Jan 28, 2018, 6:39:06 PM1/28/18
to Yethal, qubes-users
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
On Sun, Jan 28, 2018 at 09:38:17AM -0800, Yethal wrote:
> I have a spare machine I can donate. If any of the Qubes devs are Warsaw-based I can even bring it over.
Thanks!
We'd prefer a machine hosted somewhere, but just hardware also could be
useful - we can look for place to host it separately. What are physical
dimensions of it? Rack case, or tower, or else?
What CPU and RAM size it have?
- --
Best Regards,
Marek Marczykowski-Górecki
Invisible Things Lab
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
-----BEGIN PGP SIGNATURE-----
iQEzBAEBCAAdFiEEhrpukzGPukRmQqkK24/THMrX1ywFAlpuXqwACgkQ24/THMrX
1yxMsQf/V2ToVljqO92/QtUgUqPN7E7w579FOWrqedexnLYHl4Sg1KjHyvzpSMA7
hg4vHP3DxD2r7LjEmPBQ2YJM0PlS3MBubIUcbsyclQUMvUwqPOrJnBYtHV2VA8JH
w2sDMYxzRXn2BqvZxwyudrH/msp3aH+8qxmd1yUNzPpiKXwcCw87uNv+aqh3ZUeF
uLTbpuT22/7WFvpjB50kBPPC4eCvy/eEjghviKSqLClpIbLSc/Ztq1xVBvceXTGd
uElCwGEAX1Y3Kemmsz01Qz6Vld2eGGXLzPH795EBVHtGrePPKIRTkq279mUXY3qe
kTsqKijqo22OM9pGOaZ/HHJifuSfIw==
=x9o+
-----END PGP SIGNATURE-----
Hash: SHA256
On Sun, Jan 28, 2018 at 09:38:17AM -0800, Yethal wrote:
> I have a spare machine I can donate. If any of the Qubes devs are Warsaw-based I can even bring it over.
We'd prefer a machine hosted somewhere, but just hardware also could be
useful - we can look for place to host it separately. What are physical
dimensions of it? Rack case, or tower, or else?
What CPU and RAM size it have?
- --
Best Regards,
Marek Marczykowski-Górecki
Invisible Things Lab
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
-----BEGIN PGP SIGNATURE-----
1yxMsQf/V2ToVljqO92/QtUgUqPN7E7w579FOWrqedexnLYHl4Sg1KjHyvzpSMA7
hg4vHP3DxD2r7LjEmPBQ2YJM0PlS3MBubIUcbsyclQUMvUwqPOrJnBYtHV2VA8JH
w2sDMYxzRXn2BqvZxwyudrH/msp3aH+8qxmd1yUNzPpiKXwcCw87uNv+aqh3ZUeF
uLTbpuT22/7WFvpjB50kBPPC4eCvy/eEjghviKSqLClpIbLSc/Ztq1xVBvceXTGd
uElCwGEAX1Y3Kemmsz01Qz6Vld2eGGXLzPH795EBVHtGrePPKIRTkq279mUXY3qe
kTsqKijqo22OM9pGOaZ/HHJifuSfIw==
=x9o+
-----END PGP SIGNATURE-----
Yethal
Jan 30, 2018, 4:45:18 PM1/30/18
to qubes-users
Vít Šesták
Feb 8, 2018, 3:45:34 AM2/8/18
to qubes-users
Hello,
what's the current status?
If it has not been resolved, I'd like to ask if you require the hardware to have VT-d. This is a requirement for Q4, but maybe this is not a requirement when it runs under KVM with virtualized hardware. (Not sure.)
Regards,
Vít Šesták 'v6ak'
what's the current status?
If it has not been resolved, I'd like to ask if you require the hardware to have VT-d. This is a requirement for Q4, but maybe this is not a requirement when it runs under KVM with virtualized hardware. (Not sure.)
Regards,
Vít Šesták 'v6ak'
Andrew David Wong
Feb 8, 2018, 10:36:50 PM2/8/18
to Vít Šesták, qubes-users
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
We've received a hosting offer and are currently trying to make
contact and work out the details. Thank you to all who have offered
help.
- --
Andrew David Wong (Axon)
Community Manager, Qubes OS
https://www.qubes-os.org
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEZQ7rCYX0j3henGH1203TvDlQMDAFAlp9F0AACgkQ203TvDlQ
MDD0ehAAnWcATZVqJbntAr/LfxeCOjvPNF0mbA69BwKAVW2FP1LZwrdW1gAvhSaY
kn+fs5hUHCKJRAwgDNqKZIuqAOsSS0k1ElU8FZiu3n054Yf3meqm7n0OC1pG7QRo
DbzX3UY2ME3ZhwMpptKVcbb0RUBB9RXQWOhOqo4zYMvyWw7zRrPZKfUB7x5HGb/4
VdYk1fCLtJXRDumjcxNPw+T36jqWUCkVOFwYzzYPgT2sNl2WSj/pbSR4NJqMWeO9
cEiqZ1V+99CgbFt9rUyjghhWNDvr/WVGutUQsdap/PuJrCN9KG260E+ks+IJp50s
WZLr2QZpcxRvNQd5acw2IexpO5eR2K6/MlZg7J4pgr03FTAKWzzdOqash7rL3i9B
SSuXilOogyqX1QjTlpyiE/f34efTVQswPPf9knUO1GeO2FrTfbEETc9sYCYD9E6T
tkEn6D9NJ8V3sQaRkha+G1JwOdkO6OzNVYfwEkC8tKStJQZIfsmDeOAfVzMArBBv
tk/HrHA4QeRUWki9QKSu2+OYl+r6u20C3iuII5CaI6BPlfn2jZDFm2D2VSh5hq7s
wPlOADDinTrbooYu0OAy1bErilky4AM+ISbw24Xb1wYX8Ia3wMooddoK6ErtWokt
nNp7NUNaXv/MCdd8a0wct21zDL8ubHCvbToPXLOlzy/W3uZNOrE=
=Qt66
-----END PGP SIGNATURE-----
Hash: SHA512
contact and work out the details. Thank you to all who have offered
help.
- --
Andrew David Wong (Axon)
Community Manager, Qubes OS
https://www.qubes-os.org
-----BEGIN PGP SIGNATURE-----
MDD0ehAAnWcATZVqJbntAr/LfxeCOjvPNF0mbA69BwKAVW2FP1LZwrdW1gAvhSaY
kn+fs5hUHCKJRAwgDNqKZIuqAOsSS0k1ElU8FZiu3n054Yf3meqm7n0OC1pG7QRo
DbzX3UY2ME3ZhwMpptKVcbb0RUBB9RXQWOhOqo4zYMvyWw7zRrPZKfUB7x5HGb/4
VdYk1fCLtJXRDumjcxNPw+T36jqWUCkVOFwYzzYPgT2sNl2WSj/pbSR4NJqMWeO9
cEiqZ1V+99CgbFt9rUyjghhWNDvr/WVGutUQsdap/PuJrCN9KG260E+ks+IJp50s
WZLr2QZpcxRvNQd5acw2IexpO5eR2K6/MlZg7J4pgr03FTAKWzzdOqash7rL3i9B
SSuXilOogyqX1QjTlpyiE/f34efTVQswPPf9knUO1GeO2FrTfbEETc9sYCYD9E6T
tkEn6D9NJ8V3sQaRkha+G1JwOdkO6OzNVYfwEkC8tKStJQZIfsmDeOAfVzMArBBv
tk/HrHA4QeRUWki9QKSu2+OYl+r6u20C3iuII5CaI6BPlfn2jZDFm2D2VSh5hq7s
wPlOADDinTrbooYu0OAy1bErilky4AM+ISbw24Xb1wYX8Ia3wMooddoK6ErtWokt
nNp7NUNaXv/MCdd8a0wct21zDL8ubHCvbToPXLOlzy/W3uZNOrE=
=Qt66
-----END PGP SIGNATURE-----
Reply all
Reply to author
Forward
0 new messages