ubuntu woes (mirror update always fails)

[draxi...@gmail.com]

Hello,

is there anyone out there who can actually use aptly to mirror an ubuntu archive server? I do not seem to be able to mirror from ANY mirror I tried (4 different countries now).

It always fails with the missing <release>/<component>/Packages file. But that file is never ever present on any of the mirrors, even though it is referred to in the Releases file. The Packages.bz2 and Packages.gz files are present and are perfectly fine and valid. They are also downloaded by aptly first but then simply not used.

I have of course read the FAQ entry http://www.aptly.info/doc/faq/ which claims that the mirror is broken but I refuse to believe that all mirrors (very important high throughput mirrors) are broken. Especially since those mirrors all serve packages normally and perfectly fine and can also be used as netinstall sources.

Is there some dependency broken on aptly 0.8 on Ubuntu 14.04LTS itself such that it cannot unpack the .bz2 and .gz Packages and thus is absolutely dependent on the unpacked file (which isn't available)?

I am almost tempted to set up a Wheezy server just to test it, but right now, it simply does not seem to work on Ubuntu.

Anyone on Ubuntu LTS 14.04 using aptly 0.8 who can actually mirror the ubuntu mirrors with aptly mirror update ? All I get is these below, and they all work fine just not with aptly on LTS 14.04:

~# aptly mirror update ubuntu-main
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/InRelease...
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/Release...
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/Release.gpg...
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using DSA key ID 437D05B5
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key <ftpm...@ubuntu.com>"
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using RSA key ID C0B21F32
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key (2012) <ftpm...@ubuntu.com>"
Downloading & parsing package files...
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/main/binary-amd64/Packages.bz2...
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/main/binary-amd64/Packages.gz...
Downloading http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/main/binary-amd64/Packages...
ERROR: unable to update: HTTP code 404 while fetching http://mirror.switch.ch/ftp/mirror/ubuntu/dists/trusty/main/binary-amd64/Packages

~# aptly -architectures="amd64" mirror update ubuntu-lts2
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/InRelease...
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/Release...
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/Release.gpg...
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using DSA key ID 437D05B5
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key <ftpm...@ubuntu.com>"
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using RSA key ID C0B21F32
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key (2012) <ftpm...@ubuntu.com>"
Downloading & parsing package files...
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/main/binary-amd64/Packages.bz2...
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/main/binary-amd64/Packages.gz...
Downloading http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/main/binary-amd64/Packages...
ERROR: unable to update: HTTP code 404 while fetching http://ftp-stud.hs-esslingen.de/ubuntu/dists/trusty/main/binary-amd64/Packages

~# aptly mirror update ubuntu-lts
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/InRelease...
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/Release...
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/Release.gpg...
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using DSA key ID 437D05B5
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key <ftpm...@ubuntu.com>"
gpgv: Signature made Don 08 Mai 2014 16:20:33 CEST using RSA key ID C0B21F32
gpgv: Good signature from "Ubuntu Archive Automatic Signing Key (2012) <ftpm...@ubuntu.com>"
Downloading & parsing package files...
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/main/binary-amd64/Packages.bz2...
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/main/binary-amd64/Packages.gz...
Downloading http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/main/binary-amd64/Packages...
ERROR: unable to update: HTTP code 404 while fetching http://ftp.halifax.rwth-aachen.de/ubuntu/dists/trusty/main/binary-amd64/Packages

Is there some debug logging I can enable to see why it doesn't like the bz2 and gz files?

Kind regards

[draxi...@gmail.com]

On Monday, October 13, 2014 3:05:42 PM UTC+2, draxi...@gmail.com wrote:
> Hello,

Of course, 5 minutes later I find the solution. If your /tmp partition is a special ramdisk with size limit, then aptly fails to unpack the files and leads to this situation.

The issue therefor is, that aptly does not provide an error message when it cannot unpack Packages files due to low disk space (on /tmp)

[Andrey Smirnov]

Hi! 

aptly is downloading metadata files (like Packages) to temporary file, which resides in TMPDIR or /tmp if TMPDIR is not set.

The error message is unfortunately quite misleading: aptly is trying to download .bz2, fails because of /tmp dir, fallbacks to .gz, fails as well and fallbacks to uncompressed Packages which is missing actually. I'll see what I can do to improve error message.

--
You received this message because you are subscribed to the Google Groups "aptly-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aptly-discus...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Andrey Smirnov,
http://smira.ru/