apt-cacher-ng's expiry job failing

Eduardo M KALINOWSKI

unread,

Apr 25, 2019, 9:30:04 AM4/25/19

to

The daily apt-cacher-ng expiry job is failing in my machine. It refers
me to a log file, whose contents are:

---
Maintenance task Expiration, apt-cacher-ng version: 2

Locating potentially expired files in the cache...
Scanning, found 1 file...
Scanning, found 2 files...
Scanning, found 4 files...
Scanning, found 8 files...
Scanning, found 16 files...
Scanning, found 32 files...
Scanning, found 64 files...
Scanning, found 128 files...
Scanning, found 256 files...
Scanning, found 512 files...
Scanning, found 1024 files...
Found 1617 files.
Checking implicitly referenced files...
Restoring virtual file
debrep/dists/testing/contrib/Contents-i386.diff/Index (equal to )

Restoring virtual file
debrep/dists/testing/contrib/i18n/Translation-en.diff/Index (equal to )

Restoring virtual file
debrep/dists/unstable/contrib/i18n/Translation-en.diff/Index (equal to )

Bringing index files up to date...

Restoring virtual file
debrep/dists/unstable/contrib/i18n/Translation-en.diff/Index (equal to )

Error at debrep/dists/unstable/45961554550630227606591

Found errors during processing, aborting as requested.
---

I can also run the expiry from its web interface, and get the same results.

Unfortunately, it does not make clear *what* is the error that was
found. The only clue is 'Error at
debrep/dists/unstable/45961554550630227606591', but there is no such
file under
/var/cache/apt-cacher-ng/debrep/dists/unstable .

Anyone has any clue on how to fix this problem?
--
Eduardo M KALINOWSKI
edu...@kalinowski.com.br

David Wright

unread,

Apr 26, 2019, 12:10:04 PM4/26/19

to

This probably won't be of great help.

Today's successful run, which removed probably most of the wheezy
packages in my cache¹, had the following error in the log:

Error at security.debian.org/debian-security/dists/stretch/updates/19704841552237202370979443

but it didn't stop the run. This file exists, but is actually at
/var/cache/apt-cacher-ng/_xstore/rsnap/security.debian.org/…
so take a look there perhaps.

The contents of the file look sane. Running a diff against the next
version showed that a fair number of files had been updated, and
the signature was completely different. However, that next version
and the one after that showed that the signature is always different
regardless of content, because there were no update differences in
the rest of the file.

These files go back months, and their timestamps seem to correspond
to the times when my apt-get update runs occur. So perhaps you
could try hiding the file and running the web interface again.

¹ I had to decrease ExStartTradeOff from 500m to 10m to give
expiration a push because jessie and stretch have been quite quiet
in the period since I removed all wheezy's apt-cacher-ng metadata.

Cheers,
David.

Eduardo M KALINOWSKI

unread,

Apr 27, 2019, 6:50:04 AM4/27/19

to

On 26/04/2019 13:05, David Wright wrote:
> Today's successful run, which removed probably most of the wheezy
> packages in my cache¹, had the following error in the log:
>
> Error at security.debian.org/debian-security/dists/stretch/updates/19704841552237202370979443
>
> but it didn't stop the run. This file exists, but is actually at
> /var/cache/apt-cacher-ng/_xstore/rsnap/security.debian.org/…
> so take a look there perhaps.

That made me look for a file with that name in the whole hierarchy, and
I found it at

/var/cache/apt-cacher-ng/_xstore/rsnap/debrep/dists/unstable/45961554550630227606591

I removed the file and it started complaining about other similar files.
After deleting a couple, the logs became even more unhelpful:

Maintenance task Expiration, apt-cacher-ng version: 2 (Cancel)

Locating potentially expired files in the cache...
Scanning, found 1 file...
Scanning, found 2 files...
Scanning, found 4 files...
Scanning, found 8 files...
Scanning, found 16 files...
Scanning, found 32 files...
Scanning, found 64 files...
Scanning, found 128 files...
Scanning, found 256 files...
Scanning, found 512 files...
Scanning, found 1024 files...

Scanning, found 2048 files...

Found 2427 files.
Checking implicitly referenced files...
Restoring virtual file
debrep/dists/testing/contrib/Contents-i386.diff/Index (equal to )
Restoring virtual file
debrep/dists/testing/contrib/i18n/Translation-en.diff/Index (equal to )
Restoring virtual file
debrep/dists/unstable/contrib/i18n/Translation-en.diff/Index (equal to )
Bringing index files up to date...

Found errors during processing, aborting as requested.

--

Stult's Report:
Our problems are mostly behind us. What we have to do now is
fight the solutions.

Eduardo M KALINOWSKI
edu...@kalinowski.com.br

David Wright

unread,

Apr 27, 2019, 10:40:03 AM4/27/19

to

No solutions here, I'm afraid.

Today's run, which could have been running neck and neck with updating
and upgrading the point release¹, was again successful, but only needed
to tag some files without removing any.

The log contained one error again, this time for the file
debrep/dists/stretch/19774491550329202244056132 which is in
/var/cache/apt-cacher-ng/_xstore/rsnap/debrep/…
The file is alone in that directory, and it's unsigned. Its timestamp
is about the time that the update ran, but its internal timestamp is
mid-February.

There's no message arising from the file 19704841552237202370979443
which is still present.

In both cases the error was reported at the changeover from the
"Restoring virtual file…" phase to "Checking …" and
"Checking/Updating …" phases. So it might be the case that my
error occurs in a different phase from yours, and that yours is
treated as more serious.

But the other possibility is that the problem arises from caching
unstable. I ran into problems when I cached jessie on a wheezy
system, and had to use both backports and backports-sloppy at
various times to accomplish expiration of an overgrown cache.

Sorry to be the blind leading the blind.

Cheers,
David.

Eduard Bloch

unread,

May 3, 2019, 10:00:04 AM5/3/19

to

Hallo,
* David Wright [Sat, Apr 27 2019, 09:31:50AM]:

> > /var/cache/apt-cacher-ng/_xstore/rsnap/debrep/dists/unstable/45961554550630227606591
> >
> > I removed the file and it started complaining about other similar files.
> > After deleting a couple, the logs became even more unhelpful:
> >
> > Maintenance task Expiration, apt-cacher-ng version: 2 (Cancel)

Old. And had some issues in that area. Try
https://packages.debian.org/stretch-backports/apt-cacher-ng

Best regards,
Eduard.