Issue with same package version in Debian Squeeze and Debian Security

[hermannk...@googlemail.com]

In aptly I have two mirrors for debian squeeze amd64:

* [debian-squeeze-amd64-base]: http://ftp.debian.org/debian/ squeeze
* [debian-squeeze-amd64-security]: http://security.debian.org/ squeeze/updates

'aptly mirror update debian-squeeze-amd64-base' worked fine and downloaded all deb-packages.

'aptly mirror update debian-squeeze-amd64-security' does not work at all:

...
Downloading http://security.debian.org/dists/squeeze/updates/main/binary-amd64/Packages.bz2...
ERROR: unable to update: unable to save: ikiwiki_3.20100815.9_all, conflict with existing packge
...

It seems the same version 'ikiwiki_3.20100815.9_all' exists in both external repositories.

Why is the same version conflicting?
What should aptly do with conflicting packages?

Regards,

Hermann

[Andrey Smirnov]

Hi Hermann!

The same issue has already been reported in private. I need to take a look at the issue deeply.

--
You received this message because you are subscribed to the Google Groups "aptly-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aptly-discus...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Andrey Smirnov,
+79261724320

[Андрей Смирнов]

Hi Hermann!

I tried debugging the issue and here comes the reason:

In Debian squeeze main package ikiwiki_3.20100815.9_all contains following files:

deb.PackageFile{Filename:"ikiwiki_3.20100815.9_all.deb", Checksums:utils.ChecksumInfo{Size:1344322, MD5:"f16ca74c4b219199ecd333ef6dec91c6", SHA1:"8c4f69c4d0add6bc6c66c56c76f8a5aed5302421", SHA256:"4879d3a39657630e85fc1c07ad435e16c051bc9d39b701a3511605c212b08fa4"}}

while in security squeeze updates main the same package (which is weird) contains following files:

deb.PackageFile{Filename:"ikiwiki_3.20100815.9_all.deb", Checksums:utils.ChecksumInfo{Size:1344364, MD5:"cfa89389790199b279723eaf56f534c0", SHA1:"acdd0b96e29bd4ee366c6c295a0264c6d15c163d", SHA256:"effd39dcbcadb527459b2ed3d3637e14426c599fd2c5052b5359f9f1d8e35f6e"}}

You see, even though file is named the same, contents are different (I wonder how apt handles that?).

[Andrey Smirnov]

And more details:

https://wiki.debian.org/RepositoryFormat under section "Duplicate packages" says:

"A repository must not include different packages (different content) with the same package name, version, and architecture. When a repository is meant to be used as a supplement to another repository this should hold for the joint main+supplement repository as well."

When I was designing aptly, I decided that in whole universe of packages there's no duplicate package (same arch, name and version) with different content (different set of files). This assumption was true until I discovered that for package ikiwiki there's a duplicate with different conent, one is in main squeeze repository and another one in security.debian.org squeeze updates/main repository. They have exactly same version 3.20100815.90, but different files.

Here are two excerpts from Packages files:

squeeze/main:

Package: ikiwiki

Priority: optional

Section: web

Installed-Size: 8056

Maintainer: Joey Hess <jo...@debian.org>

Architecture: all

Version: 3.20100815.90

Replaces: ikiwiki-plugin-table

Provides: ikiwiki-plugin-table

Depends: perl, python, python-support (>= 0.90.0), libtext-markdown-perl | markdown, libhtml-scrubber-perl, libhtml-template-perl, libhtml-parser-perl, liburi-perl (>= 1.36)

Recommends: gcc | c-compiler, libc6-dev | libc-dev, subversion | git-core (>= 1:1.5.0) | git (>= 1:1.7) | tla | bzr (>= 0.91) | mercurial | monotone (>= 0.38) | darcs, libxml-simple-perl, libnet-openid-consumer-perl, liblwpx-paranoidagent-perl, libtimedate-perl, libcgi-formbuilder-perl (>= 3.05), libcgi-session-perl (>= 4.14-1), libmail-sendmail-perl, libauthen-passphrase-perl, libterm-readline-gnu-perl

Suggests: viewvc | gitweb | viewcvs, libsearch-xapian-perl, xapian-omega (>= 1.0.5), librpc-xml-perl, libtext-wikiformat-perl, python-docutils, polygen, tidy, libhtml-tree-perl, libxml-feed-perl, libmailtools-perl, perlmagick, libfile-mimeinfo-perl, libcrypt-ssleay-perl, liblocale-gettext-perl (>= 1.05-1), libtext-typography-perl, libtext-csv-perl, graphviz, libnet-amazon-s3-perl, libsparkline-php, texlive, dvipng, libtext-wikicreole-perl, libsort-naturally-perl, libtext-textile-perl, libhighlight-perl, po4a (>= 0.35-1), gettext, libyaml-perl

Conflicts: ikiwiki-plugin-table

Filename: pool/main/i/ikiwiki/ikiwiki_3.20100815.9_all.deb

Size: 1344364

MD5sum: cfa89389790199b279723eaf56f534c0

SHA1: acdd0b96e29bd4ee366c6c295a0264c6d15c163d

SHA256: effd39dcbcadb527459b2ed3d3637e14426c599fd2c5052b5359f9f1d8e35f6e

Description: a wiki compiler

 Ikiwiki converts a directory full of wiki pages into HTML pages suitable

 for publishing on a website. Unlike many wikis, ikiwiki does not have its

 own ad-hoc means of storing page history, and instead uses a revision control

 system such as Subversion or Git.

 .

 Ikiwiki implements all of the other standard features of a wiki, including

 web-based page editing, user registration and logins, a RecentChanges

 page, BackLinks, search, Discussion pages, tags, smart merging and conflict

 resolution, and page locking.

 .

 Ikiwiki also supports generating news feeds (RSS and Atom) and blogging.

 ikiwiki provides a plugin system which allows many other features to be

 added. Some of the plugins have additional dependencies, found among the

 Recommends and Suggests of this package.

Homepage: http://ikiwiki.info/

Tag: devel::lang:perl, devel::rcs, implemented-in::perl, interface::commandline, interface::web, role::program, use::{converting,organizing,text-formatting,typesetting}, web::{blog,cgi,wiki}, works-with::{bugs,text,vcs}, works-with-format::{html,plaintext,xml:rss}

and security.debian.org squeeze updates/main:

Package: ikiwiki

Version: 3.20100815.9

Installed-Size: 8056

Maintainer: Joey Hess <jo...@debian.org>

Architecture: all

Replaces: ikiwiki-plugin-table

Provides: ikiwiki-plugin-table

Depends: perl, python, python-support (>= 0.90.0), libtext-markdown-perl | markdown, libhtml-scrubber-perl, libhtml-template-perl, libhtml-parser-perl, liburi-perl (>= 1.36)

Suggests: viewvc | gitweb | viewcvs, libsearch-xapian-perl, xapian-omega (>= 1.0.5), librpc-xml-perl, libtext-wikiformat-perl, python-docutils, polygen, tidy, libhtml-tree-perl, libxml-feed-perl, libmailtools-perl, perlmagick, libfile-mimeinfo-perl, libcrypt-ssleay-perl, liblocale-gettext-perl (>= 1.05-1), libtext-typography-perl, libtext-csv-perl, graphviz, libnet-amazon-s3-perl, libsparkline-php, texlive, dvipng, libtext-wikicreole-perl, libsort-naturally-perl, libtext-textile-perl, libhighlight-perl, po4a (>= 0.35-1), gettext, libyaml-perl

Conflicts: ikiwiki-plugin-table

Description: a wiki compiler

 Ikiwiki converts a directory full of wiki pages into HTML pages suitable

 for publishing on a website. Unlike many wikis, ikiwiki does not have its

 own ad-hoc means of storing page history, and instead uses a revision control

 system such as Subversion or Git.

 .

 Ikiwiki implements all of the other standard features of a wiki, including

 web-based page editing, user registration and logins, a RecentChanges

 page, BackLinks, search, Discussion pages, tags, smart merging and conflict

 resolution, and page locking.

 .

 Ikiwiki also supports generating news feeds (RSS and Atom) and blogging.

 ikiwiki provides a plugin system which allows many other features to be

 added. Some of the plugins have additional dependencies, found among the

 Recommends and Suggests of this package.

Homepage: http://ikiwiki.info/

Recommends: gcc | c-compiler, libc6-dev | libc-dev, subversion | git-core (>= 1:1.5.0) | git (>= 1:1.7) | tla | bzr (>= 0.91) | mercurial | monotone (>= 0.38) | darcs, libxml-simple-perl, libnet-openid-consumer-perl, liblwpx-paranoidagent-perl, libtimedate-perl, libcgi-formbuilder-perl (>= 3.05), libcgi-session-perl (>= 4.14-1), libmail-sendmail-perl, libauthen-passphrase-perl, libterm-readline-gnu-perl

Section: web

Priority: optional

Filename: pool/updates/main/i/ikiwiki/ikiwiki_3.20100815.9_all.deb

Size: 1344322

MD5sum: f16ca74c4b219199ecd333ef6dec91c6

SHA1: 8c4f69c4d0add6bc6c66c56c76f8a5aed5302421

SHA256: 4879d3a39657630e85fc1c07ad435e16c051bc9d39b701a3511605c212b08fa4

As you can see, files are named the same, but have different size and checksums.

[Andrey Smirnov]

Looks like I've found way to fix aptly in this scenario. Development is going in https://github.com/smira/aptly/issues/60.

[Andrey Smirnov]

I've done tests with aptly 0.6 (upcoming version) and everything seems to be fine. I expect 0.6 to be released today or tomorrow.