Focal repo missing components

[Eric Mueller]

Hello,

I have created an aptly mirror for Ubuntu 20.04 Focal Fossa. I built my first 20.04 virtual machine using a mini ISO and preseed file. When running "apt update", I am receiving errors for multiple components that are missing from my new repo.

When I browse my repo and inspect my InRelease file, it is only showing component "main". See below.

http:/myaptlyserver/ubuntu/dists/focal/InRelease

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Origin: Ubuntu
Label: . focal
Suite: focal
Codename: focal
Date: Thu, 2 Jul 2020 15:05:26 UTC
Architectures: amd64 i386
Components: main
Description: Generated by aptly


Here are the details of how I am building my repository. Please let me know what I am doing wrong here. The mirror seems to be build correctly since the "show mirror" command displays the list of components.

:~$ sudo aptly version
aptly version: 1.4.0

:~$ sudo aptly -architectures="amd64" -with-udebs mirror create focal-main http://us.archive.ubuntu.com/ubuntu/ focal main restricted universe
:~$ sudo aptly -architectures="amd64" mirror create focal-updates http://us.archive.ubuntu.com/ubuntu/ focal-updates main restricted universe
:~$ sudo aptly  -architectures="amd64" mirror create focal-security http://us.archive.ubuntu.com/ubuntu/ focal-security main restricted universe

:~$ sudo aptly mirror show focal-main
Name: focal-main
Archive Root URL: http://us.archive.ubuntu.com/ubuntu/
Distribution: focal
Components: main, restricted, universe
Architectures: amd64
Download Sources: no
Download .udebs: yes
Last update: 2020-07-02 14:56:05 UTC
Number of packages: 59818

Information from release file:
Acquire-By-Hash: yes
Architectures: amd64 arm64 armhf i386 ppc64el riscv64 s390x
Codename: focal
Components: main restricted universe multiverse
Date: Thu, 23 Apr 2020 17:33:17 UTC
Description:  Ubuntu Focal 20.04

Label: Ubuntu
Origin: Ubuntu
Suite: focal
Version: 20.04


:~$ sudo aptly snapshot create focal-main-07-01-20 from mirror focal-main
:~$ sudo aptly snapshot create focal-security-07-01-20 from mirror focal-security
:~$ sudo aptly snapshot create focal-updates-07-01-20 from mirror focal-updates

:~$ sudo aptly publish snapshot focal-main-07-01-20 -component="main,restricted,universe"
:~$ sudo aptly publish snapshot focal-security-07-01-20 -component="main,restricted,universe"
:~$ sudo aptly publish snapshot focal-updates-07-01-20 -component="main,restricted,universe"

:~$ sudo aptly publish show focal
Prefix: .
Distribution: focal
Architectures: amd64 i386
Sources:
  main: focal-main-07-01-20 [snapshot]



Is there something wrong with how I am publishing the snapshots?

thanks
Eric

[Jim Campbell]

Hi Eric,

A few questions and notes ...
- You say that you aer, "receiving errors for multiple components that are missing from my new repo".  What does it say that you are missing

- I notice that you don't appear to be mirror'ing the backports repository. Do you have a reason for excluding that?  AFAIK, backports are enabled by default on Ubuntu systems.

- The output of "sudo aptly mirror show focal-main" doesn't show the 'multiverse' component.  It only shows main, universe, and restricted. I think you'd want to include the 'multiverse' component.

- I don't think that aptly should be run with sudo privs. I think that you should create a regular or service-account user, and have the aptly commands run as that user.

I hope this helps!

Jim

--
You received this message because you are subscribed to the Google Groups "aptly-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aptly-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/aptly-discuss/7a4f1109-d7e6-4681-b900-7d2738b0011fo%40googlegroups.com.

[Eric Mueller]

Hi Jim,

Here is the output from my client 20.04 system when running 'apt update'. It is looking for both restricted and universe.

:~$ sudo apt update
Hit:1 http://apt-server/ubuntu focal InRelease
Hit:2 http://apt-server/ubuntu focal-updates InRelease
Hit:3 http://apt-server/ubuntu focal-security InRelease
Reading package lists... Done
Building dependency tree
Reading state information... Done
59 packages can be upgraded. Run 'apt list --upgradable' to see them.
W: Skipping acquire of configured file 'restricted/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal-updates InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'restricted/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'restricted' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-amd64/Packages' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/binary-i386/Packages' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en_US' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/i18n/Translation-en' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)
W: Skipping acquire of configured file 'universe/cnf/Commands-amd64' as repository 'http://apt-server/ubuntu focal-security InRelease' doesn't have the component 'universe' (component misspelt in sources.list?)

I agree with your other statements but the main issue is that I cannot get my repository to publish with universe and restricted components.

thanks

Eric

To unsubscribe from this group and stop receiving emails from it, send an email to aptly-...@googlegroups.com.

[Jim Campbell]

Hi Eric,

Did you ever sort this out?  If so, what was your solution?

Jim

[Eric Mueller]

Hey Jim,

Yes, I did figure it out. When I was running 16.04 my ubuntu client had its sources.list file configured like so.....

deb http://apt-server/ubuntu xenial main restricted

deb http://apt-server/ubuntu xenial-updates main restricted

deb http://apt-server/ubuntu xenial-security main restricted

As you can see, I have the restricted component listed. This never caused an issue for any of my xenial systems using an aptly repository. In the aptly documentation it states that all components are published when you do not specify them individually.

When I started testing 20.04, I kept my sources list file the same but of course replaced xenail with focal where applicable. When doing an apt update with this configuration,I received all those error messages I listed in my previous post.

The solution was to just remove the restricted component from the sources file. Now everything works as expected. I am not what changed between 16.04 and 20.04 but I was glad it was a simple fix. Nothing needed to be changed on the aptly side.

Here is how my focal sources list looks like now.

deb http://apt-server/ubuntu focal main

deb http://apt-server/ubuntu focal-updates main

deb http://apt-server/ubuntu focal-security main

user@testvm:~$ sudo apt update

Hit:1 http://apt-server/ubuntu focal InRelease
Hit:2 http://apt-server/ubuntu focal-updates InRelease
Hit:3 http://apt-server/ubuntu focal-security InRelease
Reading package lists... Done
Building dependency tree
Reading state information... Done
59 packages can be upgraded. Run 'apt list --upgradable' to see them.

thanks

Eric

To unsubscribe from this group and stop receiving emails from it, send an email to aptly-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/aptly-discuss/3f5253f8-5a98-446b-8e20-e171487f5472o%40googlegroups.com.