Speed of "pkg install ..." for solaris 11

[Mr. Chow Wing Siu]

Hi all,

I set up the local repository at localhost to install packages.

As I have mentioned in this forum before, I need to install
most packages and am able to so but the speed of "pkg install"
is too slow. Of course, even to install one package, the speed
is also terribly slow. :)

Is there any way to quicken the speed of "pkg install"?

Thank you for sharing.

--
Johnson Chow

[Ian Collins]

On 02/29/12 02:47 PM, Mr. Chow Wing Siu wrote:
> Hi all,
>
> I set up the local repository at localhost to install packages.
>
> As I have mentioned in this forum before, I need to install
> most packages and am able to so but the speed of "pkg install"
> is too slow. Of course, even to install one package, the speed
> is also terribly slow. :)

Too slow compared to what?

Installing from a local repository is certainly faster than pkgadd and
no worse than Ubuntu.

On a test box here, installing Solaris Studio and all its dependencies
over the LAN took 1m46s. Not bad for nigh on 500MB of stuff.

> Is there any way to quicken the speed of "pkg install"?

Faster machine/disk?

--
Ian Collins

[Richard B. Gilbert]

What hardware are you using? SPARC or X86?

What device are you installing from? Faster hardware has been
known to help. If you are installing from punched paper tape ;-),
installation may take several months! If you are installing
from CDROM or DVD it should go fairly quickly. ISTR 30-45 Minutes!

CPU speed can be a factor. Having lots of RAM can also help.

It has been a while since I last installed SUN O/S but ISTR
that it took 30-45 minutes using Ultra 5/10 hardware and a CD-ROM
drive. I also recall that you can provide most of the responses
using a 3-1/2" floppy, in which case you can simply start the install,
have a leisurely lunch and find that the installation is complete or
nearly so!

You can also install over the network if you have a working Sun system.
ISTR that boot/net is the proper incantation.

[Mr. Chow Wing Siu]

Richard B. Gilbert <rgilb...@comcast.net> wrote:
> What hardware are you using? SPARC or X86?
> What device are you installing from? Faster hardware has been
> known to help. If you are installing from punched paper tape ;-),
> installation may take several months! If you are installing
> from CDROM or DVD it should go fairly quickly. ISTR 30-45 Minutes!
> CPU speed can be a factor. Having lots of RAM can also help.
> It has been a while since I last installed SUN O/S but ISTR
> that it took 30-45 minutes using Ultra 5/10 hardware and a CD-ROM
> drive. I also recall that you can provide most of the responses
> using a 3-1/2" floppy, in which case you can simply start the install,
> have a leisurely lunch and find that the installation is complete or
> nearly so!
> You can also install over the network if you have a working Sun system.
> ISTR that boot/net is the proper incantation.

-------------------------------------------------

I am running solaris 11 x86 on VMware ESXi 5.0 (Q9450 & 8GB RAM, SATA2).
The time to pkg install ... is about more than 8 hours. Compared to
CentOS Linux or whatever, I think that the package installation of
Solaris 11 is very slow.

--
Johnson Chow

[Doug McIntyre]

"Mr. Chow Wing Siu" <wsc...@Comp.HKBU.Edu.HK> writes:
>I am running solaris 11 x86 on VMware ESXi 5.0 (Q9450 & 8GB RAM, SATA2).
>The time to pkg install ... is about more than 8 hours. Compared to
>CentOS Linux or whatever, I think that the package installation of
>Solaris 11 is very slow.

I think something is seriously wrong with your hardware..

I just did a clean install of Solaris 11 text installer on an ESXi 4.1
host. Gave it 1G of DRAM and 20G of disk.

I ignored all the SCSI timeouts and such during the install since
VMWare gives no love to Solaris 11. (5.0 doesn't give any either).

Did the 'pkg install entire', and then confirmed by hand every package
listed in the catalog had been installed.

I was done within 30 minutes start to finish. And almost half of that
time was just me confirming the packages were all there.
(granted, I have quite a lot of Internet bandwidth, and Oracle feeds
me nicely).

Its either your hardware, or some sever lack of bandwidth, or something.

But there really isn't *many* packages available as it is anyway that
would take 8 hours?

[Mr. Chow Wing Siu]

--------------------------------------------------

I run a perl script to "pkg list -a" and install the packages which
are marked as "---" one-by-one.

I had asked a question in this forum: how to install all packages?
None answered me. So that I use my own method because it will
not give any dependency problem because

I did not use "pkg install entire" because I don't know this option.
Do "entire" mean "all available packages"?

Basically, "pkg list -a|wc" is 2511.

Thanks.

--
Johnson Chow

[Ian Collins]

On 02/29/12 08:58 PM, Mr. Chow Wing Siu wrote:
>
> I run a perl script to "pkg list -a" and install the packages which
> are marked as "---" one-by-one.

No wonder that took ages, pkg would have to create an install plan for
every package!

> I had asked a question in this forum: how to install all packages?
> None answered me. So that I use my own method because it will
> not give any dependency problem because

This isn't Oracle support...

> I did not use "pkg install entire" because I don't know this option.
> Do "entire" mean "all available packages"?

If you have a supported system:

Name: entire
Summary: entire incorporation including Support Repository Update
(Oracle Solaris 11 11/11 SRU 03).

--
Ian Collins

[Ian Collins]

In short - no, it isn't all packages. It is a special incorporation
used to track updates.

--
Ian Collins

[Mr. Chow Wing Siu]

Ian Collins <ian-...@hotmail.com> wrote:
> No wonder that took ages, pkg would have to create an install plan for
> every package!

> This isn't Oracle support...

> If you have a supported system:
> Name: entire
> Summary: entire incorporation including Support Repository Update
> (Oracle Solaris 11 11/11 SRU 03).

--------------------------------------------

# pkg install entire
No updates necessary for this image.
# pkg search entire
INDEX ACTION VALUE PACKAGE
pkg.fmri set solaris/entire pkg:/ent...@0.5.11-0.175.0.0.0.2.0

Is it meant that I have installed all available items or the entire
option is not supported?

If the number of packages "entire" >= the number of all available
packages and "pkg install entire" is working, I would like to use
"pkg install entire". Anyone can answer?

Thanks.

--
Johnson Chow

[Mr. Chow Wing Siu]

Mr. Chow Wing Siu <wsc...@Comp.HKBU.Edu.HK> wrote:
> # pkg install entire
> No updates necessary for this image.

-----------------------------------------

I answer my question. I newly install a Solaris 11 and try
"pkg install entire" and get the same output. No package
will be installed.

--
Johnson Chow

[Ian Collins]

On 02/29/12 09:59 PM, Mr. Chow Wing Siu wrote:
> Ian Collins<ian-...@hotmail.com> wrote:
>> No wonder that took ages, pkg would have to create an install plan for
>> every package!
>> This isn't Oracle support...
>> If you have a supported system:
>> Name: entire
>> Summary: entire incorporation including Support Repository Update
>> (Oracle Solaris 11 11/11 SRU 03).
> --------------------------------------------
>
> # pkg install entire
> No updates necessary for this image.
> # pkg search entire
> INDEX ACTION VALUE PACKAGE
> pkg.fmri set solaris/entire pkg:/ent...@0.5.11-0.175.0.0.0.2.0
>
> Is it meant that I have installed all available items or the entire
> option is not supported?

I answered your question in my last post.

--
Ian Collins

[John D Groenveld]

In article <jiklr2$6kos$1...@net44p.hkbu.edu.hk>,

Mr. Chow Wing Siu <Johnso...@Comp.HKBU.Edu.HK> wrote:
>I run a perl script to "pkg list -a" and install the packages which
>are marked as "---" one-by-one.

Lets see your script.

John
groe...@acm.org

[Richard B. Gilbert]

On 2/29/2012 12:44 AM, Mr. Chow Wing Siu wrote:
> Richard B. Gilbert<rgilb...@comcast.net> wrote:
>> What hardware are you using? SPARC or X86?
>> What device are you installing from? Faster hardware has been
>> known to help. If you are installing from punched paper tape ;-),
>> installation may take several months! If you are installing
>> from CDROM or DVD it should go fairly quickly. ISTR 30-45 Minutes!
>> CPU speed can be a factor. Having lots of RAM can also help.
>> It has been a while since I last installed SUN O/S but ISTR
>> that it took 30-45 minutes using Ultra 5/10 hardware and a CD-ROM
>> drive. I also recall that you can provide most of the responses
>> using a 3-1/2" floppy, in which case you can simply start the install,
>> have a leisurely lunch and find that the installation is complete or
>> nearly so!
>> You can also install over the network if you have a working Sun system.
>> ISTR that boot/net is the proper incantation.
> -------------------------------------------------
>

> I am running solaris 11 x86 on VMware ESXi 5.0 (Q9450& 8GB RAM, SATA2).

> The time to pkg install ... is about more than 8 hours. Compared to
> CentOS Linux or whatever, I think that the package installation of
> Solaris 11 is very slow.
>

Have you considered that your hardware may be slow by usual standards?

Solaris 8, 9, and 10 install on SPARC hardware in an hour or two.
Running on SPARC hardware with a gigabyte of RAM performance should be
quite snappy!

[Mr. Chow Wing Siu]

John D Groenveld <groe...@cse.psu.edu> wrote:
> Lets see your script.
> John
> groe...@acm.org

---------------------------------------------------

#!/bin/perl
$exclude="(^system/|_install|osnet)";
open(PKG,"pkg list -a|");
while(<PKG>) {
($pkg,$version,$flag) = split(/\s+/,$_);
if ($flag eq "---" && !($pkg =~ $exclude)) {
system("pkg install -q $pkg");
}
}
close PKG;
---------------------------------------------------

--
Johnson Chow

[Mr. Chow Wing Siu]

------------------------------------------

Sorry, have you tried solaris 11 and "pkg" command (not pkgadd) to
download/install packages directly from local or oracle's repository?

--
Johnson Chow

[John D Groenveld]

In article <jimcnp$32l6$1...@net44p.hkbu.edu.hk>,

Mr. Chow Wing Siu <Johnso...@Comp.HKBU.Edu.HK> wrote:

>#!/bin/perl
>$exclude="(^system/|_install|osnet)";
>open(PKG,"pkg list -a|");
>while(<PKG>) {
> ($pkg,$version,$flag) = split(/\s+/,$_);
> if ($flag eq "---" && !($pkg =~ $exclude)) {
> system("pkg install -q $pkg");
> }
>}
>close PKG;

What's the speed difference when running pkg(1M) only once
with all your package FMRIs?

John
groe...@acm.org

[Hugh Coomes]

Try rewriting the perl script to put all the packages to be installed in
a single command:

system("pkg install pkg1 pkg2 pkg3 ... pkgn");

If there are two many packages for this to work, you might try
installing all packages with

pkg install pkg://mypublisher/*

where mypublisher is the publisher name for your repository
and then uninstalling the packages you don't need.

[Mr. Chow Wing Siu]

Hugh Coomes <hco...@insightbb.com> wrote:
> Try rewriting the perl script to put all the packages to be installed in
> a single command:
> system("pkg install pkg1 pkg2 pkg3 ... pkgn");
> If there are two many packages for this to work, you might try
> installing all packages with
> pkg install pkg://mypublisher/*
> where mypublisher is the publisher name for your repository
> and then uninstalling the packages you don't need.

-------------------------------------------------

There's a problem. If doing "pkg install pkg1 pkg2 .... " and any one
of the packages cannot be installed, then it fails all of them.
It means "all-or-nothing" to be installed.

But if it does it one by one, the entire installation will not be
affected by those packages which cannot be installed.

--
Johnson Chow

[John D Groenveld]

In article <jimrg0$32mo$1...@net44p.hkbu.edu.hk>,

Mr. Chow Wing Siu <Johnso...@Comp.HKBU.Edu.HK> wrote:

>There's a problem. If doing "pkg install pkg1 pkg2 .... " and any one
>of the packages cannot be installed, then it fails all of them.
>It means "all-or-nothing" to be installed.

Besides developer/opensolaris/osnet what other advertised
packages on pkg.Oracle.COM fail?

John
groe...@acm.org

[Richard B. Gilbert]

Not yet. I installed S10 SPARC a few years ago. I also have machines
running Solaris 8 and Solaris 9. These systems were my home laboratory
before I retired. I don't do much with them these days, mostly they
help keep the room warm! ;-)

Occasionally, I use them to develop and test something or just to do
something for which Solaris/SPARC is the right tool.

[Ian Collins]

Don't you think all this pain is trying to tell you something?

Don't try and install everything, it's a really bad idea! Just install
packages from your local repository as needed. Otherwise you just end
up with a ton of stuff you don't need and have to keep up to date.

--
Ian Collins

[hume.sp...@bofh.ca]

Richard B. Gilbert <rgilb...@comcast.net> wrote:
> Running on SPARC hardware with a gigabyte of RAM performance should be
> quite snappy!

Solaris 10, probably with ZFS root, on a SPARC with just a gig of RAM?
"Snappy"?

I do not believe that word means what you think it means.

In any event, the OP is using Solaris 11, which is as different from Solaris
10 as 10 is from 2.4 or whatever version you last used.

That said, the OP is facing an uphill battle because 'pkg's designers, like
most of us on this group, consider what he's trying to do to be completely
insane and thus haven't put a whole lot of thought into how to do it.

It might be worthwhile (I say this seriously) to ask the folk on the
pkg-discuss mailing list about the best means to accomplish this task.
But be prepared again to deal with the "why in the world do you want to do
that?" questions.

http://mail.opensolaris.org/mailman/listinfo/pkg-discuss

--
Brandon Hume - hume -> BOFH.Ca, http://WWW.BOFH.Ca/