Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

good place to download kernel source?

10 views
Skip to first unread message

crankypuss

unread,
Apr 26, 2013, 5:38:06 AM4/26/13
to
I've been trying to download the 3.8.8 source from kernel.org for two
days now and I'm getting throughput speeds of about 10kbps which is crap
for a 67.7mb file and I don't think it's my connection... in any case
firefox keeps saying the download is complete when there's a few meg
transferred.

Anybody know what the deal is, is kernel.org having problems or what, is
there a good source for the source?

I notice that more and more sites have started regulating download
speeds so they can sell you "accelerated" access. Must be the modern thing.

Aragorn

unread,
Apr 26, 2013, 6:49:24 AM4/26/13
to
On Friday 26 April 2013 11:38, crankypuss conveyed the following to
alt.os.linux...
I've just checked. There are no sources for 3.8.8 that I could see, but
I downloaded 3.8.9 instead. File size is 67.7 MiB, and I got an average
download speed of ~700 kiB/sec. I downloaded the tarball using Firefox,
but this is an older version of Firefox.

My guess is that there's a connection problem between your own locale
and the server you access at kernel.org. The domain name kernel.org is
now a forwarder to a server geographically close to you (based upon your
IP address), or in other words: I was downloading from a European
mirror, which my connection to kernel.org automatically selected for me,
based upon my IP address range.

--
= Aragorn =
GNU/Linux user #223157 - http://www.linuxcounter.net

crankypuss

unread,
Apr 26, 2013, 7:16:36 AM4/26/13
to
Thanks A. The 3.8.9 version just went to stable yesterday (4/25). I
saw the 3.8.8 .gz and .xz versions this morning, but once I realized
that 3.8.9 had gone stable went after that .xz file instead.

I suspect that there is something not quite optimal about the way
firefox handles file downloads. Currently downloading from
ftp://ftp.kernel.org/pub/ through filezilla instead of firefox, it's
still slow but it seems at least to be progressing solidly.

Was just about to go do some research into how genuine linux folks
download files, there is doubtless something too simple to think of like
a brief rsync command or something... in many ways it would be best to
come to linux blank-slate-ignorant since when you have a way to do
something that's been working before, looking for a new way to do it
seems less important than just getting it done.

No idea why the transfer rate is so piddly, I seem to have plenty of
bandwidth available for doing other things... I'm guessing that some
node between here and there is busy and that if I was to spend some time
learning traceroute et-al I'd be able to figure out what was going on
maybe, but by then it would probably be forensic rather than curative.

Anyway thanks, your help is appreciated. Sounds pretty sweet to get an
average download speed ~700kbps, the highest I've seen on my wireless
cellular connection is ~400kbps but we're far enough out that there is
no city-water, no city-sewer, no piped-in natural-gas, and it would cost
almost $20k US just to connect to the so-called electric grid, so maybe
~400kbps is not too bad all things considered. <g>

Aragorn

unread,
Apr 26, 2013, 7:38:50 AM4/26/13
to
On Friday 26 April 2013 13:16, crankypuss conveyed the following to
Well, I just go by what the site offers that I'm downloading from. Most
commonly that will be http. For distro .iso files, I typically head to
my local mirror, which is an ftp site at a server farm mainly used by
our local universities. Firefox can handle ftp too, but sometimes I use
Konqueror instead.

> No idea why the transfer rate is so piddly, I seem to have plenty of
> bandwidth available for doing other things... I'm guessing that some
> node between here and there is busy and that if I was to spend some
> time learning traceroute et-al I'd be able to figure out what was
> going on maybe, but by then it would probably be forensic rather than
> curative.

Yeah, it's probably down to some busy node somewhere in between you and
the mirror.

> Anyway thanks, your help is appreciated. Sounds pretty sweet to get
> an average download speed ~700kbps, the highest I've seen on my
> wireless cellular connection is ~400kbps but we're far enough out that
> there is no city-water, no city-sewer, no piped-in natural-gas, and it
> would cost almost $20k US just to connect to the so-called electric
> grid, so maybe ~400kbps is not too bad all things considered. <g>

Well, my download and upload speeds vary greatly. I'm on cable
internet, which uses token ring. So if the people within the local ring
- which covers a few blocks - are all in their leeching moods, then my
speed will of course not be optimal.

As I downloaded the tarball just now, it started out somewhere around
400 KiB/sec, and then it gradually went up and back down again. Peak
was around 960 KiB/sec. And this is just after noon on a Friday, if you
need any reference points. ;-)

crankypuss

unread,
Apr 26, 2013, 7:43:20 AM4/26/13
to
On 04/26/2013 05:38 AM, Aragorn wrote:
> As I downloaded the tarball just now, it started out somewhere around
> 400 KiB/sec, and then it gradually went up and back down again. Peak
> was around 960 KiB/sec. And this is just after noon on a Friday, if you
> need any reference points. ;-)

Peak of 960, huh? Smart-guy, poking at the backwoods hick, eh? My
electric bill is $0, so there's a "reference point" for ya. <g>

Aragorn

unread,
Apr 26, 2013, 8:12:38 AM4/26/13
to
On Friday 26 April 2013 13:43, crankypuss conveyed the following to
alt.os.linux...

> On 04/26/2013 05:38 AM, Aragorn wrote:
>
>> As I downloaded the tarball just now, it started out somewhere around
>> 400 KiB/sec, and then it gradually went up and back down again. Peak
>> was around 960 KiB/sec. And this is just after noon on a Friday, if
>> you need any reference points. ;-)
>
> Peak of 960, huh? Smart-guy, poking at the backwoods hick, eh?

No, I was not quite trying to be cheeky.

> My electric bill is $0, so there's a "reference point" for ya. <g>

I can't say I'm /that. fortunate. ;-)

J G Miller

unread,
Apr 26, 2013, 8:14:20 AM4/26/13
to
On Friday, April 26th, 2013, at 03:38:06h -0600, Cranky Puss observed:

> in any case firefox keeps saying the download is complete
> when there's a few meg transferred.

For somebody who understands the mantra

"use the right tool for the right job"

one surely wonders why you are using firefox as a download
tool for large files (anything over 1 - 2 Mbyte).

As a first step one could use wget, but the best choice
is prozilla --

<http://sourceforge.NET/projects/prozilla/>

The advantage with prozilla being that if download suspend/reconnect
is allowed, if your large download fails, you do not have to start
from scratch.

For those who are only able to point and click with a mouse,
perhaps due to cliphobia, there is the prozgui front end --

<http://sourceforge.NET/projects/prozgui/>


Also if you are having trouble downloading the kernel from
one official kernel server, why are you not trying one of the
many mirrors?

J G Miller

unread,
Apr 26, 2013, 8:34:44 AM4/26/13
to
On Friday, April 26th, 2013, at 12:14:20h +0000, J G Miller burbled:

> but the best choice is prozilla --
>
> <http://sourceforge.NET/projects/prozilla/>

For those who are actually interested in installing prozilla,
one of the few places to get the source code (because the home
site disappeared a long time ago) of the most recent version 2.0.4
is

<http://linux.softpedia.COM/progDownload/ProZilla-Download-12991.html

crankypuss

unread,
Apr 26, 2013, 8:46:00 AM4/26/13
to
On 04/26/2013 06:14 AM, J G Miller wrote:
> On Friday, April 26th, 2013, at 03:38:06h -0600, Cranky Puss observed:
>
>> in any case firefox keeps saying the download is complete
>> when there's a few meg transferred.
>
> For somebody who understands the mantra
>
> "use the right tool for the right job"
>
> one surely wonders why you are using firefox as a download
> tool for large files (anything over 1 - 2 Mbyte).

Bad habits tend to stick with me.

> As a first step one could use wget,

I literally just learned something about wget this morning... some
things I know a good bit about, others not so much, and others near
nothing. Always been terrible at learning to use other peoples' tools,
or installing things, when I was working in the business I was usually
given a box with some code that needed fixed, modified, whatever... that
part I can do, but installing just draws a blank, "WTF is this?"

> but the best choice
> is prozilla --
>
> <http://sourceforge.NET/projects/prozilla/>
>
> The advantage with prozilla being that if download suspend/reconnect
> is allowed, if your large download fails, you do not have to start
> from scratch.
>
> For those who are only able to point and click with a mouse,
> perhaps due to cliphobia, there is the prozgui front end --
>
> <http://sourceforge.NET/projects/prozgui/>
>

I ended up using filezilla... used to use it on windows and the linux
version is familiar and seems solid. Next time I'll try wget.

> Also if you are having trouble downloading the kernel from
> one official kernel server, why are you not trying one of the
> many mirrors?

You see that subject title, bud-dy?

J G Miller

unread,
Apr 26, 2013, 10:39:50 AM4/26/13
to
On Friday, April 26th, 2013, at 06:46:00h -0600,
Cranky Puss explained:

> Bad habits tend to stick with me.

And that is why your progress in learning new things
is severely hampered.

> I ended up using filezilla... used to use it on windows and the linux
> version is familiar and seems solid.

Filezilla is a very good FTP client and more importantly
supports sftp to ensure that passwords are not sent as
plain text and that the remote site is really who it claims
to be via certificate verification.

However, to the best of my knowledge, Filezilla does not support
multiple download threads of the same source, nor resume session
for file downloads, as does prozilla.

So the recommendation to use prozilla stands.

> You see that subject title, bud-dy?

Your favorite search engine not working today?

I thought that kernel.org provided a list of mirrors on
one of its pages but that is not the case.

Here is a list of major mirror sites

<http://sourceware.org/mirrors.html>

not just for the kernel but for distributions and
other major collections as well.

This extremely fast mirror site should be on that list as well

<ftp://ftp.belnet.BE/mirror/>




unruh

unread,
Apr 26, 2013, 11:24:26 AM4/26/13
to
Yes, many of the sites support rsync
rsync address.of.the.mirror::
will show if they rsync set up.

You could also try for mirrors.
For example carroll.cac.psu.edu has a kernel mirror. Unfortunately
versions 2.6 and 3.0 cannot be accessed so it is a bit useless for you,
but is just an indication that if look around at some of the
distribution mirror sites, you might well find an alternative source.



>
> No idea why the transfer rate is so piddly, I seem to have plenty of
> bandwidth available for doing other things... I'm guessing that some
> node between here and there is busy and that if I was to spend some time
> learning traceroute et-al I'd be able to figure out what was going on
> maybe, but by then it would probably be forensic rather than curative.

traceroute simply sends a ping packet. Hardly a good test of a
largescale download.

>
> Anyway thanks, your help is appreciated. Sounds pretty sweet to get an
> average download speed ~700kbps, the highest I've seen on my wireless
> cellular connection is ~400kbps but we're far enough out that there is
> no city-water, no city-sewer, no piped-in natural-gas, and it would cost
> almost $20k US just to connect to the so-called electric grid, so maybe
> ~400kbps is not too bad all things considered. <g>

Ah cellular. That might explain it. I do not think that they are
optimised for speed of large transfers, and may in fact throttle them
down. How about sneakernet (have a friend download it to a usb stick and
bring it along next time you see them)
.

unruh

unread,
Apr 26, 2013, 11:28:35 AM4/26/13
to
Does that mean it is a dead programme (ie one where noone fixes any
diseases?)

Ivan Shmakov

unread,
Apr 26, 2013, 12:48:49 PM4/26/13
to
>>>>> J G Miller <mil...@yoyo.ORG> writes:

[Cross-posting to news:comp.protocols.tcp-ip, just in case.]

[...]

> As a first step one could use wget, but the best choice is prozilla
> --

> <http://sourceforge.NET/projects/prozilla/>

> The advantage with prozilla being that if download suspend/reconnect
> is allowed, if your large download fails, you do not have to start
> from scratch.

As in $ wget -c?

$ wget --help
...
-c, --continue resume getting a partially-downloaded file.
...
$

But given a solid distribution infrastructure, with Metalink
files and magnet: URIs all over the place, I'd probably
recommend aria2c(1) at once instead.

[...]

--
FSF associate member #7257

root

unread,
Apr 26, 2013, 1:01:12 PM4/26/13
to
The above source will not make as is. You have to make a change which I
quote from the authority:


colucix This is a problem with newer GNU C/C++ compilers. To solve it just edit the file src/download_win.h and strip out the class name before the method at line 55, that is
Moderator Code:

Registered: Sep 2003 void DL_Window::print_status(download_t * download, int quiet_mode);
Location: Bologna
Distribution: CentOS should be
6.4 OpenSuSE 12.2 Code:
Posts: 9,891
void print_status(download_t * download, int quiet_mode);

With this change the program will make under slack-14.

I was just wanted to see it work.

root

unread,
Apr 26, 2013, 1:50:02 PM4/26/13
to
OK, I saw it work. Not impressed. http stuff from kernel.org is now
https and prozilla doesn't recognize it. So, I went to ftp
and compared for the 3.8.9 kernel.tar.gz with
and without prozilla.

25 seconds with prozilla
28 seconds without.

unruh

unread,
Apr 26, 2013, 1:56:04 PM4/26/13
to
On 2013-04-26, root <NoE...@home.org> wrote:
> unruh <un...@invalid.ca> wrote:
>> On 2013-04-26, J G Miller <mil...@yoyo.ORG> wrote:
>>> On Friday, April 26th, 2013, at 12:14:20h +0000, J G Miller burbled:
>>>
>>>> but the best choice is prozilla --
>>>>
>>>> <http://sourceforge.NET/projects/prozilla/>
>>>
>>> For those who are actually interested in installing prozilla,
>>> one of the few places to get the source code (because the home
>>> site disappeared a long time ago) of the most recent version 2.0.4
>>> is
>>>
>>> <http://linux.softpedia.COM/progDownload/ProZilla-Download-12991.html
>>>
>>
>> Does that mean it is a dead programme (ie one where noone fixes any
>> diseases?)
>>

It is actually included in the Mandriva and Mageia releases made for
thos machines. You could download the rpm source package from any
Mageia mirror unpack it and use that on your system, if you do not have
a mageia or rpm system.


>
> The above source will not make as is. You have to make a change which I
> quote from the authority:
>
>
> colucix This is a problem with newer GNU C/C++ compilers. To solve it just edit the file src/download_win.h and strip out the class name before the method at line 55, that is
> Moderator Code:
>
> Registered: Sep 2003 void DL_Window::print_status(download_t * download, int quiet_mode);

Are you really saying that it has not had any work on it since 2003?

The version on the Mageia2 site is 2.0.4

root

unread,
Apr 26, 2013, 3:41:37 PM4/26/13
to
unruh <un...@invalid.ca> wrote:
>>
>> The above source will not make as is. You have to make a change which I
>> quote from the authority:
>>
>>
>> colucix This is a problem with newer GNU C/C++ compilers. To solve it just edit the file src/download_win.h and strip out the class name before the method at line 55, that is
>> Moderator Code:
>>
>> Registered: Sep 2003 void DL_Window::print_status(download_t * download, int quiet_mode);
>
> Are you really saying that it has not had any work on it since 2003?
>
> The version on the Mageia2 site is 2.0.4
>
>
>> Location: Bologna
>> Distribution: CentOS should be
>> 6.4 OpenSuSE 12.2 Code:
>> Posts: 9,891
>> void print_status(download_t * download, int quiet_mode);
>>

It's not me saying that. However, it seems that a problem first noticed
in 2003 has not been addressed. The version I downloaded was
prozilla-2.04.

Jasen Betts

unread,
Apr 26, 2013, 6:34:30 PM4/26/13
to
On 2013-04-26, crankypuss <crank...@nomail.invalid> wrote:
try p2p ?

try wget (with a high retry setting)



--
āš‚āšƒ 100% natural

--- news://freenews.netfront.net/ - complaints: ne...@netfront.net ---

Jasen Betts

unread,
Apr 26, 2013, 6:43:35 PM4/26/13
to
It doesn't have to be fresh to be good. Wget still uses a 1990's version of
http. Nobody seems to mind much.

crankypuss

unread,
Apr 27, 2013, 6:08:39 AM4/27/13
to
On 04/26/2013 08:39 AM, J G Miller wrote:
> On Friday, April 26th, 2013, at 06:46:00h -0600,
> Cranky Puss explained:
>
>> Bad habits tend to stick with me.
>
> And that is why your progress in learning new things
> is severely hampered.

The main thing that slows me down is actually doing things rather than
just learning about them so that I too can tell other people how stupid
they are; if you dislike me, you could simply not respond, rather than
playing the bitchy old woman.

>> I ended up using filezilla... used to use it on windows and the linux
>> version is familiar and seems solid.
>
> Filezilla is a very good FTP client and more importantly
> supports sftp to ensure that passwords are not sent as
> plain text and that the remote site is really who it claims
> to be via certificate verification.
>
> However, to the best of my knowledge, Filezilla does not support
> multiple download threads of the same source, nor resume session
> for file downloads, as does prozilla.
>
> So the recommendation to use prozilla stands.

I think filezilla does support multiple simultaneous downloads, but
would need to run a test to be sure it isn't my memory playing tricks;
it certainly resumes interrupted downloads, unless it has magically
stopped since yesterday. I'm still running a modified Ubuntu, and
filezilla was available on the Ubuntu repository, pre-built, without any
need for fixing makefiles as another poster mentioned... that earns it
extra points.

In any case wget is on my list of things to check out, I really don't
need to see blinking lights in order to download a file. When I was
maintaining a website, filezilla was handy because it offered parallel
directory lists for client & server, but for just a download or two wget
is probably a better tool assuming that it works as documented.

For that matter, firefox ought to be capable of downloading a file for
pete's sake, but apparently its maintainers are all on fast solid
connections or simply can't be bothered to fix its obvious flaws in this
area. I certainly can't be bothered to fix it at this point, not when
there are other tools that will do the job and leave me to doing more
useful things.

>> You see that subject title, bud-dy?
>
> Your favorite search engine not working today?
>
> I thought that kernel.org provided a list of mirrors on
> one of its pages but that is not the case.

Exactly, kernel.org does not provide a list of mirrors, so rather than
google around looking for sites that *claim* to be kernel mirrors (and
want you to sign up and pay money for their "accelerated", eg,
unthrottled, downloads), I asked here, where there are at least a few
who have shown themselves to be reliably knowledgable.

> Here is a list of major mirror sites
>
> <http://sourceware.org/mirrors.html>
>
> not just for the kernel but for distributions and
> other major collections as well.
>
> This extremely fast mirror site should be on that list as well
>
> <ftp://ftp.belnet.BE/mirror/>
>

"This page was last modified with loving care by cgf 2004-10-14."

WTF, it's only 9 years old. If you think that "extremely fast mirror
site" should be on the list then contact them and tell them, maybe one
of your grandkids will get to see it listed there.

crankypuss

unread,
Apr 27, 2013, 6:11:46 AM4/27/13
to
On 04/26/2013 04:34 PM, Jasen Betts wrote:
> On 2013-04-26, crankypuss <crank...@nomail.invalid> wrote:
>> I've been trying to download the 3.8.8 source from kernel.org for two
>> days now and I'm getting throughput speeds of about 10kbps which is crap
>> for a 67.7mb file and I don't think it's my connection... in any case
>> firefox keeps saying the download is complete when there's a few meg
>> transferred.
>>
>> Anybody know what the deal is, is kernel.org having problems or what, is
>> there a good source for the source?
>>
>> I notice that more and more sites have started regulating download
>> speeds so they can sell you "accelerated" access. Must be the modern thing.
>
> try p2p ?
>
> try wget (with a high retry setting)
>
>
>

Got it through filezilla, firefox is clearly broken for large downloads
on less than perfectly solid connections. wget also suggested by
others, looks good, will try it first for next large download. Thanks.

Kirk_Von_Rockstein

unread,
Apr 27, 2013, 6:37:10 AM4/27/13
to
On 2013-04-27, crankypuss <crank...@nomail.invalid> wrote:
<snip>
> In any case wget is on my list of things to check out, I really don't
> need to see blinking lights in order to download a file. When I was
> maintaining a website, filezilla was handy because it offered parallel
> directory lists for client & server, but for just a download or two wget
> is probably a better tool assuming that it works as documented.
>
> For that matter, firefox ought to be capable of downloading a file for
> pete's sake, but apparently its maintainers are all on fast solid
> connections or simply can't be bothered to fix its obvious flaws in this
> area. I certainly can't be bothered to fix it at this point, not when
> there are other tools that will do the job and leave me to doing more
> useful things.
<snip>

In all the years I have used Firefox, from the days when it was
called Phoenix, I have never used the Firefox downloader other than
to lazily backup router configs.

Install flashgot extension

http://flashgot.net/

Then you can configure firefox to download
with any downloader you prefer (i.e. wget, d4x, curl, aria, aria-2,
axel, KDE-get, prozilla, et al whatever) and allows many options also.

crankypuss

unread,
Apr 27, 2013, 7:08:57 AM4/27/13
to
I am strongly dis-inclined toward the use of browser plugins (a
carryover from experience with Windows), but thanks for mentioning it,
it sounds like one of the better plugins.

J G Miller

unread,
Apr 27, 2013, 9:49:55 AM4/27/13
to
On Saturday, April 27th, 2013, at 04:08:39h -0600, Cranky Puss wrote:

> rather than playing the bitchy old woman.

That role is already taken by one whose pseudonym precisely fits
that description and whose posting history proves.

crankypuss

unread,
Apr 27, 2013, 2:24:39 PM4/27/13
to
Yeah, yeah, spare me your personal criticism.

As for bitching... this morning I had reason to boot the virgin Ubuntu
11.10 install stick, and man what a load of crap they layered on top of
a perfectly good opsys. I'd forgotten just how bad it was before I
started peeling layers off and tossing them. No wonder Windows folks
install Ubuntu and immediately start complaining.
0 new messages