last week, openSUSE 11.1 was released, shortly after I published http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ That posting really helped to get some users to try out a download by metalink. And I read only very good feedback on mailing lists and IRC, some of it I have collected here:
I have collected some quotes from users from mailing lists and IRC:
|> 15:38 < aa> downloading with aria2c for the first time |> 15:38 < bbb> ccccc: but dddd wants us to hit the 200TB mark! :-) |> 15:39 < dddd> hehe |> 15:39 < bbb> and it just went down even further. It's crawling now. dddd, what have you done? |> 15:39 < ccccc> bbb: download 2-3 DVDs! |> 15:39 < ccccc> why stop when you can download even more
<snip>
|> 15:46 * aa downloads with area2c and reaches 1300kbit/s !!!! |> 15:47 < dddd> aa: you have only a 10mbit line? :-) |> 15:52 < ccccc> wow, aria2 is really able to saturate my line |> 15:53 < ccccc> can it output more details where it downloads from? |> 15:55 < ccccc> I don't understand its progress. It goes to 100% and then starts from scratch |> 15:56 < eee> Im trying aria2 and it was quite useful |> 15:56 < eee> I tried to ssh to another box and download with ftp, well, server is busy |> 15:57 < eee> Connected to download.opensuse.org |> 15:57 < eee> 500 This server is busy, please try again later or any of my mirrors :-) |> 15:57 < bbb> I guess dddd beat his 200TB goal then :-) |> 15:59 < ccccc> download.o.o doesn't look busy |> 16:00 < eee> ccccc:did you try with ftp ? |> 16:00 < ccccc> eee: you shouldn't, the ftp server always returns 500 |> 16:00 < ccccc> you should use http
<snip>
|> 16:13 < ffffff> ok i bow my head in awe of aria2 450KiBs vs 56KiBs for straight http |> 16:13 < ggggggg> people could also just use torrent |> 16:14 < ccccc> ggggggg: they don't reach the bandwidth you get with akamai |> 16:14 < ggggggg> ccccc: if nobody uses torrent we cant speed up of course. |> 16:14 < ccccc> at least I have 180K with torrent and 570K with http |> 16:15 < hhhhhhhh> too few high speed mirrors seeding :-) |> 16:15 < ccccc> hhhhhhhh: too few seeders for too many leechers at least |> 16:16 < hhhhhhhh> yup.. so remember to seed via bittorrent when y'all are done with your fancy speedy downloads ;-) |> 16:16 < bbb> hhhhhhhh: do you get a commission for each seed? :-) |> 16:19 < hhhhhhhh> I get closer to my goal of world domination with every completed download >:-) |> 16:19 < mirrorbrain> ccccc: a very verbose log with -l aria2c.log |> 16:19 < mirrorbrain> ccccc: its probably easier to see that it does with "netstat -tupa | grep aria" |> 16:19 < mirrorbrain> ccccc: the first "count to 100%" is file allocation only |> 16:21 < ccccc> mirrorbrain: the authors haven't heared of fseek and write the 4G byte by byte? :) |> 16:22 < mirrorbrain> ccccc: the author has, but there is a reason, which is related to fragmentation on the disk |> 16:22 < mirrorbrain> ccccc: it can be switched off though. But the default seems to better like that, in most cases
<snip>
|> 6:46 < iiiiiiiii> Usually, it takes me 2-3 days to get one. I am shocked I have it already. The US mirrors are the best ever. |> 16:46 < iiiiiiiii> thanks
<snip>
|> I just want to say... wow, the downloads seem to have gone off |> smoothly. I had no issues at all with downloading the 11.1 release. |> It came in very fast using the Metalink thing. I have to tip my hat |> to the infrastructure guys and say well done! |> C.
<snip>
In a Russian linux user forum, there was a poll for the used download method. (Small number of participants, around 30 or 40 I think.) Metalinks were the most frequently used download method there, a bit ahead of BitTorrent. http://linuxforum.ru/index.php?showtopic=82321 The page seems to be unavailable right now.
A user reporting success with aria2 used by the backend of the openSUSE download client, downloading packages: https://bugzilla.novell.com/show_bug.cgi?id=458897#c6 |> Hi Peter, |> |> I've just updated to openSuse 11.1, and neither of the Thai mirrors have |> mirrored the repos yet. So, I'll have to wait a bit before trying the |> experiments promised above. |> |> In the meantime, I can tell you that the prototype, using aria2 as a backend |> for zypper and yast2, certainly seems to solve this bug for openSuse 11.1. |> |> I got good, though not fantastic, speed and more importantly, no timeouts, from |> the kde4.2 unstable repo. |> |> I don't know which mirrors aria2 assigned for the kde4 unstable repo (roll on |> 11.2!) but I searched around manually for one, and couldn't find anything |> nearby. So without the aria2 backend, I would have been stuck with kde 4.1. |> |> I'm going to try using the email address you gave for KU to "encourage" them |> get the 11.1 repos mirrored. Do you happen to have an email address for |> mirror.in.th? I looked around the Burapha University site, but couldn't find |> anything specific. |> |> Thanks |> Ian
On Tue, 23 Dec 2008 19:09:23 +0100, "Peter Poeml" <po...@suse.de> said:
> |> 15:39 < ccccc> why stop when you can download even more
grin ! maybe ccccc want to create google competitor ?
> Isn't that great?
It wasn't a surprise for me ;) I confirm it is even mandatory in your case...
- metalink contain bittorrent link, - download peak is at the begin of publication (best moment for P2P echange ;) - download is popular, - use of mirrorbrain which force to use nearest servers,
... i was very afraid if you publish the inverse ;)
that is all great news. I think we're having an impact.
we have some really nice cooperation going between MirrorBrain + Metalink + aria2 & other metalink clients.
it's really nice w/ aria2 because it can share the files over bittorrent even if it's been a download from mirrors or mirrors+torrent. then we also have the signatures for openSUSE downloads included in the metalinks.
where do we go from here? :)
a late merry Christmas & happy holidays to everyone...
On Tue, Dec 23, 2008 at 1:09 PM, Peter Poeml <po...@suse.de> wrote: > Hi,
> last week, openSUSE 11.1 was released, shortly after I published > http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ > That posting really helped to get some users to try out a download by > metalink. And I read only very good feedback on mailing lists and IRC, > some of it I have collected here:
> I have collected some quotes from users from mailing lists and IRC:
> |> 15:38 < aa> downloading with aria2c for the first time > |> 15:38 < bbb> ccccc: but dddd wants us to hit the 200TB mark! :-) > |> 15:39 < dddd> hehe > |> 15:39 < bbb> and it just went down even further. It's crawling now. dddd, what have you done? > |> 15:39 < ccccc> bbb: download 2-3 DVDs! > |> 15:39 < ccccc> why stop when you can download even more
> <snip>
> |> 15:46 * aa downloads with area2c and reaches 1300kbit/s !!!! > |> 15:47 < dddd> aa: you have only a 10mbit line? :-) > |> 15:52 < ccccc> wow, aria2 is really able to saturate my line > |> 15:53 < ccccc> can it output more details where it downloads from? > |> 15:55 < ccccc> I don't understand its progress. It goes to 100% and then starts from scratch > |> 15:56 < eee> Im trying aria2 and it was quite useful > |> 15:56 < eee> I tried to ssh to another box and download with ftp, well, server is busy > |> 15:57 < eee> Connected to download.opensuse.org > |> 15:57 < eee> 500 This server is busy, please try again later or any of my mirrors :-) > |> 15:57 < bbb> I guess dddd beat his 200TB goal then :-) > |> 15:59 < ccccc> download.o.o doesn't look busy > |> 16:00 < eee> ccccc:did you try with ftp ? > |> 16:00 < ccccc> eee: you shouldn't, the ftp server always returns 500 > |> 16:00 < ccccc> you should use http
> <snip>
> |> 16:13 < ffffff> ok i bow my head in awe of aria2 450KiBs vs 56KiBs for straight http > |> 16:13 < ggggggg> people could also just use torrent > |> 16:14 < ccccc> ggggggg: they don't reach the bandwidth you get with akamai > |> 16:14 < ggggggg> ccccc: if nobody uses torrent we cant speed up of course. > |> 16:14 < ccccc> at least I have 180K with torrent and 570K with http > |> 16:15 < hhhhhhhh> too few high speed mirrors seeding :-) > |> 16:15 < ccccc> hhhhhhhh: too few seeders for too many leechers at least > |> 16:16 < hhhhhhhh> yup.. so remember to seed via bittorrent when y'all are done with your fancy speedy downloads ;-) > |> 16:16 < bbb> hhhhhhhh: do you get a commission for each seed? :-) > |> 16:19 < hhhhhhhh> I get closer to my goal of world domination with every completed download >:-) > |> 16:19 < mirrorbrain> ccccc: a very verbose log with -l aria2c.log > |> 16:19 < mirrorbrain> ccccc: its probably easier to see that it does with "netstat -tupa | grep aria" > |> 16:19 < mirrorbrain> ccccc: the first "count to 100%" is file allocation only > |> 16:21 < ccccc> mirrorbrain: the authors haven't heared of fseek and write the 4G byte by byte? :) > |> 16:22 < mirrorbrain> ccccc: the author has, but there is a reason, which is related to fragmentation on the disk > |> 16:22 < mirrorbrain> ccccc: it can be switched off though. But the default seems to better like that, in most cases
> <snip>
> |> 6:46 < iiiiiiiii> Usually, it takes me 2-3 days to get one. I am shocked I have it already. The US mirrors are the best ever. > |> 16:46 < iiiiiiiii> thanks
> <snip>
> |> I just want to say... wow, the downloads seem to have gone off > |> smoothly. I had no issues at all with downloading the 11.1 release. > |> It came in very fast using the Metalink thing. I have to tip my hat > |> to the infrastructure guys and say well done! > |> C.
> <snip>
> In a Russian linux user forum, there was a poll for the used download > method. (Small number of participants, around 30 or 40 I think.) > Metalinks were the most frequently used download method there, a bit > ahead of BitTorrent. > http://linuxforum.ru/index.php?showtopic=82321 > The page seems to be unavailable right now.
> A user reporting success with aria2 used by the backend of the openSUSE > download client, downloading packages: > https://bugzilla.novell.com/show_bug.cgi?id=458897#c6 > |> Hi Peter, > |> > |> I've just updated to openSuse 11.1, and neither of the Thai mirrors have > |> mirrored the repos yet. So, I'll have to wait a bit before trying the > |> experiments promised above. > |> > |> In the meantime, I can tell you that the prototype, using aria2 as a backend > |> for zypper and yast2, certainly seems to solve this bug for openSuse 11.1. > |> > |> I got good, though not fantastic, speed and more importantly, no timeouts, from > |> the kde4.2 unstable repo. > |> > |> I don't know which mirrors aria2 assigned for the kde4 unstable repo (roll on > |> 11.2!) but I searched around manually for one, and couldn't find anything > |> nearby. So without the aria2 backend, I would have been stuck with kde 4.1. > |> > |> I'm going to try using the email address you gave for KU to "encourage" them > |> get the 11.1 repos mirrored. Do you happen to have an email address for > |> mirror.in.th? I looked around the Burapha University site, but couldn't find > |> anything specific. > |> > |> Thanks > |> Ian
Including a link to BitTorrent file in metalink has another good
point: the piece hash of torrent file can be used for the data coming
from HTTP/FTP to validate them. It also makes metalink file small:)
On 12月29日, 午後12:42, "Anthony Bryan" <anthonybr...@gmail.com> wrote:
> that is all great news. I think we're having an impact.
> we have some really nice cooperation going between MirrorBrain +
> Metalink + aria2 & other metalink clients.
> it's really nice w/ aria2 because it can share the files over
> bittorrent even if it's been a download from mirrors or
> mirrors+torrent. then we also have the signatures for openSUSE
> downloads included in the metalinks.
> where do we go from here? :)
> a late merry Christmas & happy holidays to everyone...
> On Tue, Dec 23, 2008 at 1:09 PM, Peter Poeml <po...@suse.de> wrote:
> > Hi,
> > last week, openSUSE 11.1 was released, shortly after I published
> >http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ > > That posting really helped to get some users to try out a download by
> > metalink. And I read only very good feedback on mailing lists and IRC,
> > some of it I have collected here:
> > I have collected some quotes from users from mailing lists and IRC:
> > |> 15:38 < aa> downloading with aria2c for the first time
> > |> 15:38 < bbb> ccccc: but dddd wants us to hit the 200TB mark! :-)
> > |> 15:39 < dddd> hehe
> > |> 15:39 < bbb> and it just went down even further. It's crawling now. dddd, what have you done?
> > |> 15:39 < ccccc> bbb: download 2-3 DVDs!
> > |> 15:39 < ccccc> why stop when you can download even more
> > <snip>
> > |> 15:46 * aa downloads with area2c and reaches 1300kbit/s !!!!
> > |> 15:47 < dddd> aa: you have only a 10mbit line? :-)
> > |> 15:52 < ccccc> wow, aria2 is really able to saturate my line
> > |> 15:53 < ccccc> can it output more details where it downloads from?
> > |> 15:55 < ccccc> I don't understand its progress. It goes to 100% and then starts from scratch
> > |> 15:56 < eee> Im trying aria2 and it was quite useful
> > |> 15:56 < eee> I tried to ssh to another box and download with ftp, well, server is busy
> > |> 15:57 < eee> Connected to download.opensuse.org
> > |> 15:57 < eee> 500 This server is busy, please try again later or any of my mirrors :-)
> > |> 15:57 < bbb> I guess dddd beat his 200TB goal then :-)
> > |> 15:59 < ccccc> download.o.o doesn't look busy
> > |> 16:00 < eee> ccccc:did you try with ftp ?
> > |> 16:00 < ccccc> eee: you shouldn't, the ftp server always returns 500
> > |> 16:00 < ccccc> you should use http
> > <snip>
> > |> 16:13 < ffffff> ok i bow my head in awe of aria2 450KiBs vs 56KiBs for straight http
> > |> 16:13 < ggggggg> people could also just use torrent
> > |> 16:14 < ccccc> ggggggg: they don't reach the bandwidth you get with akamai
> > |> 16:14 < ggggggg> ccccc: if nobody uses torrent we cant speed up of course.
> > |> 16:14 < ccccc> at least I have 180K with torrent and 570K with http
> > |> 16:15 < hhhhhhhh> too few high speed mirrors seeding :-)
> > |> 16:15 < ccccc> hhhhhhhh: too few seeders for too many leechers at least
> > |> 16:16 < hhhhhhhh> yup.. so remember to seed via bittorrent when y'all are done with your fancy speedy downloads ;-)
> > |> 16:16 < bbb> hhhhhhhh: do you get a commission for each seed? :-)
> > |> 16:19 < hhhhhhhh> I get closer to my goal of world domination with every completed download >:-)
> > |> 16:19 < mirrorbrain> ccccc: a very verbose log with -l aria2c.log
> > |> 16:19 < mirrorbrain> ccccc: its probably easier to see that it does with "netstat -tupa | grep aria"
> > |> 16:19 < mirrorbrain> ccccc: the first "count to 100%" is file allocation only
> > |> 16:21 < ccccc> mirrorbrain: the authors haven't heared of fseek and write the 4G byte by byte? :)
> > |> 16:22 < mirrorbrain> ccccc: the author has, but there is a reason, which is related to fragmentation on the disk
> > |> 16:22 < mirrorbrain> ccccc: it can be switched off though. But the default seems to better like that, in most cases
> > <snip>
> > |> 6:46 < iiiiiiiii> Usually, it takes me 2-3 days to get one. I am shocked I have it already. The US mirrors are the best ever.
> > |> 16:46 < iiiiiiiii> thanks
> > <snip>
> > |> I just want to say... wow, the downloads seem to have gone off
> > |> smoothly. I had no issues at all with downloading the 11.1 release.
> > |> It came in very fast using the Metalink thing. I have to tip my hat
> > |> to the infrastructure guys and say well done!
> > |> C.
> > <snip>
> > In a Russian linux user forum, there was a poll for the used download
> > method. (Small number of participants, around 30 or 40 I think.)
> > Metalinks were the most frequently used download method there, a bit
> > ahead of BitTorrent.
> >http://linuxforum.ru/index.php?showtopic=82321 > > The page seems to be unavailable right now.
> > A user reporting success with aria2 used by the backend of the openSUSE
> > download client, downloading packages:
> >https://bugzilla.novell.com/show_bug.cgi?id=458897#c6 > > |> Hi Peter,
> > |>
> > |> I've just updated to openSuse 11.1, and neither of the Thai mirrors have
> > |> mirrored the repos yet. So, I'll have to wait a bit before trying the
> > |> experiments promised above.
> > |>
> > |> In the meantime, I can tell you that the prototype, using aria2 as a backend
> > |> for zypper and yast2, certainly seems to solve this bug for openSuse 11.1.
> > |>
> > |> I got good, though not fantastic, speed and more importantly, no timeouts, from
> > |> the kde4.2 unstable repo.
> > |>
> > |> I don't know which mirrors aria2 assigned for the kde4 unstable repo (roll on
> > |> 11.2!) but I searched around manually for one, and couldn't find anything
> > |> nearby. So without the aria2 backend, I would have been stuck with kde 4.1.
> > |>
> > |> I'm going to try using the email address you gave for KU to "encourage" them
> > |> get the 11.1 repos mirrored. Do you happen to have an email address for
> > |> mirror.in.th? I looked around the Burapha University site, but couldn't find
> > |> anything specific.
> > |>
> > |> Thanks
> > |> Ian
> > ...
> > Isn't that great?
> > Merry Christmas to everybody.
> > Peter
> > --
> > Contact: ad...@opensuse.org (a.k.a. ftpad...@suse.com)
> > #opensuse-mirrors on freenode.net
> > Info:http://en.opensuse.org/Mirror_Infrastructure
> > SUSE LINUX Products GmbH
> > Research & Development
> --
> (( Anthony Bryan ... Metalink [http://www.metalinker.org]
> )) Easier, More Reliable, Self Healing Downloads
|
