I think we do a pretty good job keeping track of what everyone is up
to on the 2 pages
http://groups.google.com/group/metalink-discussion/web/status-remaining-issues
http://www.metalinker.org/implementation.html
it's been kinda of hard to have a strategy before... but we have about
20 downloaders and 11 generators now.
FOCUS FOR NOW?
as Rene said, many sites won't be interested until there is Firefox
support. even Opera might not matter to some sites. I think these 2
apps should be our main goals. once they have support, a lot of sites
will be interested. I think we need to be organized in our approach,
and ALL work towards it. vote on the Firefox bug, maybe comment,
forums, follow Planet Mozilla & leave comments on developers blogs,
personally contact them, newsgroups: mozilla.dev.apps.firefox. follow
the Opera betas, post on their forums & blogs. one single thing may
not get them on board, but doing all these things will show there is
some interest from people besides just me. I have a few people from
each place I've been in contact w/, if anyone wants email addresses.
until then we're a niche technology (which isn't bad). we can focus on
what we do best. large downloads, verification, adding a bunch of
files to a queue. the tools you guys have built that make it
relatively easy for a project/company to start offering metalinks are
key. and there's still some download managers which strangely don't
support it yet!
WHAT'S COMING!!!
just today the SourceForge bug was updated: Assigned to: Service
Operations Group (sog)
https://sourceforge.net/tracker/?func=detail&atid=350001&aid=1687501&group_id=1
(whether that means we will see anything in 3 mos or 3 yrs...)
tomorrow: KGet 2.0, will be released as part of KDE 4.0.0. this has
been a long time coming, & I'm pretty excited. this means many Linux
distributions/desktops will have a metalink client installed by
default. no need to install one to try metalinks out. it'll be
available early for openSUSE, Arch, & Kubuntu but available for
Kubuntu 8.04 & Fedora 9 in april(?) & openSUSE 11 later.
screenshots...
http://picasaweb.google.com/mmauder/KDE400/photo#5152342481230625826
http://picasaweb.google.com/mmauder/KDE400/photo#5152342137633242066
soon:
DownThemAll 1.0 Firefox extension. this will make using metalinks a
whole lot easier to try out for many people.
Net Transport
VeryCD eMule client
Lailaps Download Manager
possibilities:
Rene's metalink lib ported to Ruby w/ Fred from Speed Download
Celerius: GTK python downloader. Aren, is this still planned for
release at some point?
Eclipse downloads? Bram offered a patch, but I don't think it's been used yet?
Fedora: It's been close to 3 months since I've heard from Ruben, but
he was going to update their mirror manager (python) to create
metalinks in time for a Fedora 9 release in april.
Ubuntu: https://bugs.launchpad.net/ubuntu-cdimage/+bug/140458/
Mandriva: the bug is now assigned & triaged...
http://qa.mandriva.com/show_bug.cgi?id=31463
Bouncer: if they got interested in metalinks, they could just use Bram's patch.
wget 2.0
ReGet 5.3
(oblique strategies were a set of cards w/ odd phrases to help
jumpstart things when stuck...Go slowly all the way round the outside,
Honor thy error as a hidden intention, Look closely at the most
embarrassing details and amplify them)
--
(( Anthony Bryan ... Metalink [ http://www.metalinker.org ]
)) Easier, More Reliable, Self Healing Downloads
Aren Olson
[1] - http://celerius.tuxfamily.org/roadmap
--
"Whoever said sunshine brings happiness has never danced in the rain."
- K. Jackson
Ubuntu Linux - www.ubuntu.com
very nice!
> > Fedora: It's been close to 3 months since I've heard from Ruben, but
> > he was going to update their mirror manager (python) to create
> > metalinks in time for a Fedora 9 release in april.
>
> Do you have an URL where I can look at the Python code?
> I would be glad to help.
that would be great! the Fedora people seem too overworked to add it
on their own but more than willing to accept submissions. looking at
the HelpWanted page, they still have "add metalink pages" listed.
https://hosted.fedoraproject.org/mirrormanager has all the info. the
code's in a git repository. Matt Domsch is the guy to contact, I don't
know if some code has already been submitted besides the initial patch
(which I don't think was used). the discussion was in June? on
fedora-devel & -infrastructure lists (I can forward all the info I
have if you want). scanning the infrastructure list, it looks like
there are some opportunities for metalink there. they're going to try
out some limited jigdo stuff for Fedora 9 respins.
KDE 4.0.0 is out! http://www.kde.org/announcements/4.0/
it looks great! not perfect, but a really good beginning. I think KGet
in KDE 4.1 will have even more metalink features.
also, Net Transports w/ piece checksums should be out in the next few days.
http://www.xi-soft.com/download.htm
Develop History
Net Transport 2.54 (Jan 12, 2008)
1. Added Metalink Specification (www.metalinker.org), supported
verifying SHA-1, MD5, MD4 checksums. Please click URL right "..."
button to choose ".metalink" extension to select metalink file in the
task dialog; or download .metalink URL directly.
or in Chinese, if you prefer :)
Net Transport 2.54 (2008.01.12)
1、支持Metalink规范 (www.metalinker.org),支持SHA-1、MD5、MD4校验。请通过任务窗口的URL字段右边的"..."按钮选择文件类型为".metalink"来选择;或直接下载.metalink的链接。
thanks for the update!
I stopped by but forgot to prod...looks like I didn't need to.
can code be shared between Celerius & metalink checker? I guess the
goals are different but it seems like there will be feature overlap &
they are both written in Python. are they drastically different?
how would one go about trying Celerius out, or is that not possible
yet? I've got it downloaded.
revno: 18
committer: Aren Olson <reacocard@noslor>
branch nick: celerius
timestamp: Wed 2008-01-16 19:20:56 -0600
message:
lots of fixes, lots of improvements. Perhaps I'll have a basic text-based
downloader ready soon!
modified:
celerius/backend/download/download.py
celerius/backend/download/http.py
revno: 17
committer: Aren Olson <reacocard@noslor>
branch nick: celerius
timestamp: Fri 2008-01-11 21:34:00 -0600
message:
- cleaned up magic number mess in download.py
- improved the basic downloader somewhat, it should now be able to
downloadhttp urls, either fed in raw or within a metalink
modified:
celerius/backend/download/common.py
celerius/backend/download/download.py
celerius/backend/download/http.py
Aren
--
what do you looking for ?
- some bad metalink with a lot of bad fields which can freeze core
software (size field wroten twice, filesize more than 1E30 Go, )?
- some bad metalink with some well known "cosmetic" errors (bad filename
or size, no mirrors available, only a torrent...) ?
it is not the same thing ! ;)
--
I just saw this post by Ash_Rulez on the FlashGot forum:
"I want to convert download URLs automatically to Metalink files with
the help of the Metalink Library, which usually just works fine.
But with Flashgot 0.8.8 (WinXP 32 SP2, Firefox 3.0b4) the [URL]
parameter for a batch file will be cut after an equal sign (=).
In contrary the [UFILE] file contains the full URL.
[URL] http://www.eclipse.org/downloads/download.php?file
[UFILE] contains
http://www.eclipse.org/downloads/download.php?file=/tools/cdt/releases/europa/dist/cdt-master-4.0.3.zip
...
Thanks to Flashgot 0.8.9.1, my case works perfectly now (Aria2 +
Metalink Library = automatic cross-platform BitTorrent and Metalink
generation)."
- Tidy up www.metalinker.org & lay things out better.
- Need C/C++ developers to work on & submit patches for wget, curl,
Google Chrome, & Firefox. Also, chunk checksums in DownThemAll!
see http://groups.google.com/group/metalink-discussion/web/gsoc08-ideas
- Focus on web servers & maybe investigate proxies.
maybe just a short description of how to setup apache for just serving
static metalinks with transparent content negotiation.
for proxies, any files cached would be seen as different because they
were accessed from a diff uri or if segmented downloads were used.
- Continue refining Internet Draft with IETF
- Presentations at conferences, meetups, user groups
- More articles, podcasts, videos, screencasts describing metalink
- Join with a non profit group like Software Freedom Conservancy or
Open Web Foundation?
- Search for funding like the Knight News Challenge
http://www.newschallenge.org/ or http://www.grants.gov/
- Continue applying for programs like Sun's Community Innovation
Program & Google Summer of Code
- Packaging for distributions. libmetalink, metalink checker, gget, etc
here's my application for the Knight News Challenge
Great!
I am writing on a comment.
Unfortunately, I wrote 1853 characters but it turns out that 1000
comments is the maximum.
(So now I'm working on shortening it ;)
Peter
--
Contact: ad...@opensuse.org (a.k.a. ftpa...@suse.com)
#opensuse-mirrors on freenode.net
Info: http://en.opensuse.org/Mirror_Infrastructure
SUSE LINUX Products GmbH
Research & Development
both apps maintainer's are waiting for patches to add metalink
support. I've been meaning to post about curl.
Daniel, the curl author, has blogged about it & generously put up $200
towards a feature bounty (along w/ $300 from us, for a total of $500).
Daniel Stenberg writes:
"A metalink file transfer library could be made as a layer on top of
libcurl, and I think that is the only logical and sensible way.
Adding metalink support to the curl tool however, seems like a good idea to me…"
Requirements: (1) Single source (ie not multi-source) downloads from a
single URL at a time. (2) Failover to other URLs listed in a Metalink
if the current URL is unavailable.
(3) Use chunk checksums and full file checksums so downloads retain
integrity. (4) Code to curl's coding standards for quality and
formatting so it can be incorporated into the curl sources.
http://groups.google.com/group/metalink-discussion/web/gsoc08-ideas
> If someone wants to download metalinks from scripts, using a command
> line tool with a nice interface... there is aria2.
true, and we love it!
great comment, thank you so much Peter!
if anyone's curious about the $ amount, it's what my mentor for the
program told me to put. it's how much he received to do a website for
the 2014 winter olympics.
http://www.newschallenge.org/sochi_olympics_project
Metalink technology should indeed be presented at conferences.
I think that academic world is especially grateful for "real-world"
papers with practical relevance and pragmatism, because there is a lack
thereof.
Below is a list of possible targets I found.
International World Wide Web Conference
http://www.iw3c2.org/
Next one is in March 09, Madrid, Spain.
The proceedings of this year are here:
http://www2008.org/papers/Proceedings.html
NSDI - USENIX Symposium on Networked Systems Design and Implementation
http://www.usenix.org/events/nsdi09/
Next one is in April 09, Boston, MA.
Past conferences: http://www.usenix.org/event/byname/nsdi.html
Proceedings of this year: http://www.usenix.org/events/nsdi08/tech/
IPTPS - International Workshop on Peer-to-Peer Systems
http://www.usenix.org/events/iptps09/
April 09, Boston, MA (is held mmediately before NSDI'09)
Past Proceedings: http://iptps.org/
ACM symposium on Applied computing
http://www.acm.org/conferences/sac/
Next one: March 09, Honolulu, Hawaii
http://www.acm.org/conferences/sac/sac2009/
Past proceedings via ACM library:
http://portal.acm.org/toc.cfm?id=1066677&type=proceeding&coll=ACM&dl=ACM&CFID=7148331&CFTOKEN=72614786
http://portal.acm.org/toc.cfm?id=SERIES179&type=series&coll=ACM&dl=ACM&CFID=7148331&CFTOKEN=72614786
Hmmm, funny you should mention that one. A co-worker of mine just told
me that he is presenting there. I'm going to try and see if I can go as
part of my work duties and get them to cover the cost, so I could also
present Metalink while I'm there.
The bad news, looks like its too late for submissions for most of the
tracks.
Neil
this would be great! a few years ago, I always sent in papers on
metalink but never got accepted.
hopefully now, we have enough experience and "proof" that it's useful.
while we can't afford to pay for people to attend these, we might be
able to help out a little bit. & if the funding situation changes,
this is one of the things I think needs to be paid for to help get
academia involved.
> International World Wide Web Conference
> http://www.iw3c2.org/
> Next one is in March 09, Madrid, Spain.
> The proceedings of this year are here:
> http://www2008.org/papers/Proceedings.html
>
>
> NSDI - USENIX Symposium on Networked Systems Design and Implementation
> http://www.usenix.org/events/nsdi09/
> Next one is in April 09, Boston, MA.
> Past conferences: http://www.usenix.org/event/byname/nsdi.html
> Proceedings of this year: http://www.usenix.org/events/nsdi08/tech/
>
>
> IPTPS - International Workshop on Peer-to-Peer Systems
> http://www.usenix.org/events/iptps09/
> April 09, Boston, MA (is held mmediately before NSDI'09)
> Past Proceedings: http://iptps.org/
>
>
> ACM symposium on Applied computing
> http://www.acm.org/conferences/sac/
> Next one: March 09, Honolulu, Hawaii
> http://www.acm.org/conferences/sac/sac2009/
> Past proceedings via ACM library:
> http://portal.acm.org/toc.cfm?id=1066677&type=proceeding&coll=ACM&dl=ACM&CFID=7148331&CFTOKEN=72614786
> http://portal.acm.org/toc.cfm?id=SERIES179&type=series&coll=ACM&dl=ACM&CFID=7148331&CFTOKEN=72614786
--
I have held a talk on metalinks a while ago on FOSDEM [1] and I enjoyed
that allot (they even gave me a box of chocolates!) and Anthony was even
willing to help out with the traveling costs!
Anybody who has the chance to do anything like this: go for it. It was
allot of fun and I saw allot of cool things.
If anybody finds information on a conference that might be willing to
accept a talk about metalinks, post it on the list ;)
Bram
[1] http://ftp.belnet.be/mirrors/FOSDEM/2007/Lightning_Talks/
FOSDEM 09 is coming up in Feb, as is BarCamp/Future of Web Apps Miami.
I should also look at those conferences in Boston that Peter
mentioned...
anyone want to co-author a paper? :)
--
thanks to everyone for their help w/ the Knight challenge! we didn't
get it, the application wasn't specific enough to a geographic
location.
on to other opportunities...
SourceForge doesn't use metalinks yet!
https://sourceforge.net/tracker2/index.php?func=detail&aid=1687501&group_id=1&atid=350001
I still have occasional problems downloading when their mirrors
haven't synced...
One Laptop Per Child. what a cool thing! OLPC system images are quite
large, ISO sized sometimes, & probably downloaded by people w/ awful
internet connections. Python is a main part of their system. maybe a
chance to integrate metalink-checker for system update downloads?
http://wiki.laptop.org/go/Builds#Stable_builds
launchpad.net, Canonical's webapp for bugs, translations, etc.
launchpad is closed source for now, so we can't submit patches, but in
the future will be open. or we could get someone sympathetic on the
inside.
see this download page https://launchpad.net/bzr/+download w/ md5 &
signatures. could be really slick!
Not to mention children would be confused if shown a list of mirrors and
instructions on how to manually check md5s! Yet they could get the same
functionality with the same usability as a single-mirror link with
metalink :)
Thanks for the reminder.
>
> 10 days until the deadline to give 15 min lightning talks. anyone want
> to go? :) it sounds like a cool experience & we'll help out w/ the
> traveling costs again.
>
> 2008-12-26: Deadline for lightning talk requests
>
> http://www.fosdem.org/2009/call_for_lightningtalks
Fosdem would be a nice opportunity to meet also! I'll be there.
so if anyone feels like giving a presentation, on metalink or anything
else, go for it!
>> --~--~---------~--~----~------------~-------~--~----~
>> You received this message because you are subscribed to the Google Groups "Metalink Discussion" group.
>> To post to this group, send email to metalink-...@googlegroups.com
>> To unsubscribe from this group, send email to metalink-discus...@googlegroups.com
>> For more options, visit this group at http://groups.google.com/group/metalink-discussion?hl=en
>> -~----------~----~----~----~------~----~------~--~---