Thanks guys!
Yours,
Tom
With the sudden influx of mirrors, what's the expected bandwidth
these days? I might be able to offer up another mirror if it's down
to not insane levels.
It's up to about 225 GB per month overall, so perhaps 50 GB per mirror.
But Dennis Oeklers kindly volunteered to shoulder half the load himself
on http://lauschmusik.de/ , so that cuts the bandwidth usage for the
other mirrors to perhaps 30 GB per month.
Yours,
Tom
Sam
And, in broad strokes, what is the bandwidth committment to being a mirror?
Kirk Haines
Procedurally, just send me or Rich Kilmer an email and we can work out
the details. Technically, you just need to be able to rsync down about
1.1 GB of data to a host somewhere (rubyforge.yourdomain.org or
whatever) and then be able handle to handle the bandwidth load...
Yours,
Tom
Right now it's about 30 GB per month.
Yours,
Tom
As the first mirror, I had committed to about 50Gb bandwidth out of my
available 100Gb. The 50Gb was blown in the first month (thanks, Curt!
-- it was because of Curt's RoR article) but settled down after that
with the addition of Dennis Oelkers's mirror. By time the fourth and
fifth mirrors were announced, I was at about 70Gb again (which wasn't
a problem; the machine isn't used for much else right now), so I
expect to go below 30Gb per month *for now*, as Dennis is soaking up
50% of the total bandwidth and the other four mirrors are handling the
50% that's left. I wouldn't be surprised if the next move is about 35%
Dennis, 35% Robby, and 30% the rest of us, because Robby has bandwidth
to spare for RubyForge, too.
The commitment is likely to be about 30Gb initially.
-austin
--
Austin Ziegler * halos...@gmail.com
* Alternate: aus...@halostatue.ca
FYI... dare I say it... I blogged on the RubyForge mirror setup here:
http://tomcopeland.blogs.com/juniordeveloper/2005/09/sharing_the_rub.html
Yours,
Tom
>FYI... dare I say it... I blogged on the RubyForge mirror setup here:
>
>http://tomcopeland.blogs.com/juniordeveloper/2005/09/sharing_the_rub.html
>
>
"Sharing the rub." Hehe. Dirty.
Devin
Cheers,
Han Holl
On 9/27/05, Tom Copeland <t...@infoether.com> wrote:
>
>
> http://tomcopeland.blogs.com/juniordeveloper/2005/09/sharing_the_rub.html
>
> Yours,
>
> Tom
>
>
>
>
Well, honestly, BitTorrent requires that there be continuous interest in
the files being torrented. Unless the files are well seeded and/or
downloaded often, BitTorrent downloads will often be much slower than
simple FTP downloads with round-robin mirrors as have been set up for
RubyForge.
There is, by the way, exactly one file that would even remotely qualify
for BitTorrenting based on the popularity profile -- ruby182-15.exe.
Heh, you know, I saw that and almost renamed the post... but then
laziness took over...
Tom
Yup, we hosted some large files on BT for a bit... but the torrents
really didn't get used much. Also, our tracker got hijacked (due to a
misconfiguration, my fault) which kind of left me with a bad taste for
the whole thing.
Yours,
Tom
Yup, and even that one didn't get downloaded via BT much; folks still
just went to the file releases page.
Yours,
Tom
Han Holl wrote:
>Apparently there is more overhead in the bittorrent protocol than I thought.
The problem as I understand it is that bittorrent is really best for
distributing
small numbers of large files. A single tracker can coordinate things for
lots of
files, but as far as actual seeding goes (the act most analagous to a system
providing an ftp download), it's unusual for more than a few files to be seeded
at a time. (The original bt client, I believe, would only allow three
instances to
be open at a time.) This works well enough for, say, having downloads of linux
cd images. (Which is how I got mine the last time I tried doing anything with
it.) Not so good for something like rubyforge, where you have a very large
number
of small files - you could make a torrent of the entire thing maybe, which
would
be useful to almost no one...
I've thought off and on about a system that could deal with this sort thing
better.
Something with the file verification systems like bittorrent (both to
protect against
ordinary data corruption and malicious file modifications), that allowed
passively
seeding files - if someone wants it, it's available, but if not, resources
aren't
wasted on it. Also less dependence on a single central server, since running a
high-usage bt tracker seems to be very hard on a system. Throw in some
public/private key to allow validation of <whatever file replaces .torrent>
files
that were acquired through an untrusted source...
Mostly there's three things that have kept me from actually trying to make
this.
1. I don't know enough about ruby (particularly thread handling) to make it
work.
2. I don't know enough about designing network protocols to make it work.
3. I doubt my ability to convince enough other people to use it to make it
worthwhile.
-Morgan, hates seeing "seeds: 0"...
--
No virus found in this outgoing message.
Checked by AVG Anti-Virus.
Version: 7.0.344 / Virus Database: 267.11.14/128 - Release Date: 10/10/2005