Twister - Iterative mapreduce

10 views
Skip to first unread message

Tom Chikoore

unread,
Mar 17, 2010, 8:16:03 AM3/17/10
to Boulder Hadoopers
I find Twister very interesting. Our challenge in using Map-Reduce has
been its not fast enough for the type for computations that we want to
use it for. I am finding Twister promising, given this description
"Twister allows MapReduce to achieve higher performance, perform
faster data transfers, and reduce the time it takes to process vast
sets of data for data mining and machine learning applications.". More
info is here http://www.iterativemapreduce.org/ and I cant wait to try
it. Is anyone on this group using Twister and or had played around
with it?

Tom

Jud

unread,
Mar 18, 2010, 9:02:15 AM3/18/10
to Boulder Hadoopers
Interesting. This has been a concern of mine. I'd love to hear more
about your setup And use. While the parallel processing power is
clear, the latencies feel prohibitive for apps that need to be fast.

Jud

On Mar 17, 6:16 am, Tom Chikoore <t...@tomchikoore.com> wrote:
> I find Twister very interesting. Our challenge in using Map-Reduce has
> been its not fast enough for the type for computations that we want to
> use it for. I am finding Twister promising, given this description
> "Twister allows MapReduce to achieve higher performance, perform
> faster data transfers, and reduce the time it takes to process vast
> sets of data for data mining and machine learning applications.". More

> info is herehttp://www.iterativemapreduce.org/and I cant wait to try

Reply all
Reply to author
Forward
0 new messages