High scalability interviews me about Peregrine.

13 views
Skip to first unread message

burtonator

unread,
Jan 12, 2012, 1:34:53 PM1/12/12
to peregrine...@googlegroups.com

http://highscalability.com/blog/2012/1/12/peregrine-a-map-reduce-framework-for-iterative-and-pipelined.html

"The Peregrine falcon is a bird of prey, famous for its high speed diving attacks, feeding primarily on much slower Hadoops. Wait, sorry, it is Kevin Burton of Spinn3r's new Peregrine project--new FAST modern map reduce framework optimized for iterative and pipelined map reduce jobs--that feeds on Hadoops.

If you don't know Kevin, he does a lot of excellent technical work that he's kind enough to share it onhis blog. Only he hasn't been blogging much lately, he's been heads down working on Peregrine. Now that Peregrine has been released, here's a short email interview with Kevin on why you might want to take up falconry, the ancient sport of MapReduce."

Roland Gude

unread,
Jan 12, 2012, 6:05:22 PM1/12/12
to peregrine...@googlegroups.com
Nice interview. Thanks for sharing

BTW. K-means is on my Agenda as well.

Kevin Burton

unread,
Jan 13, 2012, 3:00:25 PM1/13/12
to peregrine...@googlegroups.com
Sweet… I'm actually working on an implementation here soon.. 

I want to finish up the page rank one as it's 99% complete.

I think that having Cassandra support AND page rank could be a way to get more people using us.

If we just have a collection of stock algorithms out of the box, and people can tie them into their existing infrastructure, I think it will help overcome switching costs to trying something new.

Kevin


On Thu, Jan 12, 2012 at 3:05 PM, Roland Gude <r...@ndgu.de> wrote:
Nice interview. Thanks for sharing

BTW. K-means is on my Agenda as well.



--
--

Founder/CEO Spinn3r.com

Location: San Francisco, CA
Skype: burtonator

Skype-in: (415) 871-0687


Reply all
Reply to author
Forward
0 new messages