Example use cases for Pangool

14 views
Skip to first unread message

Pere Ferrera

unread,
Sep 19, 2012, 7:26:25 AM9/19/12
to pangoo...@googlegroups.com
I would like to recap some interesting use cases we have posted in Datasalt's blog for Pangool:

- Text classifier (http://www.datasalt.com/2012/04/building-a-parallel-text-classifier-in-hadoop-with-pangool/): In this use case we see how easy it is to implement a Bayes Text Classifier using Pangool's API. Even though we are building Map/Reduce blocks and using Java, the final code is concise enough to be easily understood and for that we are using several Pangool's core features which, in contrast to the native Hadoop Java API, allows us to achieve this goal much easily.

- Multi-SOLR Indexer (http://www.datasalt.com/2012/05/pangool-solr/): Leveraging some of Pangool's key features, we are able to program a single Map/Reduce job that is able to produce multiple SOLR indexes, something which is not currently possible in the standard Hadoop Java API.

In addition, the pangool-examples maven module provides more code examples that can be useful: https://github.com/datasalt/pangool/tree/master/examples/src/main/java/com/datasalt/pangool/examples

Also, remember we have a comprehensive user guide in pangool.net

Cheers,
Reply all
Reply to author
Forward
0 new messages