Tutorial on Nutch/StormCrawler/CloudSearch + webcast Nutch on EMR

212 views

Skip to first unread message

Julien Nioche

unread,

Sep 23, 2015, 1:44:06 PM9/23/15

to DigitalPebble

Hi guys,

Sorry for cross posting but just in case you did not see it, we published two resources today :

a webcast explaining how to run Nutch on AWS Elastic Map Reduce : https://www.youtube.com/watch?v=v9zjcTjjjyU
a tutorial on how to use Nutch (and StormCrawler) to crawl and index documents into AWS CloudSearch : http://digitalpebble.blogspot.co.uk/2015/09/index-web-with-aws-cloudsearch.html
The latter is related to the recent addition of NUTCH-1517 in the trunk codebase. The tutorial is aimed at beginners and gives step by step instructions on how to use Nutch, including in distributed mode. It should also be relevant for more advanced users as it provides an introduction to CloudSearch and a comparison between Nutch and StormCrawler.

Julien

Reply all

Reply to author

Forward

0 new messages