How to write a Map Reduce algorithm in python to perform sentiment analysis in NLTK ?

[PRAVEEN]

Hi All
I would like to perform Sentiment Analysis on large data set. How to write a Map Reduce program in python to perform sentiment analysis ? I am new to python.

Any help would be greatly appreciated !!!

Thanks
Praveen

[Nitin Madnani]

I had a talk on how to use MapReduce in Python at the Python Conference in 2010. Please see "The Elephant and The Python" on my web page (www.desilinguist.org) for an introductory take on using MapReduce for large scale text processing. 

- Nitin

--
You received this message because you are subscribed to the Google Groups "nltk-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nltk-dev+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[JAGANADH G]

Hi Praveen,

Which Python framework you are using to write the MR script ?

If your data is in HDFS and each dcoument is a single line it is a matter of writing a map only task.

If ypu could provide some more information like the Python fram work you are using that will be good.

Praveen

--

You received this message because you are subscribed to the Google Groups "nltk-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nltk-dev+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
**********************************
JAGANADH G
http://jaganadhg.in
ILUGCBE
http://ilugcbe.org.in

[PRAVEEN]

Thanks Jaganadh G & Nitin Madnani

@Jaganadh G... I am using Python 2.7, Hadoop 1.0.0 running on my Ubuntu 11.04. I am able to execute simple word count Map Reduce program written
python using Hadoop-Streaming jar. For basic sentiment analysis i have used the code present  here

Now i would like to write map reduce program for sentiment analysis.

Can you please help me.

[Anand Jeyahar]

Hi Praveen,

     This list is meant for discussing work on the nltk package itself..

Most questions here are focussed on contributions to nltk and changes to the backend and such.

Please direct your questions to the nltk-users mailing list instead.

Thanks and Regards,

Anand Jeyahar

==============================================
Anand Jeyahar

http://www.anandjeyahar.com
https://twitter.com/softwarmechanic

https://github.com/anandjeyahar

==============================================
The man who is really serious,
with the urge to find out what truth is,
has no style at all. He lives only in what is.
                  ~Bruce Lee

--