Hadoop 1.0.2 and the patches

[Piers Harding]

Hi -

With the release of 1.0.2 (http://hadoop.apache.org/common/docs/r1.0.2/
releasenotes.html), should we be able to do away with the patching
normally required for the installation?

Cheers,
Piers Harding.

[Piers Harding]

In answer to my own question - it looks like it just works! Only
problem I had was that the streaming jar is not found with the deb
packages from http://ftp.wayne.edu/apache/hadoop/common/hadoop-1.0.2/.
The hadoop root directory is /usr but the streaming lib is in /usr/
share/hadoop/contrib/streaming - hacked:
+++ b/dumbo/util.py
@@ -267,6 +267,7 @@ def findjar(hadoop, name):
hadoop home directory and component base name (e.g
'streaming')"""

jardir_candidates = filter(os.path.exists, [
+ os.path.join(hadoop, 'share', 'hadoop', 'contrib', name),

Cheers,
Piers Harding.

[Klaas Bosteels]

Yup, patch-wise everything should be ok out of the box from 1.0.2
onwards as far as I know...

-Klaas

> --
> You received this message because you are subscribed to the Google Groups "dumbo-user" group.
> To post to this group, send email to dumbo...@googlegroups.com.
> To unsubscribe from this group, send email to dumbo-user+...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/dumbo-user?hl=en.
>

[Hari]

Hi Piers,

I am using hadoop-1.0.4 but still getting the error Streaming jar not found when trying to use dumbo. I used the command 

$dumbo start wordcount.py -hadoop /usr/local/hadoop-1.0.4/bin/hadoop -input excludes.txt -output out.txt

After reading this post I also modified the file dumbo/util.py to include os.path.join(hadoop, 'share', 'hadoop', 'contrib', name). Even after that I am getting the same error...

Any suggestions?

Thanks in Advance

-Hari