Dumbo on OS X

[Ryan]

Hi,

Has anyone successfully installed dumbo on OS X?

I installed dumbo via easy_install to a subdirectory of my home
folder. I also downloaded hadoop 0.20 and extracted the .tgz to my
home folder.

The problem is that when I try to run something like
dumbo start wordcount.py -input brian.txt -output output/
I get errors:
Ryans-MacBook:examples ryan$ dumbo start wordcount.py -input brian.txt
-output .EXEC: PYTHONPATH="/Users/ryan/Library/Python/2.5/site-
packages/dumbo-0.21.21-py2.5.egg:$PYTHONPATH" python -m dumbo.cmd
encodepipe -file brian.txt | PYTHONPATH="/Users/ryan/Library/Python/
2.5/site-packages/dumbo-0.21.21-py2.5.egg:$PYTHONPATH" python -m
wordcount map 0 262144000 | LC_ALL=C sort | PYTHONPATH="/Users/ryan/
Library/Python/2.5/site-packages/dumbo-0.21.21-py2.5.egg:$PYTHONPATH"
python -m wordcount red 0 262144000 > '.'
/bin/sh: .: Is a directory
INFO: buffersize = 168960
sort: fflush failed: standard output: Broken pipe
sort: write error

Trying to run oowordcount.py is worse:
EXEC: PYTHONPATH="/Users/ryan/Library/Python/2.5/site-packages/
dumbo-0.21.21-py2.5.egg:$PYTHONPATH" python -m dumbo.cmd encodepipe -
file brian.txt | PYTHONPATH="/Users/ryan/Library/Python/2.5/site-
packages/dumbo-0.21.21-py2.5.egg:$PYTHONPATH" python -m oowordcount
map 0 262144000 | LC_ALL=C sort | PYTHONPATH="/Users/ryan/Library/
Python/2.5/site-packages/dumbo-0.21.21-py2.5.egg:$PYTHONPATH" python -
m oowordcount red 0 262144000 > 'output/'
/bin/sh: output/: Is a directory
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/5.1.1/lib/
python2.5/runpy.py", line 95, in run_module
filename, loader, alter_sys)
File "/Library/Frameworks/Python.framework/Versions/5.1.1/lib/
python2.5/runpy.py", line 52, in _run_module_code
mod_name, mod_fname, mod_loader)
File "/Library/Frameworks/Python.framework/Versions/5.1.1/lib/
python2.5/runpy.py", line 32, in _run_code
exec code in run_globals
File "/Users/ryan/Dev/dumbo/examples/oowordcount.py", line 26, in
<module>
dumbo.main(runner,starter)
File "build/bdist.macosx-10.4-i386/egg/dumbo/core.py", line 504, in
main
File "build/bdist.macosx-10.4-i386/egg/dumbo/core.py", line 40, in
run
File "build/bdist.macosx-10.4-i386/egg/dumbo/core.py", line 532, in
run
File "/Users/ryan/Dev/dumbo/examples/oowordcount.py", line 7, in
__init__
file = open(self.params["excludes"],"r")
TypeError: coercing to Unicode: need string or buffer, NoneType found


Any ideas?

Thanks,
Ryan

[Zak Stone]

Try removing the slash from the end of 'output/' -- dumbo might be
expecting an output file name and not know what to do with a
directory.

Zak