Upgraded to rmr 2.3.0 and from.dfs stopped working

75 views
Skip to first unread message

Martin Eggenberger

unread,
Sep 17, 2014, 4:42:57 PM9/17/14
to rha...@googlegroups.com
I recently upgraded to rmr 2.3.0 and from.dfs is not working.

> from.dfs( to.dfs( c(1:100) ) )
Error in if (file.exists(cmd)) return(cmd) : argument is of length zero
14/09/17 16:42:00 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/09/17 16:42:00 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
14/09/17 16:42:00 INFO compress.CodecPool: Got brand-new compressor
Error in if (file.exists(cmd)) return(cmd) : argument is of length zero

Anything I am missing here?

Antonio Piccolboni

unread,
Sep 17, 2014, 4:56:10 PM9/17/14
to RHadoop Google Group
Do you mean 3.2.0? If I am correct that's a known bug with workaround and fix which I will explain, if not we need to figure out why you are not running what you think you are running, as that line that fails did not exist before 3.2.0 as far as I can tell



Antonio

--
post: rha...@googlegroups.com ||
unsubscribe: rhadoop+u...@googlegroups.com ||
web: https://groups.google.com/d/forum/rhadoop?hl=en-US
---
You received this message because you are subscribed to the Google Groups "RHadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Martin Eggenberger

unread,
Sep 17, 2014, 5:37:37 PM9/17/14
to rha...@googlegroups.com, ant...@piccolboni.info
Sorry I mistyped the version is  3.2.0. Do we have a quick fix for this?

Antonio Piccolboni

unread,
Sep 17, 2014, 5:44:29 PM9/17/14
to RHadoop Google Group
Yep, set the env variable HDFS_CMD to output of which hdfs or equivalent. I tried to add a heuristic so that people don't have to do that as often, and I didn't code defensively. Will be fixed in next hotfix.



Antonio
Reply all
Reply to author
Forward
0 new messages