RHadoop - "there is no package called ‘rmr2’ !" how can this be ?

[Calcutta]

I am trying to run R programs using RHadoop using Ubuntu 14.04 / Hadoop 2.2.0 / R Studio 0.98.507 / R 3.0.2

individually both Hadoop (PIG, HIVE etc) and R are running fine.

I have installed and loaded packages rhdfs, rmr2, rhbase, plyr etc ...

Earlier, I was having a major problem with package "functional" until as advised I moved it from my local lib to the System library and this problem was resolved.

However my jobs are still failing  (now that I know about stderr, I looked there and found) ... "there is no package called rmr2" ... have attached the output of the errorlog

I thought that moving all these packages from local lib to system directory would help so 

1. started R in sudo mode  ( not R-Studio )

2. tried install.packages("rhdfs","/usr/lib/R/library","/user/hduser/Downloads/rhdfs_1.0.8.tar.gz") but this failed by saying that cannot access the gz files index

hence my rmr2, hdfs, hbase, plymr packages are still in my local lib ...

can anyone suggest what i can do next ? please help

[Antonio Piccolboni]

If I get this right this is an install packages issue instead of a specific rmr2 issue. Maybe the install packages manual or the r help mailing list will have better answers. I would first check the file is there and that it isn't corrupt.

--
post: rha...@googlegroups.com ||
unsubscribe: rhadoop+u...@googlegroups.com ||
web: https://groups.google.com/d/forum/rhadoop?hl=en-US
---
You received this message because you are subscribed to the Google Groups "RHadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Calcutta]

when i am installing from R-Studio, the install goes through without errors ... and hence i was pretty confident that the files were OK.

only when i came across your suggestion for package "functional" that had to be installed in "sudo R " mode did it occur to me that perhaps these packages should be in the System Library and not in the user library.

can you please confirm if these three packages can continue to be in the User Lib and need not be located in the system lib ?

in the meantime, i will download the three packages and try once again

thanks for responding

regards

[Antonio Piccolboni]

In theory any directory will do as long as r knows to go and look there and there aren't permission issues. In practice, we found that installing to a system directory is the simplest approach.

[Calcutta]

moved all the Rhadoop packages into the system library ... but unfortunately, the problem persists ...

wondering if this effort is worth the trouble since we are in anycase invoking Hadoop Streaming and I can do that easily with R programs without using RHadoop

anyway, shall keep trying

thanks for your help anyway

[Antonio Piccolboni]

If you don't understand the advantage of an abstraction layer over streaming, you absolutely should execute a project without rmr2. A user on this group reported redoing a multi month project involving r and Hadoop in a matter of days just adding rmr2 to the mix. There is nothing as effective as trying on your favorite problem.

Antonio