rhbase installation problem on yosemite

[Ahmed Nagi]

Hello

I have managed to install successfully rmr2 and rhdfs packages on yosemite; however i am having trouble with rhbase package.

I have all the java process running jps returns:

15489 SecondaryNameNode

15634 ResourceManager

17620 Jps

17509 HRegionServer

15734 NodeManager

17351 HQuorumPeer

17576 ThriftServer

15369 DataNode

17403 HMaster

15276 NameNode

I have the hadoop enviroment set in R

Sys.setenv("HADOOP_CMD"="/usr/local/Cellar/hadoop/2.5.2/bin/hadoop")

Sys.setenv("HADOOP_STREAMING"="/usr/local/Cellar/hadoop/2.5.2/libexec/share/hadoop/tools/lib/hadoop-streaming-2.5.2.jar")

and I have thrift 0.9.0 as instructed here. But when i try to install the package with:

install.packages("~/Documents/R_WorkSpaces/RHadoop/rhbase_1.2.1.tar.gz", repo = NULL, type = "source", lib = "/Library/Frameworks/R.framework/Versions/3.1/Resources/library")

i get a lots of warnings and the following error msg:

 10 warnings generated.

clang++ -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup -single_module -multiply_defined suppress -L/Library/Frameworks/R.framework/Resources/lib -L/usr/local/lib -o rhbase.so Hbase.o Hbase_constants.o Hbase_types.o tools.o -L/usr/local/lib -lthrift -F/Library/Frameworks/R.framework/.. -framework R -Wl,-framework -Wl,CoreFoundation

installing to /Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase/libs

** R

** inst

** preparing package for lazy loading

** help

*** installing help indices

** building package indices

** testing if installed package can be loaded

Error in dyn.load(file, DLLpath = DLLpath, ...) : 

  unable to load shared object '/Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase/libs/rhbase.so':

  dlopen(/Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase/libs/rhbase.so, 6): Symbol not found: __ZN6apache6thrift9transport7TSocketC1ENSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEEi

  Referenced from: /Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase/libs/rhbase.so

  Expected in: flat namespace

 in /Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase/libs/rhbase.so

Error: loading failed

Execution halted

ERROR: loading failed

* removing ‘/Library/Frameworks/R.framework/Versions/3.1/Resources/library/rhbase’

Does anyone knows how to fix this error?

Thank you in advance.

PS. Session info is:

R version 3.1.2 (2014-10-31)

Platform: x86_64-apple-darwin13.4.0 (64-bit)

locale:

[1] en_CA.UTF-8/en_CA.UTF-8/en_CA.UTF-8/C/en_CA.UTF-8/en_CA.UTF-8

attached base packages:

[1] stats     graphics  grDevices utils     datasets  methods   base     

 

[David Champagne]

When you say you installed thrift, did you follow the instructions on this page:  https://github.com/RevolutionAnalytics/RHadoop/wiki/user%3Erhbase%3EHome

Revolution R Plus

Subscribe to Technical Support & Indemnification for R

[Ahmed Nagi]

Hi David

Thanks for getting back to me on this issue. Yes, to the best of my knowledge (considering that the list of pre-requisites for Thrift are for CentOS)

To install thirft on osx: i first configured with:

• ./configure --prefix=/usr/local --without-ruby
  
• make
  
• sudo make install
  
• sudo cp /usr/local/lib/libthrift-0.9.0.dylib /usr/lib/

To configure the PKG_CONFIG:

•  export PKG_CONFIG_PATH=$PKG_CONFIG_PATH:/usr/local/lib/pkgconfig/

 And to start the thrift server, I used the following command:

• ./bin/hbase-daemon.sh start thrift
  

as described in the HBase documentation.

Have I missed something from the installation instruction? 

Thanks in advance for your help

[David Champagne]

Hi Ahmed

Did you copy or create a symbolic link to the libthrift-0.9.0.so file in /usr/lib or /usr/lib64 ?

On Thursday, November 27, 2014 12:06:53 PM UTC-8, Ahmed Nagi wrote:

[Ahmed Nagi]

I copied the .dylib file (since there was no .so file) to the /usr/lib as:

• sudo cp /usr/local/lib/libthrift-0.9.0.dylib /usr/lib/

not to usr/lib64. 

Should it be copied to lib64 folder (and not /usr/lib as instructed in the hbase home site)?

Update: i don't see any lib64 folder. Does it exist on osx?