using isilon as HDFS

[Nathan Earixson]

I was unable to get the compute-only cluster to deploy using our Isilon cluster as the HDFS.

I edited the compute_only_cluster.json. The pertinent line:
      "externalHDFS": "hdfs://xxx.xxx.xxx.xxx:8020"

(xxx.xxx.xxx.xxx is the IP of the Isilon cluster) Then I deployed the cluster using this new spec file.

The cluster created succesfully but was not using the HDFS from the Islon. I was able to go onto the client and edit the core-site.xml to use the Isilon and after restarting hadoop it's working fine.

Any other experiences with deploying the compute-only clusters using Isilon or other existing HDFS?

thanks,
-n

[jun wang]

Please first check in cli cluster creation command, did you use --specFile or --specfile? --specFile is correct one, while --specfile will ignore your specFile and created a default cluster(this is a bug from spring shell).

Thanks,
Jun

---

Date: Wed, 19 Jun 2013 14:50:49 -0700
From: eari...@gmail.com
To: serenge...@googlegroups.com
Subject: using isilon as HDFS

--
 
---
You received this message because you are subscribed to the Google Groups "serengeti-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to serengeti-use...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Nathan Earixson]

That was exactly it: I typoed the case on the specFile option.

thanks!

-n

[ssh...@gopivotal.com]

once you update the core-site.xml file with hdfs entry as you indicate below and installed the bits on the computes you should be all set. Test with hdfs fs commands and it will work