IPC version error

[David Rosenstrauch]

Trying to get Tachyon (0.4.1) up and running for the first time.

I'm calling "tachyon format", with an underfs pointing to HDFS (running
Hadoop 2.3.0). However the format fails with the IPC version error below.

Is tachyon not comptabile with a Hadoop 2 HDFS? If so, what do I have
to do to work around this?

Thanks,

DR

---

Exception in thread "main" java.lang.RuntimeException:
org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot
communicate with client version 4
at tachyon.util.CommonUtils.runtimeException(CommonUtils.java:246)
at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:73)
at
tachyon.UnderFileSystemHdfs.getClient(UnderFileSystemHdfs.java:53)
at tachyon.UnderFileSystem.get(UnderFileSystem.java:53)
at tachyon.Format.main(Format.java:54)
Caused by: org.apache.hadoop.ipc.RemoteException: Server IPC version 9
cannot communicate with client version 4
at org.apache.hadoop.ipc.Client.call(Client.java:1070)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
at
org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:69)
... 3 more

[Haoyuan Li]

You can do "mvn -Dhadoop.version=2.3.0 clean package"

Best,

Haoyuan

--
You received this message because you are subscribed to the Google Groups "Tachyon Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Haoyuan Li

AMPLab, EECS, UC Berkeley

http://www.cs.berkeley.edu/~haoyuan/

[David Capwell]

Tachyon 0.4 and 0.5 compile against 1.x hadoop and bundle the jars.  To get these to work against a 2.x cluster, you must recompile tachyon against your version.  This gets even trickier when you don't use the apache distro (since each vender applies patches, there can be conflicts).  So when trying out tachyon, you must have it compile against your version + distro to get it to work properly.

To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[David Rosenstrauch]

Ugh. Sounds a bit messy.

Any idea how to build it against Cloudera CDH5? It looks like Haoyuan's
instructions below were for plain vanilla Apache Hadoop 2.3.0.

Thanks,

DR

>>> email to tachyon-user...@googlegroups.com <javascript:>.

[Henry Saputra]

David Capwell just sent PR to support multiple Hadoop repos from
different vendors: https://github.com/amplab/tachyon/pull/299

Once this in then you can just build agains CDH5 like:

mvn -Dhadoop.version=2.0.0-mr1-cdh5.0.0 clean package


- Henry

> email to tachyon-user...@googlegroups.com.

[David Capwell]

Cloud era support is in master already so you should be able to run that command without the patch.

Patch add support for the other distros

You received this message because you are subscribed to a topic in the Google Groups "Tachyon Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/tachyon-users/IRQl6JDrsFc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to tachyon-user...@googlegroups.com.

[David Capwell]

If it helps, added a doc for support of the different distros: https://github.com/amplab/tachyon/blob/master/docs/Building-Tachyon-Master-Branch.md#distro-support

[Haoyuan Li]

DR, is the issue solved?

Haoyuan

[David Rosenstrauch]

Yes, I believe it is.

Thanks,

DR

[Haoyuan Li]

Great to know. Thanks,

Haoyuan

--
You received this message because you are subscribed to the Google Groups "Tachyon Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-users+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.