does tachyon support hadoop2.4.0?

[shibo tao]

Hi, haoyuan:

       I have been busy with my graduation in the last two weeks , It's good to see you again .

       does tachyon support hadoop2.4.0?

[Haoyuan Li]

It should. Need to compile it against 2.4.0.

e.g 

mvn -Dhadoop.version=2.4.0 clean install

--
You received this message because you are subscribed to the Google Groups "Tachyon Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Haoyuan Li

AMPLab, EECS, UC Berkeley

http://www.cs.berkeley.edu/~haoyuan/

[shibo tao]

I have tried，it can build successfully , but when I run "bin/tachyon format ", exception occurred:

Formatting Tachyon Master @ 10.75.253.117

Formatting JOURNAL_FOLDER: /root/tachyon/libexec/../journal/

Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4

        at tachyon.util.CommonUtils.runtimeException(CommonUtils.java:480)

        at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:84)

        at tachyon.UnderFileSystemHdfs.getClient(UnderFileSystemHdfs.java:56)

        at tachyon.UnderFileSystem.get(UnderFileSystem.java:68)

        at tachyon.UnderFileSystem.get(UnderFileSystem.java:54)

        at tachyon.Format.formatFolder(Format.java:32)

        at tachyon.Format.main(Format.java:59)

Caused by: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 4

        at org.apache.hadoop.ipc.Client.call(Client.java:1070)

        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)

        at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source)

        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)

        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)

        at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119)

        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238)

        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203)

        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89)

        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)

        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)

        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)

        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)

        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)

        at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:80)

        ... 5 more

I don't know why

 

在 2014年6月20日星期五UTC+8下午3时24分04秒，Haoyuan Li写道：

[Haoyuan Li]

This exception means the version is not right.

What command did you run to build?

Haoyuan

[Dengke Li]

hello,
I also get the problem,
and my version is tachyon0.5.0, spark1.0.2, yarn

i don't know why

在 2014年6月21日星期六UTC+2上午7时52分11秒，Haoyuan Li写道：

[Haoyuan Li]

Did you run "mvn -Dhadoop.version=2.4.0 clean install"?

Haoyuan

[Dengke Li]

hello,

yes, I run "mvn -Dhadoop.version=2.4.0 clean install", and get the same problem with the command''mvn -Dhadoop.version=2.4.0 clean package" like the following:
[hdfs@l-xstream-05 tachyon-0.5.0]$ mvn -Dhadoop.version=2.4.0 clean install
[INFO] Scanning for projects...
Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/org/sonatype/oss/oss-parent/7/oss-parent-7.pom
Downloading: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.tachyonproject:tachyon-parent:0.5.0 (/home/hdfs/tachyon-0.5.0/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM: Could not transfer artifact org.sonatype.oss:oss-parent:pom:7 from/to cloudera-repo (https://repository.cloudera.com/artifactory/cloudera-repos/): Connect to repository.cloudera.com:443 [repository.cloudera.com/54.165.135.107, repository.cloudera.com/54.236.247.151, repository.cloudera.com/54.165.71.98] failed: Connection timed out and 'parent.relativePath' points at wrong local POM @ line 55, column 11 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

the url 'https://repository.cloudera.com/artifactory/cloudera-repos/org/sonatype/oss/oss-parent/7/oss-parent-7.pom' doesn't exist.
do you have some idea?

thank you


在 2014年10月7日星期二UTC+2上午1时58分08秒，Haoyuan Li写道：

[Huamin Chen]

i can build it using the command you provided. 

can you clean you $HOME/.m2 and build again? 

[Haoyuan Li]

You can also run "mvn -Dhadoop.version=2.4.0 clean install -X -e" with more logs.

[Dengke Li]

I find where is the problem, owing to proxy, use the following command can solve the problem:

mvn -DproxySet=true -DproxyHost=myproxy.com -DproxyPort=3128 -Dhadoop.version=2.4.0 clean install

在 2014年10月7日星期二UTC+2下午3时01分28秒，Huamin Chen写道：

[David Capwell]

What vendor do you use for Hadoop?  If you are using cloudera, you must use the cloudera version of 2.4.  If you are using apache, then 2.4 shouldn't get the first error above.

On Tuesday, October 7, 2014 8:29:43 AM UTC-7, Dengke Li wrote:

I find where is the problem, owing to proxy, use the following command can solve the problem:

mvn -DproxySet=true -DproxyHost=myproxy.com -DproxyPort=3128 -Dhadoop.version=2.4.0 clean install

在 2014年10月7日星期二UTC+2下午3时01分28秒，Huamin Chen写道：

i can build it using the command you provided. 

can you clean you $HOME/.m2 and build again? 

On Tuesday, October 7, 2014 4:22:37 AM UTC-4, Dengke Li wrote:

hello,

yes, I run "mvn -Dhadoop.version=2.4.0 clean install", and get the same problem with the command''mvn -Dhadoop.version=2.4.0 clean package" like the following:
[hdfs@l-xstream-05 tachyon-0.5.0]$ mvn -Dhadoop.version=2.4.0 clean install
[INFO] Scanning for projects...
Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/org/sonatype/oss/oss-parent/7/oss-parent-7.pom
Downloading: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project org.tachyonproject:tachyon-parent:0.5.0 (/home

...

[vaishnav kovvuri]

Dengke,

 I also experienced similar issue when I had apache hadoop 2.5.1 and then compiled tachyon 0.5 for hadoop 2.5.1.

Since I had to get the setup up and running, I downgraded my apache hadoop 2.4.0 and then used above said command for build. No issues now.

Thanks,

Vaishnav

--

[David Capwell]

Created a JIRA to track the 2.5 comment (https://tachyon.atlassian.net/browse/TACHYON-178).  Also, adding 2.5 to our internal jenkins to make sure that we monitor the builds there as well.

[xu Bruce]

         Hi ！Dengke  ， i meet the same problem like you , the network has been stocked in  china .. I want to ask about 

 how you configure "-DproxyHost=myproxy.com -DproxyPort=3128 "  ，cause i use a proxy software named "自由门" ,
so how can i get to know  my "-DproxyHost=  and -DproxyPort=  ".

     looking  forward to your reply ! 

[Haoyuan Li]

Dengke, Bruce,

Does the problem still exist in Tachyon 0.6.0?

Thanks,

Haoyuan