java.io.IOException: Failed on local exception: java.io.EOFException; Host Details : local host

[Kay Fleischmann]

Hey guys. I am facing a new problem if my program want to access a file from hdfs, which seems more a hadoop problem, maybe you smart guys can help me out again.

I am using Scala + Stratosphere0.5-SNAPSHOT + hadoop1

google tells me that i compiled my program against a different hadoop version. in stratosphere/lib/ there is only a hadoop-hdfs-2*jar. What do you think?

Exception in thread "main" java.io.IOException: Failed on local exception: java.io.EOFException; Host Details : local host is: "domain/IP"; destination host is:"domain":9001; 

at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)

at org.apache.hadoop.ipc.Client.call(Client.java:1351)

at org.apache.hadoop.ipc.Client.call(Client.java:1300)

at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)

at com.sun.proxy.$Proxy9.getBlockLocations(Unknown Source)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:94)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)

at java.lang.reflect.Method.invoke(Method.java:619)

at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)

at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)

at com.sun.proxy.$Proxy9.getBlockLocations(Unknown Source)

at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getBlockLocations(ClientNamenodeProtocolTranslatorPB.java:188)

at org.apache.hadoop.hdfs.DFSClient.callGetBlockLocations(DFSClient.java:1064)

at org.apache.hadoop.hdfs.DFSClient.getLocatedBlocks(DFSClient.java:1054)

at org.apache.hadoop.hdfs.DFSClient.getLocatedBlocks(DFSClient.java:1044)

at org.apache.hadoop.hdfs.DFSInputStream.fetchLocatedBlocksAndGetLastBlockLength(DFSInputStream.java:235)

at org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:202)

at org.apache.hadoop.hdfs.DFSInputStream.<init>(DFSInputStream.java:195)

at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:1212)

at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:290)

at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:286)

at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)

at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:286)

at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:763)

at eu.stratosphere.runtime.fs.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:331)

at bigdataproject.scala.eu.stratosphere.ml.randomforest.RandomForestBuilder.getFeatureCount(RandomForestBuilder.scala:97)

at bigdataproject.scala.eu.stratosphere.ml.randomforest.RandomForestBuilder.build(RandomForestBuilder.scala:197)

at bigdataproject.scala.eu.stratosphere.ml.randomforest.RandomForestBuilder.build(RandomForestBuilder.scala:171)

at bigdataproject.scala.eu.stratosphere.ml.randomforest.RandomForestExecutor$.main(RandomForestExecutor.scala:34)

at bigdataproject.scala.eu.stratosphere.ml.randomforest.RandomForestExecutor.main(RandomForestExecutor.scala)

Caused by: java.io.EOFException

at java.io.DataInputStream.readInt(DataInputStream.java:403)

at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:995)

at org.apache.hadoop.ipc.Client$Connection.run(Client.java:891)

Kay

[Robert Metzger]

Hey,

Thank you for your question.
Could you use the stratosphere-users mailing list https://groups.google.com/forum/#!forum/stratosphere-users for questions like this one. (If something is not working for you, but you do not suspect a bug in our system).
I'll answer you this question on the dev mailing list.
You have to make sure that your Stratosphere version matches the HDFS version.
Is the  "Stratosphere0.5-SNAPSHOT" the "hadoop2" one or not?
The "hadoop2" version is for hadoop 2.x.x.

Did you change something in the exception's text? It looks like it contains some standard values ("domain" for the hostname) Is that correct?

Regards,
Robert

--
You received this message because you are subscribed to the Google Groups "stratosphere-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stratosphere-d...@googlegroups.com.
Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/groups/opt_out.

[Kay Fleischmann]

Yes I just replaced the domain name with something neutral. 

--

[Robert Metzger]

Hey Kay,

since you wrote

google tells me that i compiled my program against a different hadoop version. in stratosphere/lib/ there is only a hadoop-hdfs-2*jar. What do you think?

I assume that you have a Stratosphere version for Hadoop 2.x.

So you have to install a Stratosphere version that matches the HDFS version.

Regards,

Robert

[Kay Fleischmann]

I actually dowloaded stratosphere 0.5 For hadoop1. 

--

[Robert Metzger]

Hi,

Ah .. yes. There is an issue where the nightly SNAPSHOT builds contain wrong jars.
I'll fix this this evening. (So its good that you posted here, you actually found a bug in the system ;) )

I'm pretty sure your "lib/" directory also contains a hadoop-1.2.1.jar-file? (that's the correct hadoop dependency)
Delete all hadoop-*-2.2.0jar in the "lib/" directory and restart Stratosphere. This should solve your problem.


Regards,

Robert

[Stephan Ewen]

Hey!

That is quite an issue.
@Robert can you share with us why that happens?

Greetings,
Stephan

[Robert Metzger]

Hey,

it "only" affects the nightly builds.

I have a travis build running that hopefully fixes the issue: https://travis-ci.org/stratosphere/stratosphere/builds/19059421

The problem is that travis changed the id's of the jobs. I'm accessing this number via the "$TRAVIS_JOB_NUMBER" environment variable in the deployment script.
Different id's of the travis jobs deploy different things:

# Build Responsibilities
# 1. Deploy to sonatype (old hadoop)

# 2. Nothing


# 3. Deploy to s3 (old hadoop)
# 4. deploy to sonatype (yarn hadoop)

# 5. Nothing


# 6. deploy to s3 (yarn hadoop)

Since the id's changed, my assumptions regarding yarn or non-yarn builds were not valid anymore. (therefore I was assuming to deploy a non-yarn version but the test I ran before were yarn-tests. (This issue could be solved in theory by calling "mvn clean" before, but that would cause another compilation step just for the deployment))

By deploying and building only a yarn or non-yarn version I minimize the amount of artifacts required for downloading to a minimum.

Regards,

Robert

[Robert Metzger]

Hi,

the build passed. The nightly artifacts on s3 are valid again (http://stratosphere-bin.s3-website-us-east-1.amazonaws.com/stratosphere-0.5-SNAPSHOT.tgz)
I pushed the fix in commit 00676c56a875a987ce23371c1665e7d28c1f46ee to master.

Regards,

Robert

[Kay Fleischmann]

Nice!! Everything works now!

Thanks 

Kay

To unsubscribe from this group and stop receiving emails from it, send an email to stratosphere-dev+unsubscribe@googlegroups.com.

Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "stratosphere-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stratosphere-d...@googlegroups.com.
Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "stratosphere-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stratosphere-d...@googlegroups.com.
Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/groups/opt_out.