Frame size error

[shuy...@gmail.com]

Hi Guys:

Alluxio version: 1.2.0 against hadoop 2.6.0.

Hadoop version: 2.6.0.

In the server where master run

After I run the command: 

yarn jar test-1.0-SNAPSHOT.jar com.test.job.IOReadTest -libjars test-1.0.1.jar,alluxio-assemblies-1.2.0-jar-with-dependencies.jar alluxio://172.19.121.51:19998/data alluxio://172.19.121.51:19998/test.

I got the following errors:

16/08/01 17:50:13 INFO logger.type: Alluxio client (version 1.2.0) is trying to connect with FileSystemMasterClient master @ /172.19.121.51:19998

16/08/01 17:50:15 INFO logger.type: Client registered with FileSystemMasterClient master @ /172.19.121.51:19998

Exception in thread "main" java.io.IOException: Frame size (67108864) larger than max length (16777216)!

at alluxio.AbstractClient.checkVersion(AbstractClient.java:112)

at alluxio.AbstractClient.connect(AbstractClient.java:175)

at alluxio.AbstractClient.retryRPC(AbstractClient.java:322)

at alluxio.client.file.FileSystemMasterClient.getStatus(FileSystemMasterClient.java:183)

at alluxio.client.file.BaseFileSystem.getStatus(BaseFileSystem.java:175)

at alluxio.client.file.BaseFileSystem.getStatus(BaseFileSystem.java:167)

at alluxio.hadoop.AbstractFileSystem.getFileStatus(AbstractFileSystem.java:293)

at alluxio.hadoop.FileSystem.getFileStatus(FileSystem.java:25)

at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1423)

at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)

at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562)

at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)

at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)

at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)

at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)

at com.antfact.laundry.shuqi.job.IOReadTest.run(IOReadTest.java:75)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

at com.antfact.laundry.shuqi.job.IOReadTest.main(IOReadTest.java:41)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

And ther alluxio master has the following errors:

2016-08-01 17:50:15,678 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run) - Error occurred during processing of message.

java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status 0

at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)

at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.thrift.transport.TTransportException: Invalid status 0

at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)

at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)

at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)

at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)

at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)

at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)

... 4 more

How can I fix this, thanks.

[Calvin Jia]

Hi,

It looks like you have security enabled on your Alluxio server but not on your client. The client and server must be using the same authentication type (alluxio.security.authentication.type property).

Hope this helps,

Calvin

[shuy...@gmail.com]

Hi,

It's exactly the problem you mentioned, after I added dynamic parameter of the same authentication, the eeor is gone, thanks very much.

在 2016年8月2日星期二 UTC+8上午1:46:40，Calvin Jia写道：

[Calvin Jia]

Great, thanks for verifying the solution.