Tachyon with S3 backend problem

[pma...@stratio.com]

Hello everyone.

I was just going to try Tachyon, and although I made the standalone installation work just straight away when I was tried to use the S3 backend I found both very little information and a lot of problems :-/

My first steps were just configuring the tachyon-env.sh file following the documentation and trying to format the filesystem, but when trying to format it the following error arised:

[root@tachyon1 tachyon]# ./bin/tachyon format
Connection to tachyon2.foo.com... Formatting Tachyon Worker @ tachyon2.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon2.foo.com closed.
Connection to tachyon3.foo.com... Formatting Tachyon Worker @ tachyon3.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon3.foo.com closed.
Formatting Tachyon Master @ tachyon1.foo.com
Formatting JOURNAL_FOLDER: /var/sds/tachyon/journal/
Exception in thread "main" java.lang.NoClassDefFoundError: org/jets3t/service/S3ServiceException
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.createDefaultStore(NativeS3FileSystem.java:224)
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.initialize(NativeS3FileSystem.java:214)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
    at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
    at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:89)
    at tachyon.UnderFileSystemHdfs.getClient(UnderFileSystemHdfs.java:56)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:69)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:54)
    at tachyon.Format.formatFolder(Format.java:32)
    at tachyon.Format.main(Format.java:59)
Caused by: java.lang.ClassNotFoundException: org.jets3t.service.S3ServiceException
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 13 more

Because it seemed as if it lacked the necessary libs, I downloaded jets3t v0.9.2 and copied the jars to the classpath. Errors have changed since then:

[root@tachyon1 tachyon]# ./bin/tachyon format
Connection to tachyon2.foo.com... Formatting Tachyon Worker @ tachyon2.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon2.foo.com closed.
Connection to tachyon3.foo.com... Formatting Tachyon Worker @ tachyon3.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon3.foo.com closed.
Formatting Tachyon Master @ tachyon1.foo.com
Formatting JOURNAL_FOLDER: /var/sds/tachyon/journal/
Exception in thread "main" java.lang.NoSuchMethodError: org.jets3t.service.impl.rest.httpclient.RestS3Service.<init>(Lorg/jets3t/service/security/AWSCredentials;)V
    at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:54)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
    at org.apache.hadoop.fs.s3native.$Proxy1.initialize(Unknown Source)
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.initialize(NativeS3FileSystem.java:216)
    at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
    at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
    at tachyon.UnderFileSystemHdfs.<init>(UnderFileSystemHdfs.java:89)
    at tachyon.UnderFileSystemHdfs.getClient(UnderFileSystemHdfs.java:56)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:69)
    at tachyon.UnderFileSystem.get(UnderFileSystem.java:54)
    at tachyon.Format.formatFolder(Format.java:32)
    at tachyon.Format.main(Format.java:59)

Where could be the problem? My config file (tachyon-env.sh) is the following:

#!/usr/bin/env bash

# This file contains environment variables required to run Tachyon. Copy it as tachyon-env.sh and
# edit that to configure Tachyon for your site. At a minimum,
# the following variables should be set:
#
# - JAVA_HOME, to point to your JAVA installation
# - TACHYON_MASTER_ADDRESS, to bind the master to a different IP address or hostname
# - TACHYON_UNDERFS_ADDRESS, to set the under filesystem address.
# - TACHYON_WORKER_MEMORY_SIZE, to set how much memory to use (e.g. 1000mb, 2gb) per worker
# - TACHYON_RAM_FOLDER, to set where worker stores in memory data
# - TACHYON_UNDERFS_HDFS_IMPL, to set which HDFS implementation to use (e.g. com.mapr.fs.MapRFileSystem,
#   org.apache.hadoop.hdfs.DistributedFileSystem)

# The following gives an example:

if [[ `uname -a` == Darwin* ]]; then
  # Assuming Mac OS X
  export JAVA_HOME=${JAVA_HOME:-$(/usr/libexec/java_home)}
  export TACHYON_RAM_FOLDER=/Volumes/ramdisk
  export TACHYON_JAVA_OPTS="-Djava.security.krb5.realm= -Djava.security.krb5.kdc="
else
  # Assuming Linux
  if [ -z "$JAVA_HOME" ]; then
    export JAVA_HOME=/usr/lib/jvm/java-7-oracle
  fi
  export TACHYON_RAM_FOLDER=/var/sds/tachyon/ramdisk
fi

export JAVA="$JAVA_HOME/bin/java"
export TACHYON_MASTER_ADDRESS=tachyon1.foo.com
export TACHYON_UNDERFS_ADDRESS=s3n://XXXXXXX
export TACHYON_WORKER_MEMORY_SIZE=1GB
export TACHYON_UNDERFS_HDFS_IMPL=org.apache.hadoop.hdfs.DistributedFileSystem

CONF_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"

export TACHYON_JAVA_OPTS+="
  -Dlog4j.configuration=file:$CONF_DIR/log4j.properties
  -Dtachyon.debug=false
  -Dtachyon.underfs.address=$TACHYON_UNDERFS_ADDRESS
  -Dtachyon.underfs.hdfs.impl=$TACHYON_UNDERFS_HDFS_IMPL
  -Dtachyon.data.folder=$TACHYON_UNDERFS_ADDRESS/tmp/tachyon/data
  -Dtachyon.workers.folder=$TACHYON_UNDERFS_ADDRESS/tmp/tachyon/workers
  -Dtachyon.worker.memory.size=$TACHYON_WORKER_MEMORY_SIZE
  -Dtachyon.worker.data.folder=$TACHYON_RAM_FOLDER/tachyonworker/
  -Dtachyon.master.worker.timeout.ms=60000
  -Dtachyon.master.hostname=$TACHYON_MASTER_ADDRESS
  -Dtachyon.master.journal.folder=/var/sds/tachyon/journal/
  -Dfs.s3n.awsAccessKeyId=XXXXXXXXXXXXXXXXX
  -Dfs.s3n.awsSecretAccessKey=XXXXXXXXXXXXXXXXXXXXXXXX
  -Dtachyon.usezookeeper=true
  -Dtachyon.zookeeper.address=localhost:2181/tachyon
  -Dorg.apache.jasper.compiler.disablejsr199=true
  -Djava.net.preferIPv4Stack=true
"

# Master specific parameters. Default to TACHYON_JAVA_OPTS.
export TACHYON_MASTER_JAVA_OPTS="$TACHYON_JAVA_OPTS"

# Worker specific parameters that will be shared to all workers. Default to TACHYON_JAVA_OPTS.
export TACHYON_WORKER_JAVA_OPTS="$TACHYON_JAVA_OPTS"

Thank you very much.

Francisco Madrid-Salvador

[achak]

whats your hadoop and tachyon versions?

[pma...@stratio.com]

Hello achak, thanks for your quick answer.

I'm using Tachyon 0.5.0, but because I was using S3 backend I figured I didn't need Hadoop. Is it necessary?

Francisco Madrid-Salvador

[Haoyuan Li]

Hi Francisco Madrid-Salvador,

HDFS is not necessary. From your exception, there are two libraries in your classpath containing org.jets3t.service.impl.rest.httpclient.RestS3Service.<init>(Lorg/jets3t/service/security/AWSCredentials;)V

Could you do a double check on that?

Best,

Haoyuan

--
You received this message because you are subscribed to the Google Groups "Tachyon Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Haoyuan Li

AMPLab, EECS, UC Berkeley

http://www.cs.berkeley.edu/~haoyuan/

[pma...@stratio.com]

Hi Haoyuan.

In fact it's just like you said, the libraries I had included didn't have the required methods/classes. Here are my little advances:

I've had several problems with libraries, most of them due to versions. I had to install jets3t v0.7.4 although there's already a v0.9.2. I also had to install commons-httpclient v3.1 although it's deprecated and httpcomponents-client v4.3.4 is available.

After dealing with libraries another error has arised, this one having to do with paths in S3. I have doubled checked the path and confirmed it exists so I figure it has to do with the secret and access keys. Have you ever seen something similar?

[root@tachyon1 tachyon]# ./bin/tachyon format
Connection to tachyon2.foo.com... Formatting Tachyon Worker @ tachyon2.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon2.foo.com closed.
Connection to tachyon3.foo.com... Formatting Tachyon Worker @ tachyon3.foo.com
Removing local data under folder: /var/sds/tachyon/ramdisk/tachyonworker/
Connection to tachyon3.foo.com closed.
Formatting Tachyon Master @ tachyon1.foo.com
Formatting JOURNAL_FOLDER: /var/sds/tachyon/journal/

Formatting UNDERFS_DATA_FOLDER: s3n://XXXXXXXX/tmp/tachyon/data/
Exception in thread "main" org.apache.hadoop.fs.s3.S3Exception: org.jets3t.service.S3ServiceException: Request Error. HEAD '/tmp%2Ftachyon%2Fdata' on Host 'XXXXXXXX.s3.amazonaws.com' @ 'Sun, 03 Aug 2014 10:03:48 GMT' -- ResponseCode: 404, ResponseStatus: Not Found, RequestId: 1998754639CAF929, HostId: jtaveCTUj2O+0V957yVJ4Ycuk0VsKEeNiD/ELhWtXEraOtWCvZ2ddqZ/YcSUe1q3
    at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.retrieveMetadata(Jets3tNativeFileSystemStore.java:122)

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)

    at org.apache.hadoop.fs.s3native.$Proxy1.retrieveMetadata(Unknown Source)
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:326)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:768)
    at tachyon.UnderFileSystemHdfs.exists(UnderFileSystemHdfs.java:173)
    at tachyon.Format.formatFolder(Format.java:34)
    at tachyon.Format.main(Format.java:59)
Caused by: org.jets3t.service.S3ServiceException: Request Error. HEAD '/tmp%2Ftachyon%2Fdata' on Host 'XXXXXXXX.s3.amazonaws.com' @ 'Sun, 03 Aug 2014 10:03:48 GMT' -- ResponseCode: 404, ResponseStatus: Not Found, RequestId: 1998754639CAF929, HostId: jtaveCTUj2O+0V957yVJ4Ycuk0VsKEeNiD/ELhWtXEraOtWCvZ2ddqZ/YcSUe1q3
    at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest(RestS3Service.java:520)
    at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRestHead(RestS3Service.java:868)
    at org.jets3t.service.impl.rest.httpclient.RestS3Service.getObjectImpl(RestS3Service.java:2016)
    at org.jets3t.service.impl.rest.httpclient.RestS3Service.getObjectDetailsImpl(RestS3Service.java:1944)
    at org.jets3t.service.S3Service.getObjectDetails(S3Service.java:3059)
    at org.jets3t.service.S3Service.getObjectDetails(S3Service.java:1940)
    at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.retrieveMetadata(Jets3tNativeFileSystemStore.java:111)
    ... 12 more
Caused by: org.jets3t.service.impl.rest.HttpException
    at org.jets3t.service.impl.rest.httpclient.RestS3Service.performRequest(RestS3Service.java:518)
    ... 18 more

Thanks in advance.

Francisco Madrid-Salvador

[Haoyuan Li]

I didnt see this error before.  Seems a cridential issue. Try to Google it?

[pma...@stratio.com]

Hello Haoyuan.

That was my first guess but I afterwards tried with an incorrect key and the exception was a different one, the response was "ResponseStatus: Forbidden" instead of "ResponseStatus: Not found".:

...
Formatting UNDERFS_DATA_FOLDER: s3n://XXXXXXXX/data\/
Exception in thread "main" org.apache.hadoop.fs.s3.S3Exception: org.jets3t.service.S3ServiceException: Request Error. HEAD '/data%2F' on Host 'XXXXXXXX.s3.amazonaws.com' @ 'Fri, 08 Aug 2014 06:26:34 GMT' -- ResponseCode: 403, ResponseStatus: Forbidden, RequestId: 32BD2A865288909A, HostId: n+7uPzormNJYPSgashpHxhUrnRzNfA29xC+i6j2vSR5a+VAy2py1NXB6EJXBgNwO

    at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.retrieveMetadata(Jets3tNativeFileSystemStore.java:122)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
    at org.apache.hadoop.fs.s3native.$Proxy1.retrieveMetadata(Unknown Source)
    at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:326)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:768)
    at tachyon.UnderFileSystemHdfs.exists(UnderFileSystemHdfs.java:173)
    at tachyon.Format.formatFolder(Format.java:34)
    at tachyon.Format.main(Format.java:59)

    ...

It seems as if the jets3t library is not working correctly, ¿perhaps due to the old version I had tu use? I'm thinking of giving up on making it work.

Yours,

Francisco Madrid-Salvador

[Haoyuan Li]

Sorry to hear about that. This maybe helpful: https://forums.aws.amazon.com/thread.jspa?threadID=55268

Best,

Haoyuan

[Suresh Mandava]

Same problem with S3 filesystem. when trying format.

tachyon-0.5.0

Exception in thread "main" org.apache.hadoop.fs.s3.S3Exception: org.jets3t.service.S3ServiceException: Request Error. HEAD '/tmp%2Ftachyon%2Fdata' on Host 'tach.s3.amazonaws.com' @ 'Mon, 01 Sep 2014 04:19:45 GMT' -- ResponseCode: 404, ResponseStatus: Not Found, RequestId: 99525DF3AB3C2661, HostId: d6CCzemVyM3skWXcdsmyPzmE9zDAFp0FxyuKd/b4D/2AVZTnQlGqkD9W/28Znw6f

    at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.retrieveMetadata(Jets3tNativeFileSystemStore.java:122)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Was this issue resolved ?

[Manku Timma]

Same problem with tachyon-0.5.0. I checked out the presence of the jets3t jar and it seems to exist.

...

[Haoyuan Li]

According to https://spark-project.atlassian.net/browse/SPARK-456

1) According to https://issues.apache.org/jira/browse/HADOOP-5805, you might need to use a subdirectory rather than a top-level bucket. In particular, Hadoop's S3 library won't create the bucket if it doesn't exist.

2) I'm not sure whether passing your credentials with @ is supposed to work in S3N URLs (it might well work), but if it doesn't, you can also try the versions of the save() method that take a JobConf and set your credentials in there through fs.s3.awsAccessKeyId and fs.s3.awsSecretAccessKey. Check out http://wiki.apache.org/hadoop/AmazonS3.

--

You received this message because you are subscribed to the Google Groups "Tachyon Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[alapan mukherjee]

Hi Francisco, 

I am facing the same problems as you did a few months back. Could you tell me exactly which jars you added to the classpath? I downloaded jets3t-0.9.2.zip. Inside this folder there is a subfolder called "jars". Did you copy these jars, or was it some other folder? I would be glad if you helped!

Thanks in advance,

Alapan 

[Francisco Madrid-Salvador]

Hi Alapan.

I don't really remember in which directory I left the libraries in, but what I do remember is that I had to download older versions of the libraries. I had to install jets3t v0.7.4 although there's already a v0.9.2, and I also had to install commons-httpclient v3.1 although it's deprecated and httpcomponents-client v4.3.4 is available.

I could try to reinstall Tachyon to find out where I copied the libraries but it won't be in the near future (too many thing waiting for my attention :-/). Please let me know if I should.

Good luck.

Francisco Madrid-Salvador

El 30/10/14 a las 16:53, alapan mukherjee escribió:

--
You received this message because you are subscribed to a topic in the Google Groups "Tachyon Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/tachyon-users/PzQsk_dDHIE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to tachyon-user...@googlegroups.com.

[Haoyuan Li]

Hi Alapan, Francisco, and others,

We just added more documents about running Tachyon on S3: https://github.com/amplab/tachyon/blob/master/docs/Setup-UFS.md#amazon-s3 . Hope this will help.

Thanks to Dan for writing this up!

Cheers,

Haoyuan

--

You received this message because you are subscribed to the Google Groups "Tachyon Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to tachyon-user...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Anshul Singhle]

Hi all,

I followed the steps exactly as described in the link with tachyon-0.6.1
I'm getting the following error - 

Exception in thread "main" java.lang.NoSuchMethodError: org.jets3t.service.impl.rest.httpclient.RestS3Service.<init>(Lorg/jets3t/service/security/AWSCredentials;)V

at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:54)

Any thoughts?

[Dan Crankshaw]

What version of hadoop-client and of jets3t are you using? My guess is that hadoop is depending on an older or newer version of jets3t than the one you provided, and is trying to call a method that doesn't exist.

[Anshul Singhle]

Hi all,

I just tried this with tachyon 0.5.0
When I use jets3t 0.9.0, I get - 

Exception in thread "main" java.lang.NoSuchMethodError: org.jets3t.service.impl.rest.httpclient.RestS3Service.<init>(Lorg/jets3t/service/security/AWSCredentials;)V 

If I user jets3t 0.7.2 I get -

Exception in thread "main" org.apache.hadoop.fs.s3.S3Exception: org.jets3t.service.S3ServiceException: Request Error. HEAD '/tachtest%2Ftmp%2Ftachyon%2Fdata' on Host 'betaglidedata.s3.amazonaws.com' @ 'Wed, 22 Apr 2015 08:59:11 GMT' -- ResponseCode: 404, ResponseStatus: Not Found, RequestId: B4F51785C2CB0D64, HostId: ywRc46OjkxyiWfnSYAKw67L5sr3goOUdVVbqLTcUSahjRwVJxdFtv29bUpYH0We/ 

at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.retrieveMetadata(Jets3tNativeFileSystemStore.java:122)

 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606)

 at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)

 at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)

 at org.apache.hadoop.fs.s3native.$Proxy1.retrieveMetadata(Unknown Source) at org.apache.hadoop.fs.s3native.NativeS3FileSystem.getFileStatus(NativeS3FileSystem.java:326)

 at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:768) at tachyon.UnderFileSystemHdfs.exists(UnderFileSystemHdfs.java:173)

 at tachyon.Format.formatFolder(Format.java:34) at tachyon.Format.main(Format.java:59)

Caused by: org.jets3t.service.S3ServiceException: Request Error. HEAD '/tachtest%2Ftmp%2Ftachyon%2Fdata' on Host 'betaglidedata.s3.amazonaws.com' @ 'Wed, 22 Apr 2015 08:59:11 GMT' -- ResponseCode: 404, ResponseStatus: Not Found, RequestId: B4F51785C2CB0D64, HostId: ywRc46OjkxyiWfnSYAKw67L5sr3goOUdVVbqLTcUSahjRwVJxdFtv29bUpYH0We/

On Tue, Mar 31, 2015 at 8:15 PM, Dan Crankshaw <cran...@cs.berkeley.edu> wrote:

What version of hadoop-client and of jets3t are you using? My guess is that hadoop is depending on an older or newer version of jets3t than the one you provided, and is trying to call a method that doesn't exist.

[Anshul Singhle]

Also, I forgot to mention, I'm using hadoop version 1.0.4

[Calvin Jia]

Hi,

I believe the version you want to use is 0.7.1 for hadoop 1.0.4. As for the error, have you created the tachtest bucket manually? The client will not create the bucket if it does not exist.

Thanks,

Calvin