I followed the instructions from AmazonS3 wiki page (http://
wiki.apache.org/hadoop/AmazonS3) to configure my installation of
Hadoop to use one of my S3 buckets. For the simplicity sake I am using
the s3n uri scheme and specified the following URI:
s3n://
mybucketname.s3.amazonaws.com/
I also tried s3n://mybucketname (thinking that Hadoop may be appending
the rest). However with both of these URIs I am getting the following
exception:
java.lang.IllegalArgumentException: Invalid hostname in URI s3n://
mybucketname
at org.apache.hadoop.fs.s3.S3Credentials.initialize
(S3Credentials.java:41)
at
org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize
(Jets3tNativeFileSystemStore.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
I am running Hadoop locally, but would like to use S3 for input/
output. Is it even a legitimate use-case?
Thanks in advance!
Mark