s3n URI scheme

587 views
Skip to first unread message

markpiller

unread,
Aug 18, 2009, 7:13:27 PM8/18/09
to cascading-user
I followed the instructions from AmazonS3 wiki page (http://
wiki.apache.org/hadoop/AmazonS3) to configure my installation of
Hadoop to use one of my S3 buckets. For the simplicity sake I am using
the s3n uri scheme and specified the following URI:

s3n://mybucketname.s3.amazonaws.com/

I also tried s3n://mybucketname (thinking that Hadoop may be appending
the rest). However with both of these URIs I am getting the following
exception:

java.lang.IllegalArgumentException: Invalid hostname in URI s3n://
mybucketname
at org.apache.hadoop.fs.s3.S3Credentials.initialize
(S3Credentials.java:41)
at
org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize
(Jets3tNativeFileSystemStore.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)

I am running Hadoop locally, but would like to use S3 for input/
output. Is it even a legitimate use-case?

Thanks in advance!

Mark

markpiller

unread,
Aug 19, 2009, 7:52:39 AM8/19/09
to cascading-user
Please ignore this one. I had underscore in the bucket name and URI
fails to parse it.

Cheers,
Mark
Reply all
Reply to author
Forward
0 new messages