FileSystem.globStatus() & invalid signature

6 views
Skip to first unread message

Arni Sumarlidason

unread,
Aug 27, 2015, 11:02:55 AM8/27/15
to JetS3t Users
Hello,

I am trying to hook into S3 data sources using org.apache.hadoop.fs.FileSystem created like so,

String in = "s3://key:secret@some_bucket/some_folder";
Path inPath = new Path(in);
FileSystem s3_fs = FileSystem.get(inPath.toUri(), conf);
FileStatus[] files = s3_fs.globStatus(new Path(in + "/*.tif"));

However, I am able to list the directory using aws cli and the same creds.

  • relevant pom:
 <dependency>
 
<groupId>org.apache.hadoop</groupId>
 
<artifactId>hadoop-client</artifactId>
 
<version>2.6.0</version>
 
</dependency>
 
<dependency>
 
<groupId>org.apache.hadoop</groupId>
 
<artifactId>hadoop-aws</artifactId>
 
<version>2.6.0</version>
 
</dependency>
 
<dependency>
 
<groupId>net.java.dev.jets3t</groupId>
 
<artifactId>jets3t</artifactId>
 
<version>0.9.4</version>
 
</dependency>


  • log w/ trace attached
log.txt

James Murty

unread,
Sep 2, 2015, 8:52:03 AM9/2/15
to jets3t...@googlegroups.com
Hi,

I'm afraid I can't see anything in the log file to hint at what is going wrong.

Are you 100% sure you are using the right AWS access and secret key values? It may be a bug in JetS3t, but wrong credentials are the most likely explanation.

James

--
You received this message because you are subscribed to the Google Groups "JetS3t Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jets3t-users...@googlegroups.com.
To post to this group, send email to jets3t...@googlegroups.com.
Visit this group at http://groups.google.com/group/jets3t-users.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages