Pentaho with Amazon S3

1,421 views
Skip to first unread message

Prakash Killada

unread,
Jun 17, 2014, 4:05:19 PM6/17/14
to pentaho-...@googlegroups.com
Folk,
        I am getting the following error while writing in Amazon S3 using S3 output plugin in Pentaho Kettle 5.0 Community edition. The credentials seems fine as i could login and browse in the plugin. However when i am running the workflow it gives below error. The same workflow works fine on my colleagues machine with his credentials.Couldn't trace what is the issue. Any pointers will be greatly appreciated. Please let me know if you need any other info.


WARN  17-06 12:55:49,738 - Error Response: GET '/' -- ResponseCode: 403, ResponseStatus: Forbidden, Request Headers: [Content-Type: , Date: Tue, 17 Jun 2014 19:55:48 GMT, Authorization: AWS null:null, User-Agent: JetS3t/0.7.4-dev (Mac OS X/10.9.2; x86_64; en; JVM 1.6.0_65), Host: s3.amazonaws.com], Response Headers: [x-amz-request-id: 8D9289464B117400, x-amz-id-2: 7XaY1bz9j0+t+WyEOANu5J44mu81f57G53K8MB9T4azVSDbWj4sEdUnKscPvtLqW, Content-Type: application/xml, Transfer-Encoding: chunked, Date: Tue, 17 Jun 2014 19:55:49 GMT, Server: AmazonS3]

WARN  17-06 12:55:49,885 - Error Response: GET '/' -- ResponseCode: 403, ResponseStatus: Forbidden, Request Headers: [Content-Type: , Date: Tue, 17 Jun 2014 19:55:49 GMT, Authorization: AWS null:null, User-Agent: JetS3t/0.7.4-dev (Mac OS X/10.9.2; x86_64; en; JVM 1.6.0_65), Host: s3.amazonaws.com], Response Headers: [x-amz-request-id: ED7A50F7536DA179, x-amz-id-2: qpEd6fAQef/eN6vwLpcnff8ei+YIlzKRL12FsSRhiv1ciWO60hMPL06LJ4LuNjPH, Content-Type: application/xml, Transfer-Encoding: chunked, Date: Tue, 17 Jun 2014 19:55:49 GMT, Server: AmazonS3]

org.pentaho.di.core.exception.KettleException: 

Error opening new file : org.apache.commons.vfs.FileSystemException: Could not determine the type of file "s3://s3/dw-prod-bi-corp/OktaDev".


at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.openNewFile(TextFileOutput.java:648)

at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.processRow(TextFileOutput.java:125)

at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60)

at java.lang.Thread.run(Thread.java:695)

2014/06/17 12:55:49 - S3 File Output.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Unexpected error

2014/06/17 12:55:49 - S3 File Output.0 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : org.pentaho.di.core.exception.KettleException: 

2014/06/17 12:55:49 - S3 File Output.0 - Error opening new file : org.apache.commons.vfs.FileSystemException: Could not determine the type of file "s3://s3/dw-prod-bi-corp/OktaDev".

2014/06/17 12:55:49 - S3 File Output.0 - 

2014/06/17 12:55:49 - S3 File Output.0 - at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.openNewFile(TextFileOutput.java:648)

2014/06/17 12:55:49 - S3 File Output.0 - at org.pentaho.di.trans.steps.textfileoutput.TextFileOutput.processRow(TextFileOutput.java:125)

2014/06/17 12:55:49 - S3 File Output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60)

2014/06/17 12:55:49 - S3 File Output.0 - at java.lang.Thread.run(Thread.java:695)

child index = 5, logging object : org.pentaho.di.core.logging.LoggingObject@1073f623 parent=2137e145-55c0-434e-9cf3-ba3c83335038

2014/06/17 12:55:49 - S3 File Output.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=1)

2014/06/17 12:55:49 - Apps_OKTA_S3 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!

2014/06/17 12:55:49 - Spoon - The transformation has finished!!

2014/06/17 12:55:49 - Apps_OKTA_S3 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!

2014/06/17 12:55:49 - Apps_OKTA_S3 - ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : Errors detected!


Thanks,Prakash

Jens Bleuel

unread,
Jun 18, 2014, 7:33:45 AM6/18/14
to pentaho-...@googlegroups.com

“ResponseStatus: Forbidden “ I bet the credentials are wrong.

The forum might be also a good place to ask if needed.

HTH,

Jens

--
You received this message because you are subscribed to the Google Groups "Pentaho Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pentaho-commun...@googlegroups.com.
To post to this group, send email to pentaho-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/8e4ef224-5a87-4680-a1f3-63a6f7ee402c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Matt Casters

unread,
Jun 18, 2014, 8:37:10 AM6/18/14
to pentaho-...@googlegroups.com
Or maybe AWS changed their web service API and we need to update a library?  Haven't tried it myself yet.

--
Matt Casters <mcas...@pentaho.org>
Chief Data Integration, Kettle founder, Author of Pentaho Kettle Solutions (Wiley)
Fonteinstraat 70 - 9400 OKEGEM - Belgium - Cell : +32 486 97 29 37
Pentaho  -  Powerful Analytics Made Easy

 Pentaho World 2014


Reply all
Reply to author
Forward
0 new messages