Issue 28 in bigstreams: Collected files to HDFS Java component over current bash implementation

4 views
Skip to first unread message

bigst...@googlecode.com

unread,
Oct 14, 2010, 7:53:54 AM10/14/10
to stream...@googlegroups.com
Status: Accepted
Owner: ----
Labels: Type-Enhancement Priority-High

New issue 28 by gerritjvv: Collected files to HDFS Java component over
current bash implementation
http://code.google.com/p/bigstreams/issues/detail?id=28

This is currently a bash script, we should move away from this and design
as part of the collector project another component daemon that will load
the collected data to hdfs.

support for: describing bucketing through configuration. etc.

bigst...@googlecode.com

unread,
Oct 20, 2010, 8:05:47 AM10/20/10
to stream...@googlegroups.com
Updates:
Labels: Version-0.1.1

Comment #1 on issue 28 by gerritjvv: Collected files to HDFS Java component

(No comment was entered for this change.)

bigst...@googlecode.com

unread,
Nov 8, 2010, 9:48:03 AM11/8/10
to stream...@googlegroups.com

Comment #2 on issue 28 by gerritjvv: Collected files to HDFS Java component

The documentation for this issue is at:
http://code.google.com/p/bigstreams/wiki/CollectorHadoopHdfsIntegration

First implementation is CollectorDirectory:

package is : {{{ org.streams.collector.integration.hdfs.io }}}

bigst...@googlecode.com

unread,
Jan 8, 2013, 6:44:03 AM1/8/13
to stream...@googlegroups.com
Updates:
Labels: -Priority-High Priority-Low

Comment #3 on issue 28 by gerr...@gmail.com: Collected files to HDFS Java
component over current bash implementation
http://code.google.com/p/bigstreams/issues/detail?id=28

bigst...@googlecode.com

unread,
Apr 15, 2013, 6:41:09 AM4/15/13
to stream...@googlegroups.com
Updates:
Status: WontFix

Comment #4 on issue 28 by gerr...@gmail.com: Collected files to HDFS Java
component over current bash implementation
http://code.google.com/p/bigstreams/issues/detail?id=28

HDFS Bash upload works fine

--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings
Reply all
Reply to author
Forward
0 new messages