You cannot post messages because only members can post, and you are not currently a member.
|
mapreduce.map.memory.mb and other settings
|
| |
Good day to you all. Scoobi looks very interesting to me. And I am trying to figure out if it could solve most of my problems better. I am new here so please forgive me if this is a stupid question. In my current MapReduce jobs, in order to utilize the cluster resources, we have the following settings different for each job.... more »
|
|
|
SeqSchema for anything with WireFormat
|
| |
Hi,
I was hoping to write a implicit that makes a SeqSchema for anything with a W ireFormat. I submitted my code here<[link]>, but there now seems to be some issues. It was working before the refactoring of the sequence file API, but I have not dug into it further to... more »
|
|
|
Avro dependencies in cdh3
|
| |
I believe that in [link] this dependency is wrong: <dependency> <groupId>org.apache.avro</grou pId> <artifactId>avro-mapred</artif actId> <version>1.7.4</version> <classifier>hadoop2</classifie r>... more »
|
|
|
My Wish List
|
| |
Doing a fair bit of scoobi as of late, and it's been extremely useful. I've
been able to implement map reduce versions of algorithms fast enough, that
people don't believe I did it (and think i must've found some off the shelf
software to do it). So major props.
But in terms of my wish list:... more »
|
|
|
flatMapped
|
| |
Playing with 0.7 I noticed that flatMap is deprecated and replaced by flatMapped. I think I see the point made in the deprecation message, but surely it does look ugly...
|
|
|
Scoobi in Seattle
|
| |
If there's any seattle-based lurkers here, on April 9th I'll be giving a
pretty informal talk about Scoobi:
[link] (With the
obligatory disclaimer: I'm only speaking for myself)
There's only a few spots available, so get 'em quick. It's going to be a... more »
|
|
|
Scoobi Testing Reducers
|
| |
For the testing configuration, can we default the
ScoobiConfiguration.minReducer s to like .. maybe 5? There's been a few
times now, that I've written dodgy code that only bugs out on multiple
reducers, but when writing tests you tend to only have a tiny little amount
of data -- so don't really catch these bugs.... more »
|
|
|
scoobi for Scala 2.10
|
| |
(posting on dev list as per suggestion from Eric) Hi - We are planning to use Scoobi in a project. It will be Scala 2.10 - in fact one version of the application runs with native MR jobs in Scala. Now the following issues are of immediate concern :- 1. when will scala 2.10 port of Scoobi be available ? I have taken the... more »
|
|
|
versions of scoobi published
|
| |
I noticed that scoobi 0.6.2 was published only for cdh4 and not cdh3. We are running Hortonworks 1.1 on our cluster, which is closest to cdh3. Does it means that you are moving away from cdh3 or was just unintentional? Thanks! [link] : 0.7.3-RELEASE-TRIAL-cdh4<[link]>... more »
|
|
|
Developer's mailing list for Scoobi -