Groups
ಸೈನ್ ಇನ್
Groups
Scalding Development
ಸಂಭಾಷಣೆಗಳು
ಕುರಿತು
ಪ್ರತಿಕ್ರಿಯೆ ಕಳುಹಿಸಿ
ಸಹಾಯ
Scalding Development
ಮಾಲೀಕರು ಮತ್ತು ನಿರ್ವಾಹಕರನ್ನು ಸಂಪರ್ಕಿಸಿ
1–30 of 137
ಎಲ್ಲವನ್ನೂ ಓದಲಾಗಿದೆ ಎಂಬುದಾಗಿ ಗುರುತಿಸಿ
ದುರುಪಯೋಗ ಮಾಡುವ ಗುಂಪಿನ ಕುರಿತು ವರದಿಮಾಡಿ
0 ಆಯ್ಕೆ ಮಾಡಲಾಗಿದೆ
Christian Pernillo
21/2/23
Split one TypedPipe into multiple branches
Dear Scalding community, I'm struggling with a Scalding job that we need to optimize, the job
ಓದದಿರುವುದು,
Split one TypedPipe into multiple branches
Dear Scalding community, I'm struggling with a Scalding job that we need to optimize, the job
21/2/23
Jing Lu
,
Alex Levenson
2
3/9/19
Read a gziped HIVE table in scalding
Hello, Not that I know of. If you can find a cascading Tap/Scheme that understands that file format,
ಓದದಿರುವುದು,
Read a gziped HIVE table in scalding
Hello, Not that I know of. If you can find a cascading Tap/Scheme that understands that file format,
3/9/19
Jing Lu
,
Oscar Boykin
5
20/8/19
Is that possible to do exact "LATERAL VIEW EXPLODE" in scalding?
Yes, it does. Thanks for the explanation! Best On Tue, Aug 20, 2019 at 4:52 PM Oscar Boykin <oscar
ಓದದಿರುವುದು,
Is that possible to do exact "LATERAL VIEW EXPLODE" in scalding?
Yes, it does. Thanks for the explanation! Best On Tue, Aug 20, 2019 at 4:52 PM Oscar Boykin <oscar
20/8/19
Saket Kumar
, …
Alex Levenson
8
23/5/19
Bucket join in Scalding
sorry I meant leftJoin not joinLeft On Thu, May 23, 2019 at 3:43 PM Alex Levenson <alexlevenson@
ಓದದಿರುವುದು,
Bucket join in Scalding
sorry I meant leftJoin not joinLeft On Thu, May 23, 2019 at 3:43 PM Alex Levenson <alexlevenson@
23/5/19
ybro...@ebay.com
, …
Alex Levenson
4
25/4/19
Does scalding-parquet library support reading in snappy compressed Parquet files?
Parquet handles data encoding / compression a little bit different from most formats (it doesn't
ಓದದಿರುವುದು,
Does scalding-parquet library support reading in snappy compressed Parquet files?
Parquet handles data encoding / compression a little bit different from most formats (it doesn't
25/4/19
Russell Carden
,
Oscar Boykin
3
15/1/19
Keys sorted on Reducers
Thank you. I see it on the wikipedia page for map reduce. On Monday, January 14, 2019 at 5:12:37 PM
ಓದದಿರುವುದು,
Keys sorted on Reducers
Thank you. I see it on the wikipedia page for map reduce. On Monday, January 14, 2019 at 5:12:37 PM
15/1/19
Tianshan Cui
,
P. Oscar Boykin
3
28/8/18
Is there any good way to control the number of mappers for the sub-tasks in one scalding job?
Thanks for your quick response. That totally make sense. I guess the workaround in my case would be
ಓದದಿರುವುದು,
Is there any good way to control the number of mappers for the sub-tasks in one scalding job?
Thanks for your quick response. That totally make sense. I guess the workaround in my case would be
28/8/18
Russell Carden
, …
Oscar Boykin
4
26/6/18
Reducer Estimators and GroupAll
yeah, that's pretty old.... 0.17.4 is the latest. Definitely worth upgrading. On Tue, Jun 26,
ಓದದಿರುವುದು,
Reducer Estimators and GroupAll
yeah, that's pretty old.... 0.17.4 is the latest. Definitely worth upgrading. On Tue, Jun 26,
26/6/18
Jing Lu
, …
Oscar Boykin
11
23/6/18
How to profile code in scalding?
You can get an idea by how many records per second you are processing, how much total data you are
ಓದದಿರುವುದು,
How to profile code in scalding?
You can get an idea by how many records per second you are processing, how much total data you are
23/6/18
王天宇
16/1/18
Is scalding a memory based framework like Spark or a wrapper for MR?
please.
ಓದದಿರುವುದು,
Is scalding a memory based framework like Spark or a wrapper for MR?
please.
16/1/18
Kostya Salomatin
15/12/17
Scoring a matrix of elements
Hi scalding experts, I need an advise on a workflow to optimize my job efficiency. I need to score a
ಓದದಿರುವುದು,
Scoring a matrix of elements
Hi scalding experts, I need an advise on a workflow to optimize my job efficiency. I need to score a
15/12/17
Cyrille Chépélov
,
charani...@gmail.com
3
4/12/17
Re: calculate the Distinct count for every field in the List at once
Would you mind explaining, why you opted flatMap instead on map for "DB.flatMap". thank you
ಓದದಿರುವುದು,
Re: calculate the Distinct count for every field in the List at once
Would you mind explaining, why you opted flatMap instead on map for "DB.flatMap". thank you
4/12/17
mstr...@gmail.com
, …
Cyrille Chépélov
6
23/8/17
group by and apply the same reduce method on all (non-group by) fields
I was able to implement the logic I was looking for using the typed api, however, I believe Field-
ಓದದಿರುವುದು,
group by and apply the same reduce method on all (non-group by) fields
I was able to implement the logic I was looking for using the typed api, however, I believe Field-
23/8/17
Russell Carden
,
Oscar Boykin
3
18/8/17
scanLeft and Arity
Since you said it was possible, I kept reading over the scalding's scanleft. I didn't find
ಓದದಿರುವುದು,
scanLeft and Arity
Since you said it was possible, I kept reading over the scalding's scanleft. I didn't find
18/8/17
mstr...@gmail.com
, …
Koert Kuipers
12
1/7/17
getting/manupulating all fields in a pipe in scalding
That's exactly what I was looking for. Many thanks Koert, Oscar, and Alex. On Saturday, July 1,
ಓದದಿರುವುದು,
getting/manupulating all fields in a pipe in scalding
That's exactly what I was looking for. Many thanks Koert, Oscar, and Alex. On Saturday, July 1,
1/7/17
Chris K Wensel
9/2/17
Cascading Community Updates
Hey all Sorry for the cross post, but I felt all three communities should be brought up to speed on
ಓದದಿರುವುದು,
Cascading Community Updates
Hey all Sorry for the cross post, but I felt all three communities should be brought up to speed on
9/2/17
Nikhil J Joshi
, …
Alex Levenson
11
10/1/17
Small files not combined in mapper
If you look at how HfsConfPropertySetter is implemented, you just need to use a Tap that overrides
ಓದದಿರುವುದು,
Small files not combined in mapper
If you look at how HfsConfPropertySetter is implemented, you just need to use a Tap that overrides
10/1/17
Nikhil J Joshi
, …
Kostya Salomatin
4
24/11/16
Adding distinct while joining to datasets raises exception
Thanks Piyush. That solved my problem. On Thursday, November 3, 2016 at 9:51:11 AM UTC-7, Piyush
ಓದದಿರುವುದು,
Adding distinct while joining to datasets raises exception
Thanks Piyush. That solved my problem. On Thursday, November 3, 2016 at 9:51:11 AM UTC-7, Piyush
24/11/16
Nikhil J Joshi
24/11/16
TypedPipe to matrix
Hi, I have a library (XGBoost) that is optimized for matrix manipulation and hence I need to port my
ಓದದಿರುವುದು,
TypedPipe to matrix
Hi, I have a library (XGBoost) that is optimized for matrix manipulation and hence I need to port my
24/11/16
Timur Abishev
, …
P. Oscar Boykin
4
8/11/16
Migration to Kryo 3.x and Storm API 1.0.x
Yeah, in summingbird there is an expectation it can configure Kryo. It is a hard problem. On Mon, Nov
ಓದದಿರುವುದು,
Migration to Kryo 3.x and Storm API 1.0.x
Yeah, in summingbird there is an expectation it can configure Kryo. It is a hard problem. On Mon, Nov
8/11/16
Cyrille Chépélov
, …
Piyush Narang
10
4/11/16
[cascading3 branch] descriptions & parallelism
This is pretty cool! Shall take a look at the WIP PR as well. On Fri, Nov 4, 2016 at 12:57 PM,
ಓದದಿರುವುದು,
[cascading3 branch] descriptions & parallelism
This is pretty cool! Shall take a look at the WIP PR as well. On Fri, Nov 4, 2016 at 12:57 PM,
4/11/16
og...@spotify.com
, …
Alex Levenson
8
26/10/16
Problems building Scalding and Running REPL locally
Invoking ./sbt (instead of `which sbt`) uses the version of sbt / scala / etc that scalding is setup
ಓದದಿರುವುದು,
Problems building Scalding and Running REPL locally
Invoking ./sbt (instead of `which sbt`) uses the version of sbt / scala / etc that scalding is setup
26/10/16
Kostya Salomatin
,
Oscar Boykin
3
12/10/16
Does toTypedPipe call break some scalding optimization?
Thanks, that makes sense. On Wed, Oct 12, 2016 at 12:51 PM, 'Oscar Boykin' via Scalding
ಓದದಿರುವುದು,
Does toTypedPipe call break some scalding optimization?
Thanks, that makes sense. On Wed, Oct 12, 2016 at 12:51 PM, 'Oscar Boykin' via Scalding
12/10/16
Gevorg Hari
, …
P. Oscar Boykin
4
28/9/16
Scalding on Stackoverflow
I really think that a better presence on Stackoverflow will simplify adoption and increase developers
ಓದದಿರುವುದು,
Scalding on Stackoverflow
I really think that a better presence on Stackoverflow will simplify adoption and increase developers
28/9/16
Kostya Salomatin
,
Oscar Boykin
2
22/9/16
Serialization of internal job vals
It uses this code: https://github.com/twitter/chill/blob/develop/chill-scala/src/main/scala/com/
ಓದದಿರುವುದು,
Serialization of internal job vals
It uses this code: https://github.com/twitter/chill/blob/develop/chill-scala/src/main/scala/com/
22/9/16
Koert Kuipers
,
P. Oscar Boykin
3
18/9/16
low priority implicits for TupleConverter and TupleSetter etc.
yeah agreed, it just caught me by surprise somewhat On Sun, Sep 18, 2016 at 5:48 PM, P. Oscar Boykin
ಓದದಿರುವುದು,
low priority implicits for TupleConverter and TupleSetter etc.
yeah agreed, it just caught me by surprise somewhat On Sun, Sep 18, 2016 at 5:48 PM, P. Oscar Boykin
18/9/16
ravi kiran holur vijay
,
Oscar Boykin
7
11/9/16
Strange (or inconsistent) behaviour for GroupBy -> SortBy
Just to be sure can you try with scalding 0.16.0? On Sun, Sep 11, 2016 at 11:23 ravi kiran holur
ಓದದಿರುವುದು,
Strange (or inconsistent) behaviour for GroupBy -> SortBy
Just to be sure can you try with scalding 0.16.0? On Sun, Sep 11, 2016 at 11:23 ravi kiran holur
11/9/16
Kostya Salomatin
, …
Alex Levenson
3
31/8/16
Flow optimization question.
I think you *can* tune the min/max size by using the sourceConfInit method in Sources and applying
ಓದದಿರುವುದು,
Flow optimization question.
I think you *can* tune the min/max size by using the sourceConfInit method in Sources and applying
31/8/16
Xiaolin Li
, …
Oscar Boykin
4
26/8/16
taking field names as argument
yes, you can move over bit, by bit. To go from a `Pipe` to `TypedPipe` you need to use `TypedPipe.
ಓದದಿರುವುದು,
taking field names as argument
yes, you can move over bit, by bit. To go from a `Pipe` to `TypedPipe` you need to use `TypedPipe.
26/8/16
Kostya Salomatin
,
P. Oscar Boykin
3
24/8/16
Strange java heap space in mapper, solved by .forceToReducers
Thanks, good to know. On Wednesday, August 24, 2016 at 12:52:23 AM UTC-7, P. Oscar Boykin wrote: Yes,
ಓದದಿರುವುದು,
Strange java heap space in mapper, solved by .forceToReducers
Thanks, good to know. On Wednesday, August 24, 2016 at 12:52:23 AM UTC-7, P. Oscar Boykin wrote: Yes,
24/8/16