Grups
Grups
Inicia la sessió
Grups
Grups
cascading-user
Converses
Quant a
Envia suggeriments
Ajuda
Camí del grup
cascading-user
1-30 de 3247
Marca-les totes com a llegides
Informa d'aquest grup
0 files seleccionades
Chris K Wensel
16/2/23
Update
Hey all Quick status update. I have started working on a new project for developers that intersects
no llegida,
Update
Hey all Quick status update. I have started working on a new project for developers that intersects
16/2/23
Chris K Wensel
31/8/22
Cascading 4.5
Hey all Quick note that Cascading 4.5 has been released. This adds support for Hadoop 3.x. This
no llegida,
Cascading 4.5
Hey all Quick note that Cascading 4.5 has been released. This adds support for Hadoop 3.x. This
31/8/22
Chris K Wensel
30/8/22
Cascading 4.1
Hey all Quick note that Cascading 4.1 has been released. This will be the last Hadoop 2.x minor
no llegida,
Cascading 4.1
Hey all Quick note that Cascading 4.1 has been released. This will be the last Hadoop 2.x minor
30/8/22
Velkumar Neel
, …
Chris K Wensel
3
18/7/22
Cascading to spark
There are a lot of 'depends' here to work through.. First, I'd see what the gap is to
no llegida,
Cascading to spark
There are a lot of 'depends' here to work through.. First, I'd see what the gap is to
18/7/22
Chris K Wensel
14/1/22
Cascading 4.5 WIP = Hadoop 3 and Tez 0.10
Hey all Thanks to the team at Foursquare Labs, we have a new WIP with support for Hadoop 3. Special
no llegida,
Cascading 4.5 WIP = Hadoop 3 and Tez 0.10
Hey all Thanks to the team at Foursquare Labs, we have a new WIP with support for Hadoop 3. Special
14/1/22
Rakesh Iyer
,
Chris K Wensel
2
7/12/21
HashJoin results for a SelfJoin of a small File produces partial result.
Can you share what version of Hadoop you are running in the cluster? Also, is this test run on the
no llegida,
HashJoin results for a SelfJoin of a small File produces partial result.
Can you share what version of Hadoop you are running in the cluster? Also, is this test run on the
7/12/21
Chris K Wensel
31/5/21
Cascading 4.0.0 Released
Hey all Just a quick note to announce that Cascading 4.0.0 has been released to Maven Central. https:
no llegida,
Cascading 4.0.0 Released
Hey all Just a quick note to announce that Cascading 4.0.0 has been released to Maven Central. https:
31/5/21
Chris K Wensel
3
18/4/21
[Action Required] Conjars Repo
I made the switch.. For complicated reasons I had to redirect the name servers to reference a new
no llegida,
[Action Required] Conjars Repo
I made the switch.. For complicated reasons I had to redirect the name servers to reference a new
18/4/21
Velkumar Neel
, …
Chris K Wensel
17
10/2/21
Cascading counter
I'm unsure what outcome you expect? You can always test the sources for size before you plan the
no llegida,
Cascading counter
I'm unsure what outcome you expect? You can always test the sources for size before you plan the
10/2/21
ajay wisawe
,
Chris K Wensel
2
3/9/20
How Can I change the LOG LEVEL for Class : cascading.tap.hadoop.io.TapOutputCollector
If you stick log4j log declarations into your JobConf, that is then passed to the planner, they will
no llegida,
How Can I change the LOG LEVEL for Class : cascading.tap.hadoop.io.TapOutputCollector
If you stick log4j log declarations into your JobConf, that is then passed to the planner, they will
3/9/20
gc1888
,
Chris K Wensel
2
17/6/20
TextDelimited using quote string causes job to fail.
Sounds like you have a record the regex used by TextDelimited can't parse. If you enable traps
no llegida,
TextDelimited using quote string causes job to fail.
Sounds like you have a record the regex used by TextDelimited can't parse. If you enable traps
17/6/20
Guillaume Bibens
,
Chris K Wensel
2
16/6/20
Support Hadoop 3
Hi My plan is to release Cascading 4.0 for Hadoop 2 only. When C4 will be released, I'm unsure.
no llegida,
Support Hadoop 3
Hi My plan is to release Cascading 4.0 for Hadoop 2 only. When C4 will be released, I'm unsure.
16/6/20
Saravanabavagugan
,
Chris K Wensel
6
19/2/20
Cascading deletes some temporary files which MR job is trying to access in its mapper resulting in stale file handle error
Threading is not happening within the task. We use multithreading to create and run many MR jobs in
no llegida,
Cascading deletes some temporary files which MR job is trying to access in its mapper resulting in stale file handle error
Threading is not happening within the task. We use multithreading to create and run many MR jobs in
19/2/20
Chris K Wensel
,
Dusty OBrien
4
3/12/19
Nested Fields and Hierarchical Data
Yeah that does help. I figure I could reach into the JSON myself if I use the whole originalRecord
no llegida,
Nested Fields and Hierarchical Data
Yeah that does help. I figure I could reach into the JSON myself if I use the whole originalRecord
3/12/19
Chris K Wensel
24/10/19
Re: Reading GS files
If Hadoop supports gs:// then Cascading supports it. Just know the support may not ship native in
no llegida,
Re: Reading GS files
If Hadoop supports gs:// then Cascading supports it. Just know the support may not ship native in
24/10/19
Chris Schneider
16/10/19
cascading.utils 2.6.4 released
Hi Cascading Buddies, I just pushed a new version of cascading.utils to Conjars. Minor changes
no llegida,
cascading.utils 2.6.4 released
Hi Cascading Buddies, I just pushed a new version of cascading.utils to Conjars. Minor changes
16/10/19
PaulON
, …
Ben Podgursky
5
2/8/19
"Too many counters"
I vaguely recall (could very well be wrong, long time ago) that you have to set this on the
no llegida,
"Too many counters"
I vaguely recall (could very well be wrong, long time ago) that you have to set this on the
2/8/19
Jing Lu
,
Ken Krugler
5
29/7/19
Pipeline becomes very slow after I try to join one small data set using joinWithSmaller/Tiny
I tried joinWithSmaller, it's also not terminated. So, I was thinking to try something more
no llegida,
Pipeline becomes very slow after I try to join one small data set using joinWithSmaller/Tiny
I tried joinWithSmaller, it's also not terminated. So, I was thinking to try something more
29/7/19
Kunal Ghosh
,
Wang Zhong
2
18/7/19
Cascading hive metastore with Kerberos authentication
Hi, It seems that the version of your hive metastore service is older than that of your hive
no llegida,
Cascading hive metastore with Kerberos authentication
Hi, It seems that the version of your hive metastore service is older than that of your hive
18/7/19
Ben Podgursky
,
Chris K Wensel
2
29/6/19
Released OSS data pipeline orchestrator Workflow2, with Cascading integration
Hey, this looks great! Thanks for sharing this with everyone! chris On Jun 28, 2019, at 8:57 AM, Ben
no llegida,
Released OSS data pipeline orchestrator Workflow2, with Cascading integration
Hey, this looks great! Thanks for sharing this with everyone! chris On Jun 28, 2019, at 8:57 AM, Ben
29/6/19
gc1888
,
Chris K Wensel
3
26/2/19
Writing HFiles
I was able to do this by modifying the HFileoutFormat2 to work with the hadoop.mapred library. I then
no llegida,
Writing HFiles
I was able to do this by modifying the HFileoutFormat2 to work with the hadoop.mapred library. I then
26/2/19
HIMANSHU VERMA
,
Ken Krugler
2
3/12/18
Problem with avro part file compaction using Cascading
Why are you comparing Avro records? Are you using the record as part of a grouping key? Asking
no llegida,
Problem with avro part file compaction using Cascading
Why are you comparing Avro records? Are you using the record as part of a grouping key? Asking
3/12/18
duob...@homeaway.com
16/11/18
Joins and optimal partitioning
Hi all, I've never really had a good opportunity to deeply understand LARGE (inner) joins in
no llegida,
Joins and optimal partitioning
Hi all, I've never really had a good opportunity to deeply understand LARGE (inner) joins in
16/11/18
Srikanth Adibhatla
, …
minkymorgan
4
8/11/18
Cascading - strategic direction
1. For complex ETL pipelines where we had to apply multiple business rules on incoming data, we found
no llegida,
Cascading - strategic direction
1. For complex ETL pipelines where we had to apply multiple business rules on incoming data, we found
8/11/18
khedkarn...@gmail.com
24/10/18
Unable to read decimal and timestamp column values from a parquet file
Hello, I am facing an issue while reading decimal and timestamp type values from a parquet file. I am
no llegida,
Unable to read decimal and timestamp column values from a parquet file
Hello, I am facing an issue while reading decimal and timestamp type values from a parquet file. I am
24/10/18
PaulON
,
Chris K Wensel
4
15/10/18
Custom Partitioner not working for GroupBy
Basically we have some join operations that have a small set of keys (100's) and we want want one
no llegida,
Custom Partitioner not working for GroupBy
Basically we have some join operations that have a small set of keys (100's) and we want want one
15/10/18
Shivank Garg
,
Ken Krugler
2
4/7/18
Optimising Cascading Codes.
Hi Shivank, As Bill Atkinson told me when I first started working at Apple, "Measure, then
no llegida,
Optimising Cascading Codes.
Hi Shivank, As Bill Atkinson told me when I first started working at Apple, "Measure, then
4/7/18
Hagai Attias
26/6/18
Converting a pipe to a map using .toIterableExecution results in OutOfMemory
I'm using the following code to convert a pipe into a map and use it in a subsequent step: val
no llegida,
Converting a pipe to a map using .toIterableExecution results in OutOfMemory
I'm using the following code to convert a pipe into a map and use it in a subsequent step: val
26/6/18
Chris K Wensel
,
vinnov...@gmail.com
2
25/6/18
Re: AVAILABLE CONSULTANT HOTLIST
Title: Jr. ScrumMaster Location: Denver (DTC) - CO Duration: 6 month contract Experience : 4-5 yrs
no llegida,
Re: AVAILABLE CONSULTANT HOTLIST
Title: Jr. ScrumMaster Location: Denver (DTC) - CO Duration: 6 month contract Experience : 4-5 yrs
25/6/18
ranjan banerjee
, …
Chris K Wensel
8
6/6/18
Is retry policy available for individual hadoop jobs
see FlowStepJob#blockOnJob() that should get you going in the right direction. but keep in mind this
no llegida,
Is retry policy available for individual hadoop jobs
see FlowStepJob#blockOnJob() that should get you going in the right direction. but keep in mind this
6/6/18