Spark Developers (Old List)

Contact owners and managers

1–30 of 132

This is a read-only archive of the old Spark developer mailing list before our move to Apache. The list has moved to dev@spark.incubator.apache.org.

To subscribe to the new list, send an email to dev-subscribe@spark.incubator.apache.org.

Archives for the new list are available at http://mail-archives.apache.org/mod_mbox/incubator-spark-dev/.

0 selected

9/9/13

IMPORTANT: Spark Developers list has moved to Apache

Hi folks, Today we're going to put this Google Group into archival more, as warned earlier this

unread,

IMPORTANT: Spark Developers list has moved to Apache

Hi folks, Today we're going to put this Google Group into archival more, as warned earlier this

9/9/13

9/3/13

About a paper titiled "Memory-Efficient GroupBy-Aggregate using Compressed Buffer Trees"

Hi, all. I noticed a paper called "Memory-Efficient GroupBy-Aggregate using Compressed Buffer

unread,

About a paper titiled "Memory-Efficient GroupBy-Aggregate using Compressed Buffer Trees"

Hi, all. I noticed a paper called "Memory-Efficient GroupBy-Aggregate using Compressed Buffer

9/3/13

8/30/13

Testing again. On Aug 30, 2013, at 5:44 PM, Matei Zaharia <matei....@gmail.com> wrote: >

unread,

Testing again. On Aug 30, 2013, at 5:44 PM, Matei Zaharia <matei....@gmail.com> wrote: >

8/30/13

kingf...@gmail.com, Matei Zaharia3

8/29/13

spark make error

it is very confuse to get this error again after i rebuild project with maven. i check the dependency

unread,

spark make error

it is very confuse to get this error again after i rebuild project with maven. i check the dependency

8/29/13

Hao REN, … Ian O'Connell6

8/27/13

spark/sbt building problem when using custom class as type parameter

Sorry about the delay, I had a bit of time to look at this today. It looks like the class loader hit

unread,

spark/sbt building problem when using custom class as type parameter

Sorry about the delay, I had a bit of time to look at this today. It looks like the class loader hit

8/27/13

yafeng zhao, … Patrick Wendell4

8/26/13

must i install scala on worker node?

Ah - I forgot that got merged. Cool! On Mon, Aug 26, 2013 at 3:58 PM, Evan Chan <e...@ooyala.com>

unread,

must i install scala on worker node?

Ah - I forgot that got merged. Cool! On Mon, Aug 26, 2013 at 3:58 PM, Evan Chan <e...@ooyala.com>

8/26/13

8/24/13

Introducing myself with MQTT Adapter for Spark Streaming

Hi All, My Name is Prabeesh. We do a project on Internet of Things (IoT) at Amrita Center for Cyber

unread,

Introducing myself with MQTT Adapter for Spark Streaming

Hi All, My Name is Prabeesh. We do a project on Internet of Things (IoT) at Amrita Center for Cyber

8/24/13

Matei Zaharia, … Henry Saputra11

8/20/13

IMPORTANT: Spark mailing lists moving to Apache by September 1st

From http://www.apache.org/foundation/mailinglists.html looks like the spam filter will reject HTML-

unread,

IMPORTANT: Spark mailing lists moving to Apache by September 1st

From http://www.apache.org/foundation/mailinglists.html looks like the spam filter will reject HTML-

8/20/13

moji...@gmail.com

8/18/13

spark worker registration failed

hi, everyone when i do some operation of shark, and i find that spark running for sometime, some

unread,

spark worker registration failed

hi, everyone when i do some operation of shark, and i find that spark running for sometime, some

8/18/13

8/16/13

Anybody running (working on) Spark on Windows?

Hey, I've been thinking about trying to get a Windows box running in the AMPLab Jenkin's

unread,

Anybody running (working on) Spark on Windows?

Hey, I've been thinking about trying to get a Windows box running in the AMPLab Jenkin's

8/16/13

8/13/13

Using newAPIHadoopRDD function

Hi, I am trying to use Spark's newAPIHadoopRDD function to read data from Cassandra database

unread,

Using newAPIHadoopRDD function

Hi, I am trying to use Spark's newAPIHadoopRDD function to read data from Cassandra database

8/13/13

Matei Zaharia, … Evan chan32

8/10/13

Discussion: Consolidating Spark's build system

Matei, According to the Akka / typesafe config developers, one is supposed to append all of the

unread,

Discussion: Consolidating Spark's build system

Matei, According to the Akka / typesafe config developers, one is supposed to append all of the

8/10/13

Matei Zaharia, … Josh Rosen8

8/9/13

Spark 0.8 branch

I think a change to Optional is good, so let's do that. @Evan -- documentation should definitely

unread,

Spark 0.8 branch

I think a change to Optional is good, so let's do that. @Evan -- documentation should definitely

8/9/13

Evan Chan, … Henry Saputra12

8/9/13

Spark Job Server

Sorry I meant separate module. On Fri, Aug 9, 2013 at 3:40 PM, Evan Chan <e...@ooyala.com> wrote:

unread,

Spark Job Server

Sorry I meant separate module. On Fri, Aug 9, 2013 at 3:40 PM, Evan Chan <e...@ooyala.com> wrote:

8/9/13

gustavs...@gmail.com, … Patrick Wendell11

8/9/13

Copy Spark 0.7 AMI to US West (Northern California), us-west-1

I think github might be down right now... On Fri, Aug 9, 2013 at 1:56 PM, Alessandro Gagliardi <

unread,

Copy Spark 0.7 AMI to US West (Northern California), us-west-1

I think github might be down right now... On Fri, Aug 9, 2013 at 1:56 PM, Alessandro Gagliardi <

8/9/13

moji...@gmail.com, … Reynold Xin7

8/8/13

compiling shark-0.8 from source code

Can you try add to the beginning of sbt/sbt file the following lines, and see what gets printed? echo

unread,

compiling shark-0.8 from source code

Can you try add to the beginning of sbt/sbt file the following lines, and see what gets printed? echo

8/8/13

8/8/13

Any plan to support Kafka 0.8 in Spark Streaming

Hi all and TD, Is there any plan to update Kafka to 0.8 for Spark Streaming, since 0.8 adds some new

unread,

Any plan to support Kafka 0.8 in Spark Streaming

Hi all and TD, Is there any plan to update Kafka to 0.8 for Spark Streaming, since 0.8 adds some new

8/8/13

Mayuresh Kunjir, Patrick Wendell2

8/7/13

Cluster scheduler exiting abruptly

Hey There, This is really odd... it's possible that this is just caused by a connectivity problem

unread,

Cluster scheduler exiting abruptly

Hey There, This is really odd... it's possible that this is just caused by a connectivity problem

8/7/13

Sathish Senathi, … Evan Chan3

8/7/13

Data Locality - How to force it to run only on the node where the data it available..STRICT NODE_LOCAL.

You can also use HadoopRDD with your own InputFormat, which assigns locality speciifcally to the

unread,

Data Locality - How to force it to run only on the node where the data it available..STRICT NODE_LOCAL.

You can also use HadoopRDD with your own InputFormat, which assigns locality speciifcally to the

8/7/13

Michael Schiff, … Matei Zaharia6

8/6/13

Thanks for pointing this out, Michael. My suggestion is also to add more tests to DistributedSuite

unread,

Thanks for pointing this out, Michael. My suggestion is also to add more tests to DistributedSuite

8/6/13

Selwyn McCracken, … Alessandro Gagliardi10

8/5/13

Copy Spark 0.7 AMI to AWS Europe region

Could you do the same for us-west-2 please? Thank you! Alessandro Gagliardi Data Scientist Path, Inc.

unread,

Copy Spark 0.7 AMI to AWS Europe region

Could you do the same for us-west-2 please? Thank you! Alessandro Gagliardi Data Scientist Path, Inc.

8/5/13

8/5/13

Jenkins comments on PRs

I'm setting up a Jenkins pull request builder for Shark (to parallel the one we have for Spark)

unread,

Jenkins comments on PRs

I'm setting up a Jenkins pull request builder for Shark (to parallel the one we have for Spark)

8/5/13

Josh Rosen, … Christopher Nguyen21

8/5/13

Does SparkEnv need to be thread-local?

I'll do a PR from our existing fix. -- Christopher T. Nguyen Co-founder & CEO, Adatao

unread,

Does SparkEnv need to be thread-local?

I'll do a PR from our existing fix. -- Christopher T. Nguyen Co-founder & CEO, Adatao

8/5/13

Konstantin Boudnik, Mark Hamstra8

8/3/13

Re: Looking into Maven build for spark

[Bcc: spark-de...@googlegroups.com] Guys, just wanted to close the loop on this. I have

unread,

Re: Looking into Maven build for spark

[Bcc: spark-de...@googlegroups.com] Guys, just wanted to close the loop on this. I have

8/3/13

7/31/13

The SparkBuild.scala should upgrade spray depency

HI There are some error occurred while I build spark-0.7.3 (sbt/sbt package) [error] unresolved

unread,

The SparkBuild.scala should upgrade spray depency

HI There are some error occurred while I build spark-0.7.3 (sbt/sbt package) [error] unresolved

7/31/13

Jerry Shao, … Thomas graves9

7/29/13

Multi-user support for Spark standalone mode

Hi Tom, Thanks for your replying. I agree with you that renew a token for long-run apps in Spark is

unread,

Multi-user support for Spark standalone mode

Hi Tom, Thanks for your replying. I agree with you that renew a token for long-run apps in Spark is

7/29/13

Evan Chan, Reynold Xin3

7/26/13

[job server] best strategy for inter-job metadata sharing?

Hi Reynold, Thanks for having a look. Yes, the job server isn't designed for streaming jobs.... I

unread,

[job server] best strategy for inter-job metadata sharing?

Hi Reynold, Thanks for having a look. Yes, the job server isn't designed for streaming jobs.... I

7/26/13

moji...@gmail.com, Wong Wong2

7/25/13

multi-user run shark on spark

please ref. https://groups.google.com/forum/#!topic/spark-developers/DDT7JycbcQM 在 2013年7月25日星期四UTC+8

unread,

multi-user run shark on spark

please ref. https://groups.google.com/forum/#!topic/spark-developers/DDT7JycbcQM 在 2013年7月25日星期四UTC+8

7/25/13

Konstantin Boudnik

7/24/13

a79f6077f0b3bc0110f6e8e15de3068f296f3b81 breaks the build

As per the blame report... 2013-07-08 16:07 Mark Hamstra 0b39d66 │ <dependency> 2013-07-08 16:

unread,

a79f6077f0b3bc0110f6e8e15de3068f296f3b81 breaks the build

As per the blame report... 2013-07-08 16:07 Mark Hamstra 0b39d66 │ <dependency> 2013-07-08 16:

7/24/13

7/22/13

AMP Camp 3 Big Data Bootcamp registration now open

Hey everyone, Join us for the third AMP Camp Big Data Bootcamp, which we will be hosting at UC

unread,

AMP Camp 3 Big Data Bootcamp registration now open

Hey everyone, Join us for the third AMP Camp Big Data Bootcamp, which we will be hosting at UC

7/22/13

Search

Clear search

Close search

Google apps

Main menu