what cause the exceed spark.akka.frameSize？

[fangzhen...@gmail.com]

I have set the spark.akka.frameSize to a larger value (25mb). and the size become bigger. But with  my code  running ,  my programme consume more ,it continues to fail with the error of  "exceed the maximum spark.akka.frameSize ".I want to known  what cause to consume the spark.akka.frameSize ?  in my code ,there is 

//            var Wdata = next_Qdata.zip(scoreAndLabels).sortBy(_._2._1,ascending = true).take(( itrnum).toInt).map(x => x._1)
//            next_data = sc.parallelize(Wdata)

[David Hall]

I accepted this because it wasn't spam, but this message doesn't belong in this forum. Try asking in a spark or akka forum or on stack overflow.

--
You received this message because you are subscribed to the Google Groups "Scala Breeze" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scala-breeze...@googlegroups.com.
To post to this group, send email to scala-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scala-breeze/23589dd4-3d80-4696-89ce-a47425a3541e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.