NPE while reading broadcast variable.

[Archit Thakur]

Hi,

I am getting NPE while I access broadcast variable.

I created an object:

object ClusterVariableEnumeration {
 
  var CURRENT_EXECUTION: org.apache.spark.broadcast.Broadcast[Any] = null.asInstanceOf[org.apache.spark.broadcast.Broadcast[Any]];
}

and then after creating SparkContext, I did ClusterVariableEnumeration.CURRENT_EXECUTION = sc.broadcast("value")

and then in map function When I tried to access it it gave me NPE. Idea?

Thanks and Regards,
Archit Thakur.

[Archit Thakur]

Accessed it:

val CURRENT_EXECUTING = ClusterVariableEnumeration.CURRENT_EXECUTION.value.asInstanceOf[String]

[Archit Thakur]

I am still getting it. I googled and found a similar open problem on stackoverflow: http://stackoverflow.com/questions/17794664/accumulator-fails-on-cluster-works-locally.

Thx, Archit_Thakur.