ZippedPartition

50 views
Skip to first unread message

Arindam Paul

unread,
Mar 4, 2013, 11:07:40 PM3/4/13
to spark...@googlegroups.com
I was going through the source code and it appears to me that there is a typo at ZippedRDD.scala
The line is highlighted below.

private[spark] class ZippedPartition[T: ClassManifest, U: ClassManifest](
    idx: Int,
    @transient rdd1: RDD[T],
    @transient rdd2: RDD[U]
  ) extends Partition {

  var split1 = rdd1.partitions(idx)
  var split2 = rdd1.partitions(idx)
  override val index: Int = idx

  def splits = (split1, split2)
...
Reply all
Reply to author
Forward
0 new messages