Adding unique /sequential row id into a dlist

20 views
Skip to first unread message

ydalal

unread,
Jun 9, 2014, 8:24:49 PM6/9/14
to scoobi...@googlegroups.com
Hi Folks,


I need help in adding row id to a dlist, with unique rowids.

I tried adding row ids to a dlist. And as expected the ids are not unique, as dlist is distributed I see that by using a global scope varibles and incrementing and appending it to the dlist in flatMap doesn't give correct answer.


Please let me know if you encountered similar isssue or can provide some pointers.

Thanks !

Eric Torreborre

unread,
Jun 10, 2014, 2:18:19 AM6/10/14
to scoobi...@googlegroups.com
Hi,

There is a zipWith method on DList which should do what you want. This task will incur 2 map-reduce job to complete.

Eric.
Reply all
Reply to author
Forward
Message has been deleted
0 new messages