K-means cluster membership

[Vinodh Krishnaraju]

Hi.

I have used the sample k-means code given at 

https://github.com/RevolutionAnalytics/rmr2/blob/master/docs/tutorial.md

It ran correctly and returning me the cluster centers. But how do I determine the cluster association as to which cluster a point belongs to. 

I understand this has to be done somewhere in the reducer code. Can someone help me on this.

[Antonio Piccolboni]

I think you will need an additional job, as the reducer has to return the centers and the centers are then loaded into memory. The association with the points in the data set will take one row per point and won't fit main memory. I am guessing here, you know the data sizes at play here. So you will need to do a final pass, map only, where you calculate and return the associations. In the java API there is a multiple output feature, but we can't access it from R AFAIK so I don't think there's another way,

Antonio

--
post: rha...@googlegroups.com ||
unsubscribe: rhadoop+u...@googlegroups.com ||
web: https://groups.google.com/d/forum/rhadoop?hl=en-US
---
You received this message because you are subscribed to the Google Groups "RHadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.