What is the best number for titan partitions? (0.5.3)

62 views
Skip to first unread message

Fisher

unread,
Mar 2, 2015, 2:25:42 PM3/2/15
to aureliu...@googlegroups.com

In a 5 billion edge graph, what is the best number for titan partitions?

Does it have to be equals to the cassandra token count?  256 is recommended for cassandra token count, so cluster.max-partitions should be 256, is it correct?


Thanks,

Dan LaRocque

unread,
Mar 4, 2015, 7:27:08 AM3/4/15
to aureliu...@googlegroups.com
Hi Fisher,

cluster.max-partitions should theoretically be greater than or equal to the number of physical nodes.  It currently must be less than or equal to 2^16.  It does not have to be equal to the Cassandra token count.

IIRC, cassandra.yaml's num_tokens is interpreted differently from Titan's cluster.max-partitions.  I think num_tokens specifies the number of tokens per machine.  cluster.max-partitions specifies the total number of partitions in the cluster (it's divided among all machines).

thanks,
Dan
--
You received this message because you are subscribed to the Google Groups "Aurelius" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aureliusgraph...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/aureliusgraphs/41af7f5e-5c6c-479d-8305-7fbd3d8c9c84%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages