Evaluation

[Christian]

You write 'Edit: For any sub mission, I will post for a random subset
of vocab words each entry’s 10 related terms. I’ll then ask people to
vote blind. This is a reasonable technique for quantitative
evaluation.".
This presumes that the people who vote are representative of the
semantics encoded in your corpus. If your corpus is of general topics
then a reasonable audience probably will still achieve a good result
though.

[Joseph Turian]

> This presumes that the people who vote are representative of the
> semantics encoded in your corpus. If your corpus is of general topics
> then a reasonable audience probably will still achieve a good result
> though.

True, but this is a general English usage corpus.