Word frequency count from common crawl

[Etesh Mangray]

Wondering if anyone has an already existing database or know of one that has word count frequency?  Would save us a week of dev time.  thanks in advance for any leads or advice.

[John Wiseman]

If you don't need recent data, and you don't need counts that came from Common Crawl specifically, then there's the Google n-gram data from 2006: http://googleresearch.blogspot.com/2006/08/all-our-n-gram-are-belong-to-you.html

On Thu, Oct 10, 2013 at 4:29 PM, Etesh Mangray <etesh....@gmail.com> wrote:

Wondering if anyone has an already existing database or know of one that has word count frequency?  Would save us a week of dev time.  thanks in advance for any leads or advice.

--
You received this message because you are subscribed to the Google Groups "Common Crawl" group.
To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl...@googlegroups.com.
To post to this group, send email to common...@googlegroups.com.
Visit this group at http://groups.google.com/group/common-crawl.
For more options, visit https://groups.google.com/groups/opt_out.

[Etesh Mangray]

Thanks John - looks like the google n-grams corpus is now available via license for $24K from LDC.

[harisankar h]

They can be downloaded directly from here: http://storage.googleapis.com/books/ngrams/books/datasetsv2.html

Sincerely,
Harisankar H

--

[Etesh Mangray]

thanks for the link.

--
You received this message because you are subscribed to a topic in the Google Groups "Common Crawl" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/common-crawl/ZaLDoLLk84E/unsubscribe.
To unsubscribe from this group and all its topics, send an email to common-crawl...@googlegroups.com.

[Ryan Stout]

Etesh,

   Did you end up making this data set?  I've been looking to get a web n-gram data set.

Thanks,

   Ryan