Download common crawl (42B token) corpus

[matt.si...@gmail.com]

Hello, where can I download the full 42B token common crawl corpus?

Thanks,

Matt

[Bob van Luijt]

Corpus: http://commoncrawl.org/the-data/get-started/

[prstev...@gmail.com]

Which of the versions on this page is the version that was used to generate the GloVe vectors available for download on this page? https://nlp.stanford.edu/projects/glove/

Thanks. 

[n8rro...@gmail.com]

Did you all ever find an answer to this question? I'm looking for the 840B token Common Crawl (a 2.03 GB download according to the GloVe website). The Common Crawl website that Bob van Lujit posted has many datasets available, but they all seem to be much bigger (on the order of 50 TB compressed). I just want to find the same corpus that GloVe used. And hints?