Commoncrawl index page down?

[Yuheng Du]

Hi everyone, 

I was trying to use the index page of commoncrawl to retrieve the needed warc files for a text analysis task, but I found that the index page is down now?

http://index.commoncrawl.org/

can anyone help?

Thanks!

best,

Yuheng

[Sebastian Nagel]

Hi Yuheng,

you're right. That's fixed now.

Thanks,
Sebastian

> --
> You received this message because you are subscribed to the Google Groups "Common Crawl" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> common-crawl...@googlegroups.com <mailto:common-crawl...@googlegroups.com>.
> To post to this group, send email to common...@googlegroups.com
> <mailto:common...@googlegroups.com>.
> Visit this group at https://groups.google.com/group/common-crawl.
> For more options, visit https://groups.google.com/d/optout.

[Lakshmi Narasimhan]

Looks like the index page is down today as well. Is there any scheduled downtime?

On Monday, April 24, 2017 at 1:12:42 PM UTC+5:30, Sebastian Nagel wrote:

Hi Yuheng,

you're right. That's fixed now.

Thanks,
Sebastian

On 04/24/2017 03:57 AM, Yuheng Du wrote:
> Hi everyone,
>
> I was trying to use the index page of commoncrawl to retrieve the needed warc files for a text
> analysis task, but I found that the index page is down now?
>
> http://index.commoncrawl.org/
>
> can anyone help?
>
> Thanks!
>
> best,
> Yuheng
>
> --
> You received this message because you are subscribed to the Google Groups "Common Crawl" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to

> common-crawl...@googlegroups.com <mailto:common-crawl+unsub...@googlegroups.com>.

[Sebastian Nagel]

Hi,

thanks for reporting. It's fixed now.

> Is there any scheduled downtime?

No. The simple truth is: it's often too heavily loaded and the TCP stack runs out of memory.
During the next weeks I hope to move the index server to a more powerful machine.

Thanks,
Sebastian

On 05/10/2017 05:01 PM, Lakshmi Narasimhan wrote:
> Looks like the index page is down today as well. Is there any scheduled downtime?
>
> On Monday, April 24, 2017 at 1:12:42 PM UTC+5:30, Sebastian Nagel wrote:
>
> Hi Yuheng,
>
> you're right. That's fixed now.
>
> Thanks,
> Sebastian
>
> On 04/24/2017 03:57 AM, Yuheng Du wrote:
> > Hi everyone,
> >
> > I was trying to use the index page of commoncrawl to retrieve the needed warc files for a text
> > analysis task, but I found that the index page is down now?
> >
> > http://index.commoncrawl.org/
> >
> > can anyone help?
> >
> > Thanks!
> >
> > best,
> > Yuheng
> >
> > --
> > You received this message because you are subscribed to the Google Groups "Common Crawl" group.
> > To unsubscribe from this group and stop receiving emails from it, send an email to

> > common-crawl...@googlegroups.com <javascript:>
> <mailto:common-crawl...@googlegroups.com <javascript:>>.
> > To post to this group, send email to common...@googlegroups.com <javascript:>
> > <mailto:common...@googlegroups.com <javascript:>>.

> > Visit this group at https://groups.google.com/group/common-crawl

> <https://groups.google.com/group/common-crawl>.
> > For more options, visit https://groups.google.com/d/optout <https://groups.google.com/d/optout>.

>
> --
> You received this message because you are subscribed to the Google Groups "Common Crawl" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to

> common-crawl...@googlegroups.com <mailto:common-crawl...@googlegroups.com>.