JavaScript redirect

[QC Dev]

Hi,

What happens if a website has a JavaScript redirect? For example,  the page http://example.com/ has a javascript code that redirects the user to http://example.com/home

Is the common crawl bot capable of detecting such redirects and follow them correctly?

Thanks!

[Sebastian Nagel]

Hi,

good question!

Currently and up to now, the crawler does not interpret JavaScript and is then not redirected.

There is a chance that the link is extracted and followed later if
- if the redirect URL is defined in the JavaScript code embedded in the
HTML page
- or if the URL is found as link somewhere else

If not the crawler will never visit the redirect target.

Best,
Sebastian

> --
> You received this message because you are subscribed to the Google Groups "Common Crawl" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to common-crawl...@googlegroups.com
> <mailto:common-crawl...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/common-crawl/caa2cabb-cf39-4cef-b9f0-4b628016abc0n%40googlegroups.com
> <https://groups.google.com/d/msgid/common-crawl/caa2cabb-cf39-4cef-b9f0-4b628016abc0n%40googlegroups.com?utm_medium=email&utm_source=footer>.