Won't crawl pass first page...

59 views
Skip to first unread message

Marcello Jaspan

unread,
Oct 7, 2014, 1:03:18 PM10/7/14
to gsitec...@googlegroups.com
Using Surface Pro / Win 8.1.

It seems to find the first page, but it goes not further. What should I try? Where can I find issues, logs or more info?

Thx!

webado

unread,
Oct 7, 2014, 8:18:34 PM10/7/14
to gsitec...@googlegroups.com
For starters make sure you installed the program and are executing it as administrator.

Then when you want to start a crawl make sure you have the correct canonical form and make sure your navigation always stays on that.

Make sure your robots.txt file doesn't block robots. Also make sure your homepage doesn't have a robots meta tag that specifies nofollow.
Reply all
Reply to author
Forward
0 new messages