Re: [GSiteCrawler] Digest for gsitecrawler@googlegroups.com - 2 updates in 1 topic
25 views
Skip to first unread message
Marcello Jaspan
Oct 8, 2014, 5:05:20 PM10/8/14
to gsitec...@googlegroups.com
Thank you. That did the trick!
On Wed, Oct 8, 2014 at 4:46 AM, <gsitec...@googlegroups.com> wrote:
- Won't crawl pass first page... - 2 Updates
Marcello Jaspan <mja...@gmail.com>: Oct 07 10:03AM -0700
Using Surface Pro / Win 8.1.
It seems to find the first page, but it goes not further. What should I
try? Where can I find issues, logs or more info?
Thx!
webado <web...@gmail.com>: Oct 07 05:18PM -0700
For starters make sure you installed the program and are executing it as
administrator.
Then when you want to start a crawl make sure you have the correct
canonical form and make sure your navigation always stays on that.
Make sure your robots.txt file doesn't block robots. Also make sure your
homepage doesn't have a robots meta tag that specifies nofollow.
On Tuesday, October 7, 2014 1:03:18 PM UTC-4, Marcello Jaspan wrote:
You received this digest because you're subscribed to updates for this group. You can change your settings on the group membership page.
To unsubscribe from this group and stop receiving emails from it send an email to gsitecrawler...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages