Message from discussion
crawler idle
MIME-Version: 1.0
Received: by 10.151.141.8 with SMTP id t8mr402502ybn.6.1243251803075; Mon, 25
May 2009 04:43:23 -0700 (PDT)
Date: Mon, 25 May 2009 04:43:23 -0700 (PDT)
In-Reply-To: <34775fab-28c3-4893-add5-e69b6138d313@m39g2000yqc.googlegroups.com>
X-IP: 72.0.207.229
References: <34775fab-28c3-4893-add5-e69b6138d313@m39g2000yqc.googlegroups.com>
User-Agent: G2/1.0
X-HTTP-UserAgent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB6;
.NET CLR 1.1.4322; .NET CLR 2.0.50727),gzip(gfe),gzip(gfe)
Message-ID: <84e6b9c9-d536-4f61-a741-2cd3a410a715@o30g2000vbc.googlegroups.com>
Subject: Re: crawler idle
From: webado2 <web...@gmail.com>
To: SOFTplus GSiteCrawler <gsitecrawler@googlegroups.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
First of all if your computer runs Vista then check the Vista
instructions:
http://groups.google.com/group/gsitecrawler/web/gsc-v1-23-and-vista?hl=3Den
The when you request a crawl use the down arrow next to the button Re-
crawl and pikc This site.
Give it plenty of time to cawl, your site is big and/or slow for
crawlers (dont' knwo whihc, only tested a bit and seems to take long).
If your site has any redirecittions on it as it's being crawled that's
going to cause problems.
You can crawl your site using Xenu from
http://home.snafu.de/tilman/xenulink.html
and see if there are no errors (404, redirections, etc) during
navigation. These will need to be fixed before you can hope to build a
sitemap using Gsietcrawler or any other tool.
On May 21, 4:34=A0pm, prodigy2006 <adever...@gmail.com> wrote:
> I'd like to make a sitemap but I can't seem to get the site crawled
> with the program, other than robots.txt, all I get in URL list is one
> URL (the main url).www.mediaportal.hr
>
> I read on this a post with a similar problem on this board but it
> doesn't help solve the problem.
>
> I set up the program through it's wizard but it doesnt seem to crawl