Confused

4 views
Skip to first unread message

dunn

unread,
Dec 28, 2009, 12:01:09 PM12/28/09
to SOFTplus GSiteCrawler, dunn...@gmail.com
Hello All,

My website is not being crawled i tried for almost 10 hrs total and i
just don't understand why it's not working.

I am using Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.6)
Gecko/20091201 Firefox/3.5.6

I went back to the very basic robots.txt as i was having trouble
confirming if my robots txt file was any good on site would tell me
yes the other site would tell me errors. There's like a double
standard when it come to robots txt However my current txt is

User-agent: *
Disallow:

The program picked it up no probs there everything was just automatic
never manual adjusted anything it detected my server as a linux/unix
based server & Remove HTML comments whatever that is. I'm thinking of
uninstalling the program and restarting.

Give me some message about performing a rollback.. I am so so
confused i don't know what to do

Any help would like a fresh start

Thanks
Dunn

webado

unread,
Dec 28, 2009, 5:37:06 PM12/28/09
to SOFTplus GSiteCrawler
What OS are you running under? Widnows XP/ WIndows Vista? WIndows 7?

If using Vista, please refer to the installaiton notes for Vista. I
think they also apply to WIndows 7.
http://groups.google.com/group/gsitecrawler/web/gsc-v1-23-and-vista?hl=en

In all cases you must be logged in as adminstrator on your PC when you
install and when you run the program.

webado

unread,
Dec 29, 2009, 10:11:24 AM12/29/09
to SOFTplus GSiteCrawler
Discussion continued at:
http://groups.google.com/group/gsitecrawler/browse_thread/thread/7b3d2631b3fa53f4#

On Dec 28, 5:37 pm, webado <web...@gmail.com> wrote:
> What OS are you running under? Widnows XP/ WIndows Vista? WIndows 7?
>
> If using Vista, please refer to the installaiton notes for Vista. I

> think they also apply to WIndows 7.http://groups.google.com/group/gsitecrawler/web/gsc-v1-23-and-vista?h...


>
> In all cases you must be logged in as adminstrator on your PC when you
> install and when you run the program.
>
> On Dec 28, 12:01 pm, dunn <dunn1...@gmail.com> wrote:
>
>
>
> > Hello All,
>
> > My website is not being crawled i tried for almost 10 hrs total and i
> > just don't understand why it's not working.
>
> > I am using Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.1.6)
> > Gecko/20091201 Firefox/3.5.6
>
> > I went back to the very basic robots.txt as i was having trouble
> > confirming if my robots txt file was any good on site would tell me
> > yes the other site would tell me errors. There's like a double
> > standard when it come to robots txt However my current txt is
>
> > User-agent: *
> > Disallow:
>
> > The program picked it up no probs there everything was just automatic
> > never manual adjusted anything it detected my server as a linux/unix
> > based server & Remove HTML comments whatever that is. I'm thinking of
> > uninstalling the program and restarting.
>
> > Give me some message about performing a rollback..    I am so so
> > confused i don't know what to do
>
> > Any help would like a fresh start
>
> > Thanks

> > Dunn- Hide quoted text -
>
> - Show quoted text -

Reply all
Reply to author
Forward
0 new messages