problems with rotate

529 views
Skip to first unread message

erik

unread,
Nov 19, 2009, 4:12:44 PM11/19/09
to Thinking Sphinx
I can't find anyone with his problem...which is awesome.

I compiled Sphinx 0.9.8.1-id64-release like this
./configure --enable-id64

This is on a mac leopard.

The issue i'm having is with rotate. It doesn't matter if i do it
from the command line or through thinking_sphinx.

searchd starts, stops and indexes just fine.

The pid file is in my working_directory/log/searchd.test.pid and it is
correct and everyone can read it.

Right now it has : 8766
in it and nothing else

When I run /usr/local/bin/indexer --config /Users/erik/work/carwoo/
viper/config/test.sphinx.conf --rotate dealership_delta

it prints out this:

Sphinx 0.9.8.1-id64-release (r1533)
Copyright (c) 2001-2008, Andrew Aksyonoff

using config file '/Users/erik/work/carwoo/viper/config/
test.sphinx.conf'...
indexing index 'dealership_delta'...
collected 0 docs, 0.0 MB
collected 0 attr values
sorted 0.0 Mvalues, nan% done
total 0 docs, 0 bytes
total 0.016 sec, 0.00 bytes/sec, 0.00 docs/sec
WARNING: no process found by PID 12562.
WARNING: indices NOT rotated.

The PID is the wrong freaking number. I have searched for 12562 all
over and can not find it. It's using the exact same config file.

if i do a ps -aux | grep search i get:
erik 8766 0.0 0.0 604196 284 s002 S 12:49PM 0:00.06
searchd --pidfile --config /Users/erik/work/carwoo/viper_head/viper/
config/test.sphinx.conf

same config files and searchd is working just fine.


I HAVE NO IDEA WHERE THIS ROGUE PID FILE IS BUT THIS IS DRIVING ME
CRAZY!!!




ok, i feel better.

Any help would be greatly appreciated.

Erik

erik

unread,
Nov 19, 2009, 4:22:16 PM11/19/09
to Thinking Sphinx
Oh and if i use another config file like development.sphinx.conf it
complains about not pid file in the log directory called
searchd.development.pid. so it can read it just fine. all the
searchd commands are using pid_file variable just fine, but the
indexer is getting another pid from somewhere.

Erik

Pat Allan

unread,
Nov 25, 2009, 3:41:31 AM11/25/09
to thinkin...@googlegroups.com
Hi Erik

First things first - can you try compiling Sphinx without the --enable-
id64 flag, and see if that makes a difference? If that's definitely
the cause, then I'll try doing the same on my machine, see if I can
reproduce it.

Also, can you double-check that there are no other searchd instances
running on your machine?

I realise this email's a few days late - hopefully you've found a way
around the problem by now.

--
Pat
> --
>
> You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> To post to this group, send email to thinkin...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=
> .
>
>

Erik Landerholm

unread,
Nov 25, 2009, 1:01:19 PM11/25/09
to thinkin...@googlegroups.com
Pat-
  Thanks for the repsonse.  Sorry, I didn't respond back with the answer.

  You are correct.  Compiling with the id64 flag did it.

  I have a new laptop now with snow leopard and compiled it with the 64-bit architecture flags which I assume will also accomplish the same thing.  I think I threw in the id64 flag just for good measure.

  I can't remember where I finally found the answer...some blog probably.  But the jist is Sphinx multiples the ids by 4 or something like that.  So if you have an id up near 1 billion when it multiples it up it could go over the 2 ^32 maximum of an unsigned int and then skip those entries.

Thanks.
Erik

To unsubscribe from this group, send email to thinking-sphi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.





--
Erik Landerholm
CTO, CarWoo Inc.
er...@carwoo.com
503 317 2169

http://www.carwoo.com

Follow us on Twitter
http://www.twitter.com/carwoo

Pat Allan

unread,
Nov 25, 2009, 6:10:08 PM11/25/09
to thinkin...@googlegroups.com
Hi Eric

I've just compiled 0.9.9rc2 using --enable-id64, and it works nicely
with TS. From all reports I've heard, 0.9.9 is just as stable as
0.9.8, so I'd recommend upgrading unless you have some key reasons not
to.

Cheers

--
Pat

On 26/11/2009, at 5:01 AM, Erik Landerholm wrote:

> Pat-
> Thanks for the repsonse. Sorry, I didn't respond back with the
> answer.
>
> You are correct. Compiling with the id64 flag did it.
>
> I have a new laptop now with snow leopard and compiled it with the
> 64-bit architecture flags which I assume will also accomplish the
> same thing. I think I threw in the id64 flag just for good measure.
>
> I can't remember where I finally found the answer...some blog
> probably. But the jist is Sphinx multiples the ids by 4 or
> something like that. So if you have an id up near 1 billion when it
> multiples it up it could go over the 2 ^32 maximum of an unsigned
> int and then skip those entries.
>
> Thanks.
> Erik
>
> On Wed, Nov 25, 2009 at 12:41 AM, Pat Allan <pat@freelancing-
> For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en
> .
>
>
>
>
>
> --
> Erik Landerholm
> CTO, CarWoo Inc.
> er...@carwoo.com
> 503 317 2169
>
> http://www.carwoo.com
>
> Follow us on Twitter
> http://www.twitter.com/carwoo
>
> --
>
> You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> To post to this group, send email to thinkin...@googlegroups.com.
> To unsubscribe from this group, send email to thinking-sphi...@googlegroups.com
> .
> For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en
> .

Reply all
Reply to author
Forward
0 new messages