Cloudsearch Help - reddit-dev

The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Message from discussion Cloudsearch Help
Date: Wed, 7 Nov 2012 16:28:23 -0800 (PST)
From: tr <ril...@gmail.com>
To: reddit-dev@googlegroups.com
Message-Id: <754d1982-20e9-4360-a5e1-b53cb8cdf147@googlegroups.com>
In-Reply-To: <CAGcL2v0e4uTLQTtfLJJzwcffrT65KNQ=2MY_-t80p4Fbb7L37A@mail.gmail.com>
References: <bf22a095-e38d-4569-b515-0bd8d5d15c12@googlegroups.com>
 <CAGcL2v2oOjA=d0g6Z2GfbhpjOHdDy55fvOpCtV14ay2oWkOyig@mail.gmail.com>
 <9c1c8620-a1b4-46e0-8115-4f13e60ef597@googlegroups.com> <CAGcL2v1oet4d22yV=N0T=jbANvQazKQ2Tqk6aKaB4JgJ==QfjQ@mail.gmail.com>
 <c799ef78-162f-4875-a1c8-e6c17df7cc4d@googlegroups.com> <CAGcL2v3e=s4LLdq4bJWZ_8vW0bsk4u6hG2N__=TfyNkEPRdmNg@mail.gmail.com>
 <835dc6a4-875e-4a03-90bd-01869a824a5e@googlegroups.com>
 <CAGcL2v0e4uTLQTtfLJJzwcffrT65KNQ=2MY_-t80p4Fbb7L37A@mail.gmail.com>
Subject: Re: [reddit-dev] Cloudsearch Help
MIME-Version: 1.0
Content-Type: multipart/mixed; 
	boundary="----=_Part_812_12659814.1352334503709"

------=_Part_812_12659814.1352334503709
Content-Type: multipart/alternative; 
	boundary="----=_Part_813_27567147.1352334503716"

------=_Part_813_27567147.1352334503716
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

initctl list shows:

reddit-consumer-cloudsearch_q (1) start/running, process 28212

So it appears to be running as it should.  I'm not sure what to even look 
for as far as logs go.  A find for *log* doesn't really come up with 
anything significant, and I don't see anything significant in syslog either.



On Wednesday, November 7, 2012 2:30:30 PM UTC-5, Keith Mitchell wrote:
>
> Yup, sounds like the q_proc. If you're certain it's running ("sudo initctl 
> list | grep reddit" should help with that, I think) then the log is the 
> next important bit.
>
> On Tue, Nov 6, 2012 at 12:38 PM, tr <ril...@gmail.com <javascript:>>wrote:
>
>> Thanks - running manually successfully processed, and I now see documents 
>> in Cloudsearch.  Searching are returning successfully.
>>
>> So it seems the issue is with the q proc?  I'll poke around syslog and 
>> see if I see anything, otherwise if you have any suggestions let me know.  
>>
>> Thanks for the help thus far.
>>
>>
>> On Tuesday, November 6, 2012 1:27:42 PM UTC-5, Keith Mitchell wrote:
>>>
>>> You can get a python shell for running reddit code in the proper context 
>>> by cd'ing to {reddit}/r2, then running "paster shell your_ini_file.ini".
>>>
>>> From there, you can do:
>>>
>>> import r2.lib.cloudsearch as cs
>>> cs.rebuild_link_index()
>>>
>>> (And of course, you can import anything else from the reddit code base, 
>>> inspect objects, load things from the database, etc.)
>>>
>>> I'm not 100% sure, but I think by default the q procs will write to 
>>> syslog.
>>>
>>>
>>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "reddit-dev" group.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msg/reddit-dev/-/rPPK0gKqn5AJ.
>>
>> To post to this group, send email to reddi...@googlegroups.com<javascript:>
>> .
>> To unsubscribe from this group, send email to 
>> reddit-dev+...@googlegroups.com <javascript:>.
>> For more options, visit this group at 
>> http://groups.google.com/group/reddit-dev?hl=en.
>>
>
>
------=_Part_813_27567147.1352334503716
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit

initctl list shows:<br><br>reddit-consumer-cloudsearch_q (1) start/running, process 28212<br><br>So it appears to be running as it should.&nbsp; I'm not sure what to even look for as far as logs go.&nbsp; A find for *log* doesn't really come up with anything significant, and I don't see anything significant in syslog either.<br><br><br><br>On Wednesday, November 7, 2012 2:30:30 PM UTC-5, Keith Mitchell wrote:<blockquote class="gmail_quote" style="margin: 0;margin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;">Yup, sounds like the q_proc. If you're certain it's running ("sudo initctl list | grep reddit" should help with that, I think) then the log is the next important bit.<br><br><div class="gmail_quote">On Tue, Nov 6, 2012 at 12:38 PM, tr <span dir="ltr">&lt;<a href="javascript:" target="_blank" gdf-obfuscated-mailto="n6fH1OrWyGkJ">ril...@gmail.com</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Thanks - running manually successfully processed, and I now see documents in Cloudsearch.&nbsp; Searching are returning successfully.<br>

<br>So it seems the issue is with the q proc?&nbsp; I'll poke around syslog and see if I see anything, otherwise if you have any suggestions let me know.&nbsp; <br><br>Thanks for the help thus far.<div><br><br>On Tuesday, November 6, 2012 1:27:42 PM UTC-5, Keith Mitchell wrote:<blockquote class="gmail_quote" style="margin:0;margin-left:0.8ex;border-left:1px #ccc solid;padding-left:1ex">

You can get a python shell for running reddit code in the proper context by cd'ing to {reddit}/r2, then running "paster shell your_ini_file.ini".<br><br>From there, you can do:<br><br>import r2.lib.cloudsearch as cs<br>



cs.rebuild_link_index()<br><br>(And of course, you can import anything else from the reddit code base, inspect objects, load things from the database, etc.)<br><br>I'm not 100% sure, but I think by default the q procs will write to syslog.<br>



<br><br>
</blockquote>

<p></p></div><div>

-- <br>
You received this message because you are subscribed to the Google Groups "reddit-dev" group.<br></div>
To view this discussion on the web visit <a href="https://groups.google.com/d/msg/reddit-dev/-/rPPK0gKqn5AJ" target="_blank">https://groups.google.com/d/<wbr>msg/reddit-dev/-/rPPK0gKqn5AJ</a>.<div><div>

<br> 
To post to this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="n6fH1OrWyGkJ">reddi...@googlegroups.com</a>.<br>
To unsubscribe from this group, send email to <a href="javascript:" target="_blank" gdf-obfuscated-mailto="n6fH1OrWyGkJ">reddit-dev+...@<wbr>googlegroups.com</a>.<br>

For more options, visit this group at <a href="http://groups.google.com/group/reddit-dev?hl=en" target="_blank">http://groups.google.com/<wbr>group/reddit-dev?hl=en</a>.<br>


</div></div></blockquote></div><br>
</blockquote>
------=_Part_813_27567147.1352334503716--

------=_Part_812_12659814.1352334503709--
Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
Account Options
