Config not aware of data saved in the same execution?

[Rodrigo García]

Hi to all.

I have kind of a problem when trying to test thinking sphinx in my
Rails application. I don't want to mock it because I want to be sure
config and search options are working the desired way.

- Ruby: 1.8.7 (i686-darwin10.6.0); Rails: 2.3.11; Thinking Sphinx: 1.4.3

I only index a join-table model:

class AffiliatesAddress < ActiveRecord::Base

# DB relations:
belongs_to :address
belongs_to :affiliate, :polymorphic => true, :dependent => :delete

# Thinking-sphinx configuration
define_index do
...
has affiliate.direct, :as => :formato_direct, :type => :boolean
has affiliate.papel, :as => :formato_papel, :type => :boolean
has 'CRC32(affiliate_type)', :as => :affiliate_type, :type => :integer
end

end

To setup sphinx I need a relation for every affiliate type in DB,
which is ok. The problem is that if I save those relations in the same
execution I configure thinking sphinx, indexing is not aware of the
data in DB.

For example: I created a rake task as a per-requisite for
thinking-sphinx:index. The first time i run index, with an empty DB,
the config process doesn´t create the right SQL (it does without
polymorphic relations). But if I run index one more time, this time
with the relations remaining from previous execution, then all goes
ok. The same if I save the relations in a before(:all) block from
rspec. I am pretty sure relations are successfully saved before
calling indexing/config process.

In local, I generated the config first and then tweaked the tests to
avoid config again when DB is empty. But it's not a good solution for
the integration server or to share with the other team members.

Am I doing something wrong (other than my English)? some ideas?

Thanks for your time.

--
Rodrigo García Suárez

[Pat Allan]

Hi Rodrigo

It looks like you're aware that TS requires data for polymorphic joins to index them correctly... so I'm not entirely sure what's going wrong here.

Are you using transactions for your tests? Because Sphinx can't operate with those. Also, are you using ThinkingSphinx::Test? I highly recommend you do, as you shouldn't need to use any of the TS rake tasks from within your tests...

In particular:
ThinkingSphinx::Test.index 'affiliates_address_core'

More info is here:
http://freelancing-god.github.com/ts/en/testing.html#functional

Let me know if I'm not understanding things quite right, or you get stuck with something else.

Cheers

--
Pat

> --
> You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group.
> To post to this group, send email to thinkin...@googlegroups.com.
> To unsubscribe from this group, send email to thinking-sphi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.
>

[rochgs]

Hi again.

First, thanks for your quick reply and sorry about the delay with
mine. An insane week last one.

On 12 mar, 08:07, Pat Allan <p...@freelancing-gods.com> wrote:

> Are you using transactions for your tests? Because Sphinx can't operate with those. Also, are you using ThinkingSphinx::Test? I highly recommend you do, as you shouldn't need to use any of the TS rake tasks from within your tests...
>
> In particular:
>   ThinkingSphinx::Test.index 'affiliates_address_core'

I am aware of the limitations with transactions and of
ThinkingSphinx::Test. I am going to try a little example with some
code to explain myself. I am using has_many_polymorphs and Rspec with
Steak so I have a before(:each) block like this:

before(:each) do
# DB is empty here.
Affiliate1.create.addresses << Address.create
Affiliate2.create.addresses << Address.create
# ... And so on until all needed relations are in DB. I ensured with
debugger.
ThinkingSphinx::Test.index
ThinkingSphinx::Test.start
end

Then I run the examples with "use_transactional_fixtures = false". All
test upon Thinking Sphinx fail (they don't find what is expected) and
when I look at "config/test.sphinx.conf", the tables from the
polymorphic relation don't appear in the sql_query. It only shows the
join with the addresses table (the one for the non-polymorphic
association).

Hope this time I have come with a better explanation :)


--
Rodrigo García Suárez

[Pat Allan]

Hi Rodrigo

I think the issue here is that the configuration file isn't rewritten when you index. Try adding the following after creating your addresses:

ThinkingSphinx::Test.config.build

Cheers

--
Pat

[rochgs]

Hi Pat.

On 22 mar, 14:35, Pat Allan <p...@freelancing-gods.com> wrote:

> I think the issue here is that the configuration file isn't rewritten when you index. Try adding the following after creating your addresses:
>
>   ThinkingSphinx::Test.config.build

I know configuration is been rewritten because if I generate the right
one before the tests (saving the models manually and then running rake
thinking_spinx:index RAILS_ENV=test) when I run the test the file is
rewritten again without the polymorphic tables in the sql query.

Still I have try your suggestion and it didn't work.

[Pat Allan]

Hi Rodrigo

Can you share the code you've got in your before(:each) block?

--
Pat

[rochgs]

Hi Pat.

On 3 abr, 07:42, Pat Allan <p...@freelancing-gods.com> wrote:

> Can you share the code you've got in your before(:each) block?

Sure thing:

before(:all) do
8.times {TicketRestaurant.make.addresses <<
Address.make(:poblacion => 'Barcelona')}
@ticket_restaurant = TicketRestaurant.make(:nombre => 'restaurante
con ticket', :tipo_cocina => 'tipo cocina')
@ticket_restaurant.addresses << Address.make()
@card_restaurant = CardRestaurant.make(:nombre => 'restaurante de
tarjeta', :tipo_cocina => 'tipo cocina')
@card_restaurant.addresses << Address.make()
@direct_kindergarten = Kindergarten.make(:nombre => 'guarderia
acceso direct', :direct => true, :papel => false)
@direct_kindergarten.addresses << Address.make()
@papel_kindergarten = Kindergarten.make(:nombre => 'guarderia con
ticket', :direct => false, :papel => true)
@papel_kindergarten.addresses << Address.make()
@compliment = ComplimentsAffiliate.make(:nombre => 'afiliado a
compliments',:tipo => 'tipo establecimiento')
@compliment.addresses << Address.make
3.times {ComplimentsAffiliate.make.addresses << Address.make}
ThinkingSphinx::Test.index
ThinkingSphinx::Test.start
# No queremos enviar peticiones de prueba a Google:
geo_results = mock('geo_results')
geo_results.stub!('status').and_return(Geocoding::GEO_SUCCESS)
geo_results.stub!('first').and_return(GLatLng.new([1,1]))
Geocoding.stub!('get').and_return(geo_results)
end

[Pat Allan]

Hi Rodrigo

Maybe you've tried this already and I'm misunderstanding earlier emails, but what happens if you put ThinkingSphinx::Test.config.build above the ThinkingSphinx::Test.index line:

# ... creating objects
3.times { ComplimentsAffiliate.make.addresses << Address.make }
ThinkingSphinx::Test.config.build
ThinkingSphinx::Test.index
ThinkingSphinx::Test.start
# stubbing objects

--
Pat

[rochgs]

Hi Pat.

Sorry for the delay in my replies.

On 6 abr, 23:58, Pat Allan <p...@freelancing-gods.com> wrote:

> Maybe you've tried this already and I'm misunderstanding earlier emails, but what happens if you put ThinkingSphinx::Test.config.build above the ThinkingSphinx::Test.index line:

This is what i tried this time. First, I regenerated the test DB and
deleted config/test.sphinx.conf. Next, I ran the tests with the code
you suggest in the before(:all) block. Then I looked into the test DB
and config/test.sphinx.conf. All associations are successfully saved
into DB, and test.sphinx.conf has been created. But the sql_query
still lacks the associated models (only "addresses" and
"affilliates_addresses" are joined).