RE: [Blacklight-development] Blacklight example application with remote solr cloud server

309 views
Skip to first unread message

Sean Hannan

unread,
Apr 25, 2013, 11:02:02 AM4/25/13
to blacklight-...@googlegroups.com
Sure, it's possible. Ideally, the remote Solr server should have a similar solrconfig.xml so that everything lines up.

Just open up (or create, if it's not there) a /config/solr.yml file and add (or change) the lines:

development:

to whatever the remote server & solr URL are.

-Sean

From: blacklight-...@googlegroups.com [blacklight-...@googlegroups.com] on behalf of Aakash [javaj2ee...@gmail.com]
Sent: Thursday, April 25, 2013 10:19 AM
To: blacklight-...@googlegroups.com
Subject: [Blacklight-development] Blacklight example application with remote solr cloud server

Hi,
I am able to run balcklight example on my local windows machine. I want to get data from remote solr cloud server to display values from there in the same format as example application.
Please let me know if its possible or not, if it is where should I look into make changes.

Just to mention I am very new to RoR, still will try to figure out if I need to know something specific to RoR (Ruby on Rails)

Thanks

--
You received this message because you are subscribed to the Google Groups "Blacklight Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blacklight-develo...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Aakash

unread,
Apr 25, 2013, 2:31:40 PM4/25/13
to blacklight-...@googlegroups.com, sha...@jhu.edu
Thanks Sean !


Message has been deleted

Aakash

unread,
Apr 25, 2013, 2:47:39 PM4/25/13
to blacklight-...@googlegroups.com, sha...@jhu.edu
Hi Sean,
after making changes to specified file I am getting below error, can you please suggest me where to look into or how can I resolve this?

RSolr::Error::Http in CatalogController#index 

RSolr::Error::Http - 404 Not Found
Error: <html><head><title>Apache Tomcat/7.0.37 - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 404 - /solr/select</h1><HR size="1" noshade="noshade"><p><b>type</b> Status report</p><p><b>message</b> <u>/solr/select</u></p><p><b>description</b> <u>The requested resource is not available.</u></p><HR size="1" noshade="noshade"><h3>Apache Tomcat/7.0.37</h3></body></html>

Thanks,

Justin Coyne

unread,
Apr 25, 2013, 4:12:41 PM4/25/13
to Blacklight Development
Either solr isn't running at the URL you've specified or your solrconfig.xml doesn't have theses lines in it:

https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/blacklight-core/conf/solrconfig.xml#L37-L39

Can you send us the link to the solrconfig.xml you are using?

-Justin


--

Chris F.

unread,
Apr 25, 2013, 5:27:10 PM4/25/13
to blacklight-...@googlegroups.com


Hi,

I actually do the same thing with my instance, as it just seems easier to develop against our production solr instance, since it allows me to catch any edge cases of material that might have been indexed in a way I wasn't expecting. Also, in production I've found it much better to have Solr on a different machine than my app, since updates to the index can cause a performance hit on the app.   

But one problem is that most cloud-based Solr-as-a-service providers I've seen don't allow you to edit you config XML (which blacklight requires), so you'll probably have to have Solr running on a  VM.

I've recently switch to using Digital Ocean and am very happy. It's a really nice service and their VMs run on SSD drives, which is very good for Lucene indexing. And the cost is much,much cheaper than running a EC2 instance. I actually have the feeling that I could easily move the app off Heroku and have it and solr on the same VM, since the SSD drive probably limits hit seen in the update process.  

The catch is you'll want to firewall Solr ( at the very least in the /update and /admin ) paths to only accept request from your own clients. It's also a good idea to require authentication to add another layer of security, which you can read about here => http://wiki.apache.org/solr/SolrSecurity .

I'm working on a blog post about a Chef recipe I use to deploy to DO...when I get around to finish it, I'll post it to the list..

best,chris. 
To unsubscribe from this group and stop receiving emails from it, send an email to blacklight-development+unsub...@googlegroups.com.

Jonathan Rochkind

unread,
Apr 25, 2013, 5:41:38 PM4/25/13
to blacklight-...@googlegroups.com, Chris F.
On 4/25/2013 5:27 PM, Chris F. wrote:
>
> But one problem is that most cloud-based Solr-as-a-service providers
> I've seen don't allow you to edit you config XML (which blacklight
> requires), so you'll probably have to have Solr running on a VM.

Blacklight can actually work with any Solr config at all, Blacklight
does not actually require you to be able to edit your solr config. I
guess that's a misconception that BL requires you to be able to edit
your Solr configuration, or requires a certain Solr configuration.

But there is some configuration in Blacklight that needs to be
coordinated with the configuration in Solr, and with how you index
things into your Solr. What solr fields to use for searching in what
ways, what solr fields to use to fetch data to display in what ways, etc.

The default BL install has you change your Solr config to match
Blacklight's default configuration.

But you can certainly instead change Blacklight's configuration to match
any Solr configuration you want (or are stuck with) instead.

If you aren't able to edit your Solr configuration, that may limit some
of the things you can do with Solr, sure. Running a Solr where you can
change the config however you want gives you more flexibility, with or
without BL.

And if you aren't using Blacklight's recommended getting-started Solr
configuration (possibly because you can't, with your Solr provider) --
you'll have to understand the Solr configuration you have, and make some
choices about how you're going to use it. What things you are going to
index in how many fields in Solr set up how, how you're going to search
those fields to get the search results you desire, etc.

These are all things that normally go into writing an application on top
of Solr, thinking about those things, even without BL. Then you'll have
to configure Blacklight to use Solr the way you want, within the
limitations of what your Solr configuration can do.

But BL is pretty flexible, it can probably be configured to work just
about however you want, and with just about any Solr configuration --
you just have to figure out 'how you want', possibly within limitations
of what your Solr provider lets you do. If you are able to take
Blacklight's suggested 'getting started' Solr configuration then you
can, at least at first, skip all that and just get started, it's true.
You'll probably still need to eventually understand what's going on on
the Solr end and what the options are, to develop your app effectively
and deal with any problems.


Jonathan
> blacklight-develo...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out
> <https://groups.google.com/groups/opt_out>.
>
>
>
> --
> You received this message because you are subscribed to the Google
> Groups "Blacklight Development" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to blacklight-develo...@googlegroups.com.

Chris F.

unread,
Apr 25, 2013, 5:59:51 PM4/25/13
to blacklight-...@googlegroups.com, Chris F.

Hi,

Yeah, I see your point. I hadn't actually thought of reconfiguring BL to use a default solr request handler...regardless, I kind of think the trouble would be so much that it would probably outweigh the convenience of using something like WebSolr. That request handler is one of the really nice things about BL, since it eases the app development...as I've found in my experience with Heroku, sometime taking the time to build your own Ops environment actually is time better spent than trying to build around the limitations of a particular service...

b,chris. 
>         For more options, visit https://groups.google.com/groups/opt_out
>         <https://groups.google.com/groups/opt_out>.
>
>
>
> --
> You received this message because you are subscribed to the Google
> Groups "Blacklight Development" group.
> To unsubscribe from this group and stop receiving emails from it, send

Aakash

unread,
Apr 26, 2013, 8:12:17 PM4/26/13
to blacklight-...@googlegroups.com
Thanks Justin !

I don't see specified line # in my config file and also do you think requesthandler for search is also needed?
I need to talk to admin to make changes.
To unsubscribe from this group and stop receiving emails from it, send an email to blacklight-development+unsub...@googlegroups.com.

Aakash

unread,
Apr 26, 2013, 8:19:49 PM4/26/13
to blacklight-...@googlegroups.com, Chris F.
Thanks !

I am able to connect to my remote VM solr cloud, I don't see previous issue anymore. Only thing is now I am not getting faceted values or any solr indexed values.

attached is the screen shot.

Please suggest what all files or where should I look into.

>         For more options, visit https://groups.google.com/groups/opt_out
>         <https://groups.google.com/groups/opt_out>.
>
>
>
> --
> You received this message because you are subscribed to the Google
> Groups "Blacklight Development" group.
> To unsubscribe from this group and stop receiving emails from it, send
Capture.PNG

Aakash

unread,
Apr 29, 2013, 7:08:25 AM4/29/13
to blacklight-...@googlegroups.com
Hi Guys,

Any reply on below issue. Please see screen shot.

Thanks,
Reply all
Reply to author
Forward
0 new messages