Comment on Usage in solrmeter

[solr...@googlecode.com]

Comment by sburnitt:

asfdasdf

For more information:
http://code.google.com/p/solrmeter/wiki/Usage

[solr...@googlecode.com]

Comment by rahul.wa...@gmail.com:

Is there any plan to support multiple user testing in Solrmeter ?

[solr...@googlecode.com]

Comment by tflo...@gmail.com:

You mean testing one Solr server with many SolrMeter instances? I think
this is something we have to do, as this would be the only way to execute
more QPS, but the truth is that nothing has been done in this area yet.

[Rahul Warawdekar]

It is something similar that we do with Jmeter for load/performance testing.
Simulate multiple users with the same Solrmeter instance on one Solr server.

--
Thanks and Regards
Rahul A. Warawdekar

[Tomas Fernandez Lobbe]

Right now there are two different executors for queries or updates. See http://code.google.com/p/solrmeter/wiki/Executors.

Currently there is no way to say "I want 5 threads executing queries" like with JMeter, this could be a different Executor, but it is not implemented.

Regards,
Tomás

2011/10/5 Rahul Warawdekar <rahul.wa...@gmail.com>

[Rahul Warawdekar]

Got it. Thanks !

[solr...@googlecode.com]

Comment by cpa...@gmail.com:

Is there a way to support running shard queries against a particular
request handler?

In particular I want to test sharding against a shardSearch handler
http://SERVERNAME:8080/solr3/core1/shardsearch?q=XYZ
Adding the request handler to the url didn't seem to work.

[Tomas Fernandez Lobbe]

You mean just point to a different request handler or do you want to add the "shards" parameter? You can specify the request handler by using the "qt" parameter of Solr. In the settings page, you can add extra parameters, add "qt" as property and "/shardsearch" as value.

2011/10/6 <solr...@googlecode.com>

[Tomas Fernandez Lobbe]

Also, you can specify the request handler on the text box that says "Query Type" on the Query Settings (I forgot about it :) ). See http://code.google.com/p/solrmeter/wiki/Tutorial#Query_Type:

2011/10/6 Tomas Fernandez Lobbe <tfl...@gmail.com>

[solr...@googlecode.com]

Comment by tflo...@gmail.com:

you can specify the request handler on the text box that says "Query Type"

on the Query Settings. See
http://code.google.com/p/solrmeter/wiki/Tutorial#Query_Type:
For this case, it should be "/shardsearch"

[ed0t]

Hi all,
i'm looking at a way of adding this feature: "support concurrent
queries to simulate multiple users".
I'm considering two possible options:

- create a custom executor
- modify the QueryExecutorConstantImpl and QueryExecutorRandomImpl and
introduce a threadpool executor.

The first option means that we have to "duplicate" some code to
provide a MultiUserQueryExecutorConstant and
MultiUserQueryExecutorRandom.
The second option instead would require to introduce something like a
ThreadPoolExecutor in both of the current QueryExecutors. We can
introduce another parameter in the Query Panel UI to specify the
number of concurrent queries. (default would be 1 which means same
behaviour that we have at the moment)

Personally i prefer the second option but i'd like to have your
opinion. Maybe i'm missing something :)

Thank you,

edo




On Oct 5, 7:32 pm, Tomas Fernandez Lobbe <tflo...@gmail.com> wrote:
> Right now there are two different executors for queries or updates. See *http://code.google.com/p/solrmeter/wiki/Executors*.

>
> Currently there is no way to say "I want 5 threads executing queries" like
> with JMeter, this could be a different Executor, but it is not implemented.
>
> Regards,
> Tomás
>

> 2011/10/5 Rahul Warawdekar <rahul.warawde...@gmail.com>

>
>
>
>
>
>
>
> > It is something similar that we do with Jmeter for load/performance
> > testing.
> > Simulate multiple users with the same Solrmeter instance on one Solr
> > server.
>

> > On Wed, Oct 5, 2011 at 3:22 PM, <solrme...@googlecode.com> wrote:
>
> >> Comment by tflo...@gmail.com:
>
> >> You mean testing one Solr server with many SolrMeter instances? I think
> >> this is something we have to do, as this would be the only way to execute
> >> more QPS, but the truth is that nothing has been done in this area yet.
>
> >> For more information:

> >>http://code.google.com/p/**solrmeter/wiki/Usage<http://code.google.com/p/solrmeter/wiki/Usage>

[Tomas Fernandez Lobbe]

I've been thinking in this feature and I have some comments more related to the user side than with the actual implementation:

With the current "ConstantExecutor", the operations (either queries or updates) are executed on a fixed time. If we start 5 of this "ConstantExecutor"s and we start them all at the same time, all the operations for all the threads will be executed almost at the same instance. For example, if the executor is going to execute one operation every 10 seconds, and run 5 threads (simulating 5 users), then every 10 seconds the 5 threads will execute one operation each, and then wait 10 seconds. We should in some way delay the start of new threads so that they don't want to execute at the exact same instance, don't you think?

For the RandomExecutor, does it makes sense to add this behavior? The idea of this executor is that is emulates different users, as the number of operations per minute, are implemented as different threads that execute an operation sometime in that minute and then sleep the rest of the time (something that uses many threads, so I'm planning to change a little). For example, y 10 operations per minute are configured, then 10 threads will be created to execute one operation per minute. So I don't think it would make sense to say "I want 5 RandomExecutors", as at the end, it will be the same as just one RandomExecutor with 5 times the number of operations per minute.

Thanks,

Tomás

2011/11/8 ed0t <edoard...@gmail.com>

[edo]

Hi Tomás,
i totally agree with you,
yesterday i implemented a possible solution with multiple threads that are executed inside  each executor. And indeed, for the ConstantExecutor i could see the behavoiur that you pointed out.
Regarding the RandomExecutor you're probably right, it could run more than a query at the same time (especially with a high query per minute value). So effectively it doesn't make sense to add more complexity!

i move to some other open issues :)

Thanks,
edo

--
Edoardo Tosca
Mail: edoardo.tosca@{autistici.org, gmail.com}
Skype: edoardotosca
Web: http://blog.devonlinux.net

[solr...@googlecode.com]

Comment by cpa...@gmail.com:

Any way to add the Query type using the external mode?
I have actual queries I already use in external mode, I would like to
re-use in shard search.

[solr...@googlecode.com]

Comment by tflo...@gmail.com:

Unfortunately not from the UI, the way I usually do it is by adding the
parameter "qt" to all the queries of the external queries file.

[solr...@googlecode.com]

Comment by peter.wo...@acquia.com:

Does one have to use the GUI, or can all the functionality be accessed via
the command line or by passing in configurations files or variables?

[Tomas Fernandez Lobbe]

Right now the only option is to use SolrMeter through the UI. Recently I faced situations in which I would have loved to be able to send commands to SolrMeter through the command line. This is not implemented, but If you want create an issue for it, it would be a very interesting and useful feature to have.

2011/12/5 <solr...@googlecode.com>

[edo]

This is something i have been thinking about for a while. It could make sense to spend some time to pull out the codebase to run the stress test via command line. The only thing is that i believe it will not be an easy task :(

In a past project  we wanted to add the execution of a load test during nightly builds and to achieve the goal we had to handcraft a solution with jmeter and some bash scripts. It would be great if we had already a command line SolrMeter.

I think this feature can add great value to this project so i will do some investigation and let you know.

It would be great if you guys can share ideas to create a task breakdown. I can see at least two tasks:

• refactor and create a comman line tool and a UI on top
  
• create or use some libraries to export stats (or generate graphs and export in XLS or PDF)

What do you think?

Edo

[Tomas Fernandez Lobbe]

Hi, what do you think about letting SolrMeter run in a web server like jetty? that way it could even be reached remotely very easy. For start, I would try to refactor SolrMeter in order to allow execution in UI and web server mode as you said.
I think we should start by allowing to run SolrMeter using some configuration file, and add simple commands to start, stop, etc. Then we can incrementally add more and more features, like the generating PDF reports or even getting information through HTTP.
Also, I think we should wait a little to implement these changes, as they will require too many changes. Lets finish some of the stuff we have today, generate a release and they we can start with these improvments.

What do you think?

Tomás

2011/12/6 edo <edoard...@gmail.com>

[edo]

+1 on everything!
Honestly in the past month i've been thinking about transforming SolrMeter into a webapp. But as you said, it requires a huge effort.
I completely agree with your idea: small steps towards this massive change :)

So let's solve main important issues and release a new version. Subsequently we can start trying to introduce external configuration files.
Once done we can separate the core module from the UI and then decide if we want to carry on having two UIs (web interface and swing)

It would be great if some other SolrMeter users tell what do they think about :)

Edo

[solr...@googlecode.com]

Comment by vadim.ki...@memonews.com:

Is it possible to use DistributedSearch with SolrMeter, with queries like
this (?):
http://localhost:8983/solr/select?shards=localhost:8983/solr,localhost:7574/solr&indent=true&q=ipod+solr

Thanks :)

[solr...@googlecode.com]

Comment by vadim.ki...@memonews.com:

Is it possible to use DistributedSearch in SolrMeter, with queries like

[Mou Nandi]

Yes it is possible. I have used it successfully with external mode.

Use URLSolr:   http://localhost:8983/solr/ 

and create a query file which will have quries in each line like

shards=localhost:8983/solr,localhost:7574/solr&indent=true&q=ipod+solr 

thanks,

[solr...@googlecode.com]

Comment by ep...@opensourceconnections.com:

Is this still the right way to compile etc? I was working from the root
/source directory and ran "mvn package". However, it does seem to build
the assembly then in the solrmeter/ dir. I do sometimes get odd maven
package finding errors.

For more information:
https://code.google.com/p/solrmeter/wiki/Usage

[solr...@googlecode.com]

Comment by tflo...@gmail.com:

You are right, this is outdated. The "single" phase of the assembly plugin
is attached to the "package" phase, so 'mvn package' on the root /solrmeter
should do it.
What kind of package finding errors to you see?

[solr...@googlecode.com]

Comment by ep...@opensourceconnections.com:

I'll see if I can figure it out, but I do think it was related to not
properly doing mvn install on the stressTestScope project...

[solr...@googlecode.com]

Comment by sham...@gmail.com:

Does it have support for SolrCloud ? Can I specify the zookeeper ensemble
for running distributed queries ?

[Tomas Fernandez Lobbe]

No, currently solrmeter doesn't support SolrCloud, sorry

2013/10/13 <solr...@googlecode.com>

--

You received this message because you are subscribed to the Google Groups "SolrMeter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to solrmeter+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[abhishek gupta]

Hi,

Can someone help me using SOLR meter to test an Alfresco SOLR node that has an SSL endpoint as the tool seems to be failing to run queries because of certificate exceptions.

Thanks

On Thursday, September 9, 2010 12:07:14 AM UTC+5:30, solr...@googlecode.com wrote:

Comment by sburnitt:

asfdasdf

[solr...@googlecode.com]

Comment by sarath.k...@gmail.com:

Does solrmeter support solr cloud ? I have a zookeeper URL. So can I able
to run a load test using this URl

[李佳键]

Not yet. But you may modify the source code to let solrmeter send queries to your cloud server. The class controls detecting server is called SolrServerRegistry, within this class change the HttpSolrServer to CloudSolrServer and modify the rest relative code can help your solrmeter connect with your slorcloud.

在 2014年9月11日星期四UTC-5上午2时16分13秒，solr...@googlecode.com写道：

[solr...@googlecode.com]

Comment by tflo...@gmail.com:

There is no support for SolrCloud. Queries can be done to a SolrCloud
cluster from SolrMeter, but it will use the old HttpSolrServer and not the
cloud-aware CloudSolrServer.

[solr...@googlecode.com]

Comment by dmor...@lafourchette.com:

Hey, I ported the project to github, we're big fan of solrmeter at
lafourchette. Is anyone interested in helping us making the tool better ?

[solr...@googlecode.com]

Comment by dmor...@lafourchette.com:

https://github.com/lafourchette/solrmeter

[edo]

Good idea,

thanks for taking care of that.

I apologise for my absence but in the past year I have been very busy with other projects and less and less involved with Solr and SolrMeter.

Edo

--
You received this message because you are subscribed to the Google Groups "SolrMeter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to solrmeter+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.