Distributed load testing with Gatling, is it possible???

[Assane Diop]

I have been doing some load test with gatling 1.5.1 and so far i am pretty happy with the framework.
I was wondering though if anybody had ever done distributed load testing with this framework.
I know gatling uses akka actors, maybe someone has already play with it and make this work.

Assane

[Andrew Duffy]

We run distributed load tests in Gilt; we built a (slightly hacky) set of scripts run by Jenkins that create EC2 instances, upload executable jars to them, run the load test without generating reports on each one (-nr, I think), and harvest the simulation logs afterwards. Once you have a directory of simulation logs you can create a report and test assertions against the aggregate of them by just using -ro (and -s if you have assertions to test).

Assane

--
You received this message because you are subscribed to the Google Groups "Gatling User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gatling+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Assane Diop]

Thanks for the response Andrew.
I am not sure I follow completely, do you have some examples or tutorial of what your set up is doing?
I see gilt allows you to connect to another host within gatling, and i can easily create some virtual machine. I am not sure how the scenario will actually run on the machines?

[Stéphane Landelle]

Thank you Andrew.

May I suggest that this would be a nice topic for a post on Gilt's blog (excellent material there, BTW, you guys rock!)?

2013/6/21 Assane Diop <assan...@gmail.com>

--

[yuhao fang]

Could Gatling run distributed load testing now？

在 2013年6月21日星期五 UTC+8下午1:30:18，Stéphane Landelle写道：

[Abhinav Gogna]

Distributed load test is implemented albeit manually. You can run the simulations from various machines, collect the log and create a report. Check out http://gatling.io/docs/2.1.7/cookbook/scaling_out.html

What Andrew has done is create scripts to do all these manual tasks. We also did something like this with AWS EC2 instances using fabric.

[Jakub Jeszke]

Gatling Team,

are there any plans to provide any 'cluster' or 'distributed' mode? Do you have any road map for this year? 

Regards,

Jakub

[Stéphane LANDELLE]

Absolutely, our upcoming commercial product, FrontLine, will support clustering.

Stéphane Landelle

GatlingCorp CEO

slan...@gatling.io

For more options, visit https://groups.google.com/d/optout.

[adrian...@hushmail.com]

Hi Assane, 

Until the commercial product arrives, I'd probably use a lightweight distribution tool[1] and aggregate hosts in InfluxDB. Unless, the Gatling reports were actually required, I'd probably turn them off and disable the parser. 

I can write some notes on this if required?

Can I ask what your expected concurrency peak is?

[1] https://github.com/bbc/notes-on-perf-testing#distribution

Aidy

[Stéphane LANDELLE]

One of the issues with InfluxDB and other standard time series databases is that if you care about percentiles/distributions (which you should, those are the only metrics that make sense, on contrary to average and standard deviation), you end up averaging them (over time, over cluster nodes).

This is of course completely wrong (e.g.: the 100th percentile is the maximum, and the global maximum is absolutely not the average of the local maximums) and artificially smoothen your results.

This is one of the issues we're fixing with FrontLine.

Stéphane Landelle

GatlingCorp CEO

slan...@gatling.io

--

You received this message because you are subscribed to the Google Groups "Gatling User Group" group.

[adrian...@hushmail.com]

That is a very good point.

On 2/14/2016 at 6:05 PM, "Stéphane LANDELLE" <slan...@gatling.io> wrote:
>
>One of the issues with InfluxDB and other standard time series
>databases is
>that if you care about percentiles/distributions (which you
>should, those
>are the only metrics that make sense, on contrary to average and
>standard
>deviation), you end up averaging them (over time, over cluster
>nodes).
>
>This is of course completely wrong (e.g.: the 100th percentile is
>the
>maximum, and the global maximum is absolutely not the average of
>the local
>maximums) and artificially smoothen your results.
>
>This is one of the issues we're fixing with FrontLine.
>
>

>*Stéphane Landelle*
>*GatlingCorp CEO*
>slan...@gatling.io

[Aparna Rastogi]