Confused by "Response Codes Per Second" graph - JMeter-Plugins 1.1.1.

[Chris Rankin]

Hi,

I've generated a 900 MB CSV file of HTTP responses over a 6 hour overnight run, and now I'm examining the results with the "Response Codes per Second" graph (JMeter 2.9, JMeter-Extras 1.1.1). However, the "Log/Display Only Errors / Successes" checkbox controls are not behaving as I might expect.

My test results contain a mixture of 200s, 404s, 500s, and samples that failed without returning a status code at all. When I load my CSV with the "Log/Display Only Success" checkbox checked, I get a graph covering the full 6 hours and displaying all 4 status codes. However, only 200s are "successes" as I understand them, viz samples where "success" is "true" in the CSV file.

When I load my CSV with the "Log/Display Only Errors" checkbox checked, I get a graph covering only the last 90 minutes of the test, but again displaying all 4 status codes. I would actually expect a graph for the full 6 hours that displays 404s, 500s and no status codes, corresponding to samples with "success" being "false" in the CSV file.

Other graphs, such as "Response Latencies Over Time", are also behaving like this. Am I misunderstanding something here, please? (But what other definition of "success" and "error" could there be?!)

Thanks,
Chris

[Andrey Pohilko]

Hi,

Listeners interpret "success" colimn of CSV file using those checkboxes. Your expectations are correct. But remember that http codes like 500 or 200 can have "success" flag, if the sampler or assertion marked so.

900MB log is really huge, there may be some format errors in it. Do you see any errors in JMeter log while parsing this file?

пятница, 2 августа 2013 г., 14:11:46 UTC+4 пользователь Chris Rankin написал:

[Chris Rankin]

Hi, thanks for replying.

I am actually generating a CSV file on a remote cluster, and only using JMeter-Plugins to load this data later. Further experiments are now suggesting that the "Log/Display Only..." checkboxes are being used as "filters" on the data read in from my CSV file. Once read in, *ALL* data is then displayed - regardless of its "success" or "error" flag status.

This is not what I was expecting to happen: I thought the plugin would use the checkbox to adjust the graphical output, not filter the CSV inputs.

I also seem to need to press the "clear all" button between loading CSV files, to prevent the data sets from stacking up!

But having said all this, the "Log/Display Only Errors" graph is still restricted to only the last 90 minutes of the test - and I KNOW I have errors across all 6 hours. So I still don't understand what is happening here.

Cheers,

Chris

--
You received this message because you are subscribed to a topic in the Google Groups "jmeter-plugins" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jmeter-plugins/spDu6fWarBg/unsubscribe.
To unsubscribe from this group and all its topics, send an email to jmeter-plugin...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Chris Rankin]

P.S. I have successfully loaded the first 200 lines of this 900 MB file, and it is plotting "Elapsed Time" as I would expect it - for both "successes" and "failures". So I don't believe the file has format errors.

On Fri, Aug 2, 2013 at 1:35 PM, Andrey Pohilko <a...@apc.kg> wrote:

[Andrey Pohilko]

Your file can just be broken somewhere in the middle... So first 200 lines gives no guarantee. 

My question about log messages still the same...

пятница, 2 августа 2013 г., 17:13:52 UTC+4 пользователь Chris Rankin написал:

[Chris Rankin]

Hi,

There is nothing interesting in the jmeter.log:

2013/08/02 13:49:43 INFO  - jmeter.util.JMeterUtils: Setting Locale to en_GB
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Loading user properties from: E:\workspace\apache-jmeter-2.9\bin\user.properties
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Loading system properties from: E:\workspace\apache-jmeter-2.9\bin\system.properties
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Copyright (c) 1998-2013 The Apache Software Foundation
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Version 2.9 r1437961
2013/08/02 13:49:43 INFO  - jmeter.JMeter: java.version=1.7.0_21
2013/08/02 13:49:43 INFO  - jmeter.JMeter: java.vm.name=Java HotSpot(TM) 64-Bit Server VM
2013/08/02 13:49:43 INFO  - jmeter.JMeter: os.name=Windows 7
2013/08/02 13:49:43 INFO  - jmeter.JMeter: os.arch=amd64
2013/08/02 13:49:43 INFO  - jmeter.JMeter: os.version=6.1
2013/08/02 13:49:43 INFO  - jmeter.JMeter: file.encoding=Cp1252
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Default Locale=English (United Kingdom)
2013/08/02 13:49:43 INFO  - jmeter.JMeter: JMeter  Locale=English (United Kingdom)
2013/08/02 13:49:43 INFO  - jmeter.JMeter: JMeterHome=E:\workspace\apache-jmeter-2.9
2013/08/02 13:49:43 INFO  - jmeter.JMeter: user.dir  =E:\workspace\apache-jmeter-2.9\bin
2013/08/02 13:49:43 INFO  - jmeter.JMeter: PWD       =E:\workspace\apache-jmeter-2.9\bin
2013/08/02 13:49:43 INFO  - jmeter.JMeter: IP: 10.0.0.69 Name: IS01061 FullName: IS01061.omnifone.com
2013/08/02 13:49:43 INFO  - jmeter.JMeter: Loaded icon properties from org/apache/jmeter/images/icon.properties
2013/08/02 13:49:43 INFO  - jmeter.engine.util.CompoundVariable: Note: Function class names must contain the string: '.functions.'
2013/08/02 13:49:43 INFO  - jmeter.engine.util.CompoundVariable: Note: Function class names must not contain the string: '.gui.'
2013/08/02 13:49:43 INFO  - jmeter.gui.action.LookAndFeelCommand: Using look and feel: javax.swing.plaf.metal.MetalLookAndFeel [Metal, CrossPlatform]
2013/08/02 13:49:44 INFO  - jmeter.gui.util.MenuFactory: Skipping kg.apc.jmeter.config.VariablesFromCSVFile
2013/08/02 13:49:44 INFO  - jmeter.util.BSFTestElement: Registering JMeter version of JavaScript engine as work-round for BSF-22
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Cannot find .className property for htmlParser, using default
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Parser for text/html is 
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Parser for application/xhtml+xml is 
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Parser for application/xml is 
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Parser for text/xml is 
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Parser for text/vnd.wap.wml is org.apache.jmeter.protocol.http.parser.RegexpHTMLParser
2013/08/02 13:49:44 INFO  - jmeter.protocol.http.sampler.HTTPSamplerBase: Reuse SSL session context on subsequent iterations: true
2013/08/02 13:49:45 INFO  - jmeter.gui.util.MenuFactory: Skipping org.apache.jmeter.protocol.http.modifier.gui.ParamModifierGui
2013/08/02 13:49:45 INFO  - jmeter.samplers.SampleResult: Note: Sample TimeStamps are START times
2013/08/02 13:49:45 INFO  - jmeter.samplers.SampleResult: sampleresult.default.encoding is set to ISO-8859-1
2013/08/02 13:49:45 INFO  - jmeter.samplers.SampleResult: sampleresult.useNanoTime=true
2013/08/02 13:49:45 INFO  - jmeter.samplers.SampleResult: sampleresult.nanoThreadSleep=5000
2013/08/02 13:49:52 INFO  - jmeter.services.FileServer: Default base='E:\workspace\apache-jmeter-2.9\bin'
2013/08/02 13:49:52 INFO  - jmeter.gui.action.Load: Loading file: E:\workspace\apache-jmeter-2.9\bin\ContentServicesReport.jmx
2013/08/02 13:49:52 INFO  - jmeter.services.FileServer: Set new base='E:\workspace\apache-jmeter-2.9\bin'
2013/08/02 13:49:52 INFO  - jmeter.save.SaveService: Testplan (JMX) version: 2.2. Testlog (JTL) version: 2.2
2013/08/02 13:49:52 INFO  - jmeter.save.SaveService: Using SaveService properties file encoding UTF-8
2013/08/02 13:49:52 INFO  - jmeter.save.SaveService: Using SaveService properties file version 1427507
2013/08/02 13:49:52 INFO  - jmeter.save.SaveService: Using SaveService properties version 2.4
2013/08/02 13:49:52 INFO  - jmeter.save.SaveService: All converter versions present and correct
2013/08/02 13:49:52 INFO  - jmeter.services.FileServer: Set new base='E:\workspace\apache-jmeter-2.9\bin'
2013/08/02 14:28:59 INFO  - kg.apc.charting.GraphPanelChart: Saving PNG to E:\workspace\apache-jmeter-2.9\bin\success-response-latencies-no-nfs.png

That is *everything*, so if there's a formatting error in my CSV file then JMeter is being very quiet about it.

I've created a smaller (235MB) file covering a 2 hour period, and discovered that loading "Log/Display Only Successes" shows the entire "Elapsed Time". However, "Log/Display Only Errors" shows only the final 30 minutes.

Cheers,
Chris