Hi,
I do have several questions about this new release of the jmeter-maven-plugin and the jmeter-analysis-maven-plugin.
1) jmeter-analysis-maven-plugin 1.0.0 seems to create the reports at the "/target" directory, no mater what address I do set to the <target> tag. I'm using <target>${project.build.directory}/jmeter/upload/</target>, but it always the reports at <target>${project.build.directory}</target> no mater what I write
2) Big problem for me. jmeter-maven-plugin 1.4.1 used to build the report according to the *.jmx name. So if I had for two *.jmx files (test_1.jmx and test_2.jmx) it would create two separate *.jtl files (test_1.jtl and test_2.jtl) and when generating the report it would do the very same thing, two *.html files (test_1.html and test_2.html) based on the *.jtl files that are present at the ../report/ directory.
The jmeter-analysis-maven-plugin 1.0.0 always does use "sumary" to name the reports, so when I have several *.jtl files, at ../reports, I have nothing but a sumary.html report at the end with the information of the last (alphabetical) test.
3) The kind of reporting that the jmeter-analysis-maven-plugin 1.0.0 generates is the statistics kind (response times and numbers). Is it possible to have the jmeter-maven-plugin 1.4.1 simple pass/fail format with this new plugin?
4) I'm a developer to, and I know how hard it is to document the tools as I develop them, but I has been really hard to find information about how to use these plugins, so I'll appreciate if you can make a small guide at least with the tags that can be used to configure the plugins them selfs.
I know the easiest thing would be to go back to the jmeter-maven-plugin 1.4.1, but the jmeter-maven-plugin 1.6.0 works better for me because of the jmeter version that it uses. So I'll appreciate any help with these 4 questions.
Regards,
Nate
I would agree that documentation is a bit too sparse at the moment. I think the best documentation we have for the jmeter-maven-plugin is accessed by doing:
mvn site:run
and then browsing to the documentation on http://localhost:8080
For the analysis plugin it is best to look at:
https://github.com/afranken/jmeter-analysis-maven-plugin
I know I’ve not really done anything on the jmeter maven plugin, or the jmeter analysis maven plugin, the past couple of months, but that is largely because we haven’t had any feedback saying things need to change.
The reasons that we took the old reporting functionality out is because:
1. It was very inefficient and it more than doubled the time taken to run a test.
2. It seemed more sensible to focus the JMeter maven plugin purely on running the tests, and then have an additional plugin to do the reporting. This way you can potentially add any reporting plugin to the mix rather than being forced to use the one we offered.
As to your questions, I’m not familiar with the Jmeter analysis maven plugin codebase at the moment so my answers below may not be totally accurate:
1. Sounds like a bug, we will need to investigate and fix that if it is.
2. Again sounds like a bug, we should be providing sensible names by default.
3. I think this is possible by using a custom freemarker template.
4. I agree we need to spend some time on this (hopefully the info at the start of the mail will be of some use)
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To view this discussion on the web, visit https://groups.google.com/d/msg/maven-jmeter-plugin-users/-/QLdlijdim2oJ.
To post to this group, send an email to maven-jmeter...@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
To post to this group, send an email to maven-jmeter-plugin-users@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
Could you raise the following as bugs at https://github.com/afranken/jmeter-analysis-maven-plugin/issues:
1. Tag is called <targetDirectory> not <target>
2. Report names not being set correctly.
The parser that is reading in the .jtl file is here:
Hopefully that will help you out a bit.
I’m going to need some time going through the code beore I can supply anything more concrete I’m afraid.
From: maven-jmeter...@googlegroups.com [mailto:maven-jmeter...@googlegroups.com] On Behalf Of nano_nate
Sent: 23 July 2012 22:15
To: maven-jmeter...@googlegroups.com
Subject: [jmeter-maven-plugin-users] Re: jmeter-maven-plugin 1.4.1 reports with 1.6.0 and jmeter-analysis-maven-plugin 1.0.0
Hi,
I do have several questions about this new release of the jmeter-maven-plugin and the jmeter-analysis-maven-plugin.
1) jmeter-analysis-maven-plugin 1.0.0 seems to create the reports at the "/target" directory, no mater what address I do set to the <target> tag. I'm using <target>${project.build.directory}/jmeter/upload/</target>, but it always the reports at <target>${project.build.directory}</target> no mater what I write
2) Big problem for me. jmeter-maven-plugin 1.4.1 used to build the report according to the *.jmx name. So if I had for two *.jmx files (test_1.jmx and test_2.jmx) it would create two separate *.jtl files (test_1.jtl and test_2.jtl) and when generating the report it would do the very same thing, two *.html files (test_1.html and test_2.html) based on the *.jtl files that are present at the ../report/ directory.
The jmeter-analysis-maven-plugin 1.0.0 always does use "sumary" to name the reports, so when I have several *.jtl files, at ../reports, I have nothing but a sumary.html report at the end with the information of the last (alphabetical) test.
3) The kind of reporting that the jmeter-analysis-maven-plugin 1.0.0 generates is the statistics kind (response times and numbers). Is it possible to have the jmeter-maven-plugin 1.4.1 simple pass/fail format with this new plugin?
4) I'm a developer to, and I know how hard it is to document the tools as I develop them, but I has been really hard to find information about how to use these plugins, so I'll appreciate if you can make a small guide at least with the tags that can be used to configure the plugins them selfs.
I know the easiest thing would be to go back to the jmeter-maven-plugin 1.4.1, but the jmeter-maven-plugin 1.6.0 works better for me because of the jmeter version that it uses. So I'll appreciate any help with these 4 questions.
Regards,
Nate
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To view this discussion on the web, visit https://groups.google.com/d/msg/maven-jmeter-plugin-users/-/QLdlijdim2oJ.
To post to this group, send an email to maven-jmeter...@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To view this discussion on the web, visit https://groups.google.com/d/msg/maven-jmeter-plugin-users/-/OIkd085w2QAJ.
To post to this group, send an email to maven-jmeter...@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugi...@googlegroups.com.
2012/7/26 Natanael Castro <ncog...@gmail.com>
To post to this group, send an email to maven-jmeter-plugin-users@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To view this discussion on the web, visit https://groups.google.com/d/msg/maven-jmeter-plugin-users/-/OIkd085w2QAJ.
To post to this group, send an email to maven-jmeter-plugin-users@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To post to this group, send an email to maven-jmeter-plugin-users@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
--
Natanael Castro Ortega.
(+506) 8342-0141
--
You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
To post to this group, send an email to maven-jmeter...@googlegroups.com.
To unsubscribe from this group, send email to maven-jmeter-plugi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
If you pass -X to your maven command line it will print debug information to the console as well, so something like:
mvn verify -X
(It will probably be quite a lot of output getting logged)
It would be useful to see the relevant part of your POM that configures the plugin as well so I can mirror it on my environment.
Gone through this again this morning and I still get appropriately named files written to my <targetDirectory>.
It isn’t logging multiple summaries in the console, is that what you are looking at?
Here is a copy of the relevant section from my POM:
<plugin>
<groupId>com.lazerycode.jmeter</groupId>
<artifactId>jmeter-analysis-maven-plugin</artifactId>
<version>1.0.1-SNAPSHOT</version>
<executions>
<execution>
<phase>verify</phase>
<goals>
<goal>analyze</goal>
</goals>
<configuration>
<source>${project.build.directory}/jmeter/results/*</source>
<targetDirectory>${project.build.directory}/jmeter/reports</targetDirectory>
<generateCSVs>true</generateCSVs>
<generateCharts>true</generateCharts>
<processAllFilesFound>true</processAllFilesFound>
</configuration>
</execution>
</executions>
</plugin>
Version 1.0.1 is now out (and in maven central), see:
https://groups.google.com/forum/?fromgroups#!topic/maven-jmeter-plugin-users/8wJ9BNudaY0
It should fix the problems you are seeing, however we have do have a cosmetic bug with console output that is still outstanding:
https://github.com/afranken/jmeter-analysis-maven-plugin/issues/3
There's no mention of this before, at least as I remember...
Whith this tag and the graphs and cvs set to be generated, you're right, all the files are generated, but, the one that concerns me keeps been overwritten. I'm seeking for the HTML file that is generated unther the name "sumary.html" because I need to upload the reports based on the freemarker template that I'm building.
So yes, you got different graphs and cvs files, but only one overwritten html file.
Have you tried the 1.0.1 final release I previously linked to?
The tag <processAllFilesFound>true</processAllFilesFound> is new for version 1.0.1 it did not exist before (in version 1.0.1 the plugin would only process one .jtl file as specified in <source> element. If multiple files were found it would only process the first one).
It looks like issue #3 is removing any useful output getting logged to the console so I can’t see the debug logging that shows the filename used for writing.
There should no longer be a summary.html generated. Assuming that the .jtl file that is being read in is called “foo.jtl”, it should be called “foo.html”.
It will probably be worth doing the following on the command line to clean out any old junk:
mvn clean pre-site -f test-pom.xml
Good to hear you got it working J
Sorry for the late response to this, I’ve not looked here for a couple of days.
All of the keys available are shown as comments at the top of aggregatedResponse.ftl:
<#-- @ftlvariable name="key" type="java.lang.String" -->
<#-- @ftlvariable name="aggregatedResponses" type="com.lazerycode.jmeter.analyzer.parser.AggregatedResponses" -->
<#-- @ftlvariable name="bytes" type="com.lazerycode.jmeter.analyzer.statistics.Samples" -->
<#-- @ftlvariable name="requests" type="com.lazerycode.jmeter.analyzer.statistics.Samples" -->
<#-- @ftlvariable name="Q_QUANTILES" type="java.lang.Integer" -->
<#-- @ftlvariable name="K_99_PERCENT" type="java.lang.Integer" -->
<#-- @ftlvariable name="K_99_PONT_9_PERCENT" type="java.lang.Integer" -->
<#-- @ftlvariable name="PERCENT_100" type="java.lang.Integer" -->
<#-- @ftlvariable name="CHARTS" type="java.lang.Boolean" -->
<#-- @ftlvariable name="DETAILS" type="java.lang.Boolean" -->
<#-- @ftlvariable name="SUMMARY_FILE_NAME" type="java.lang.String" -->
Looking through jMeterResultParser.java it would appear that the key element is either set to tn or lb, so I think ${key} would be the place to look for lb values.
Status codes are stored as part of ${aggregatedResponses} (code is here AggregatedResponses.java) so I think what you are looking for is ${aggregatedResponses.statusCodes.codes} which will be a list of status codes returned for a specific ${key}.
Hope that helps
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
>
> --
> Natanael Castro Ortega.
> (+506) 8342-0141
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
>
> --
> Natanael Castro Ortega.
> (+506) 8342-0141
>
>
>
> --
> Natanael Castro Ortega.
> (+506) 8342-0141
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
>
> --
> Natanael Castro Ortega.
> (+506) 8342-0141
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/maven-jmeter-plugin-users?hl=en-GB.
>
>
>
> --
> Natanael Castro Ortega.
> (+506) 8342-0141
> --
> You received this message because you are subscribed to the Google Groups "Maven JMeter Plugin Users" group.
> To post to this group, send an email to maven-jmeter...@googlegroups.com.
> To unsubscribe from this group, send email to maven-jmeter-plugin-users+unsub...@googlegroups.com.