Persisting some results together with the benchmark

[Kai]

I want to compare two methods not only by the time theyre running but also by their results theyre producing. So for example:

Collection<myClass> method1(...);
Collection<myClass> method2(...);

I want to compare the running time of method1 with method2 but also method1.size() with method2.size().
What is the encouraged way, if there is any, to persist these results together with the benchmarks in the H2 database and plot them with/without the running time?

[Dawid Weiss]

Nope, this won't be possible, at least not out of the box. You could
probably alter the source code and do it manually though (add the size
to the database, then plot it).

Dawid

> --
> You received this message because you are subscribed to the Google Groups
> "JUnitBenchmarks: Performance Benchmarking for JUnit4" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to junit-benchmar...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

[Jens Wilke]

Hi Kai,

within...

https://github.com/headissue/cache2k-benchmark

I use junit-benchmarks. For the additional results, e.g. "hit ratio" I write a
separate CSV file and postprocess it with a shell script. The final result
is a CSV that is graphed via gnuplot. For processing the unix tools xml2, awk,
grep, sort are used. The magic shell script is:

https://github.com/headissue/cache2k-benchmark/blob/master/processBenchmarkResults.sh

If you are on Unix/Linux, feel free to copy&paste what you need.

Cheers,

Jens

--
"Everything superfluous is wrong!"

// Jens Wilke - headissue GmbH - Germany
\// http://www.headissue.com

[Dawid Weiss]

Thanks Jens!

D.