New benchmarks for Vectorz?

[Mike Anderson]

Hi,

I'm the author of the library Vectorz (https://github.com/mikera/vectorz)

This started out as a fast library for 1D vector maths, but it now supports most common 2D matrix operations as well so I'd be interested to add it to the benchmark to see how it performs against other libraries (and hopefully identify areas for optimisation!)

Two questions:

1) Is the java-matrix-benchmark still being maintained?

2) If so, what is the process for getting a new library included in the benchmark?

  Mike

[Peter A]

Hi, yes the benchmark is still being maintained.  It's updated about once a year right now.

When adding a new library I typically work with the library's author.  It's best if you implemented the following interfaces:

RuntimePerformanceFactory, MemoryFactory, BenchmarkMatrix.  Then FactoryLibraryDescriptions needs to be updated.

Use the latest SVN code.  See implementations inside of jmbench.impl.* for examples of how to do it correctly by looking at other libraries.  Then I go over it and discuss any modifications that need to be made.    Take a look at http://code.google.com/p/java-matrix-benchmark/wiki/manual to see how it should be run.

The benchmark is designed to measure the sort of performance the average user can expect.  Code which requires intimidate knowledge of the library, especially if the documentation provides a different solution, will raise a red flag.  Also use of algorithms which are known to be numerically unstable, but run faster, which no one would use in the general case, are not allowed.  There are checks in place which attempt to catch that, but it is possible to sneak by them.  The same code should also be used across all matrix sizes, but your library is allowed to do internally whatever it wants.

Let me know if you have any questions!

- Peter

--
You received this message because you are subscribed to the Google Groups "java-matrix-benchmark-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to java-matrix-benchmar...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
"Now, now my good man, this is no time for making enemies."    — Voltaire (1694-1778), on his deathbed in response to a priest asking that he renounce Satan.