Nightly Performance Plots

[Bill Hart]

FYI, after much wrangling with our internal servers, I finally have nightly performance plots being generated:

  https://software.sandia.gov/downloads/pub/pyomo/performance/index.html

Let me know if you'd like other analytics like this generated.  The best way to document those is with a ticket to the pyomo-benchmarks repo:

  https://github.com/Pyomo/pyomo-benchmarks

Note that we can add branches to the nightly tests.  For now, send me a note if you want to do that.  But in the future this should be easily configured.

--Bill

[Laird, Carl Damon]

Can you explain how the FAST/OK/SLOW are determined?

--
You received this message because you are subscribed to the Google Groups "Pyomo Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pyomo-develope...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Bynum, Michael Lee]

This is awesome! Thanks Bill. I need to set something like this up for one of my other projects...

Michael

[Bill Hart]

Here's the breakdown:

Really slow (gold):   > 10% slower

Slow (yellow):   5-10% slower

OK (light green):  5% faster - 5% slower

Fast (green):  5-10% faster

Really fast (dark green): > 10% faster

I'm open to suggestions about the coloring.  Red and Brick red reflect errors - Missing data from last-night's test and missing baselines from the last release.

--Bill

To unsubscribe from this group and stop receiving emails from it, send an email to pyomo-developers+unsubscribe@googlegroups.com.

[Bill Hart]

FYI, I'm using plot.ly.  If you're just generating a small number of plots, then plot.ly has a free web hosting service that's probably suitable.  But in my case I'm generating a bunch so a more complicated solution was necessary.

--Bill

On Friday, May 18, 2018 at 8:32:22 AM UTC-6, Michael Bynum wrote:

This is awesome! Thanks Bill. I need to set something like this up for one of my other projects...

Michael

On May 18, 2018, at 4:34 AM, 'Laird, Carl Damon' via Pyomo Developers <pyomo-developers@googlegroups.com> wrote:

Can you explain how the FAST/OK/SLOW are determined?

 

From: <pyomo-developers@googlegroups.com> on behalf of Bill Hart <whar...@gmail.com>
Reply-To: "pyomo-developers@googlegroups.com" <pyomo-developers@googlegroups.com>
Date: Friday, May 18, 2018 at 2:13 AM
To: Pyomo Developers <pyomo-developers@googlegroups.com>
Subject: [EXTERNAL] Nightly Performance Plots

 

FYI, after much wrangling with our internal servers, I finally have nightly performance plots being generated:

 

  https://software.sandia.gov/downloads/pub/pyomo/performance/index.html

 

Let me know if you'd like other analytics like this generated.  The best way to document those is with a ticket to the pyomo-benchmarks repo:

 

  https://github.com/Pyomo/pyomo-benchmarks

 

Note that we can add branches to the nightly tests.  For now, send me a note if you want to do that.  But in the future this should be easily configured.

 

--Bill

-- 
You received this message because you are subscribed to the Google Groups "Pyomo Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to pyomo-developers+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups "Pyomo Developers" group.

To unsubscribe from this group and stop receiving emails from it, send an email to pyomo-developers+unsub...@googlegroups.com.

[Bynum, Michael Lee]

Are these relative to the last data point (the last nightly build)?

Michael

To unsubscribe from this group and stop receiving emails from it, send an email to pyomo-develope...@googlegroups.com.

[Bill Hart]

The RHS of the plots is the latest release, and the 0-th index is data from "last night".

--Bill

[Bill Hart]

FWIW, I didn't get any requests for "other" plots, and I know that folks are interested in other stuff...

So ... speak up!  I'm not sure how quickly I can add stuff, but I'd like to have a wish list.

--Bill