Re: [sympy] Re: Being more conscious of performance

[Aaron Meurer]

How is the memory usage? We should try to find a good balance. Can you create plots of memory usage and performance vs. cache size (in master)? 

Aaron Meurer

On Mon, Jul 20, 2015 at 2:14 PM, Jason Moore <moore...@gmail.com> wrote:

FYI, if I increased the cache size I can push the timings, post new cache, down to the normal speeds.

e.g.

SYMPY_CACHE_SIZE=5000 asv run 051850f2..880f5fa6

Jason
moorepants.info
+01 530-601-9791

On Mon, Jul 20, 2015 at 12:07 PM, Aaron Meurer <asme...@gmail.com> wrote:

Regarding the Raspberry Pi 2, as far as I can tell it is a good option, but I opened https://github.com/spacetelescope/asv/issues/292 to see if anyone else has any suggestions. 

Aaron Meurer

On Mon, Jul 20, 2015 at 1:20 PM, Björn Dahlgren <bjo...@gmail.com> wrote:

On Monday, 20 July 2015 19:09:54 UTC+2, Aaron Meurer wrote:

So apparently the new cache is way too slow. Can the size be increased to a point that makes the performance comparable to the old cache? One obviously has to balance the cache size against memory usage (which won't show up in the performance tests).

asv has support for tracking memory usage:
http://asv.readthedocs.org/en/latest/writing_benchmarks.html#memory

It's just a matter of adding memory benchmarks..

--
You received this message because you are subscribed to the Google Groups "sympy" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sympy+un...@googlegroups.com.
To post to this group, send email to sy...@googlegroups.com.
Visit this group at http://groups.google.com/group/sympy.
To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/09b68809-bd21-4806-8f96-2b0a7cff722b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "sympy" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sympy+un...@googlegroups.com.
To post to this group, send email to sy...@googlegroups.com.
Visit this group at http://groups.google.com/group/sympy.

To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/CAKgW%3D6%2B0Oha6UMz4O6KK3kcVdLXEOaUdXWWODF6B0PfAZ%2B08JQ%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "sympy" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sympy+un...@googlegroups.com.
To post to this group, send email to sy...@googlegroups.com.
Visit this group at http://groups.google.com/group/sympy.
To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/CAP7f1AgfYAA7y87vAczE%3D8e%2BbKGX7E6p9-MfBsWT%2B9f627D3Ug%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

[Jason Moore]

I can try to come up with something...but I need to get back to the day job at the moment :(

Jason
moorepants.info
+01 530-601-9791

To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/CAKgW%3D6%2BFmBOr4O85ZD8%2BYrE-Hn9NRK04P8%2BuusEG1H4S%3DN%3DF6g%40mail.gmail.com.

[Ondřej Čertík]

On Mon, Jul 20, 2015 at 11:09 AM, Aaron Meurer <asme...@gmail.com> wrote:
> Awesome. This is exactly the sort of thing I've wanted to see for a long
> time.

>
> So apparently the new cache is way too slow. Can the size be increased to a
> point that makes the performance comparable to the old cache? One obviously
> has to balance the cache size against memory usage (which won't show up in
> the performance tests).

Indeed, thanks everybody for pushing this. I need to setup something
similar for SymEngine --- we can just run the tests using Python
wrappers, so ASV can be used for it as well.

I think this is useful even without a dedicated machine --- you just
run it on some machine that you have for few days, first every couple
hundreds of commits to get a quick graph back and then you "zoom in".

Ondrej

[Jason Moore]

I've got a machine that I don't use, so I'm going periodically run the benchmarks from Bjorn's repo and automatically publish them to:

moorepants.info/misc/sympy-asv

I'll make an initial pass and the results will likely be up by tomorrow sometime.

Once I get the base database up and running I will eventually have it pull down the benchmark repo from master so it will pick up new benchmarks and I'll have it skip existing successfully benchmarks/commits so that we only have to run the latest commits on a daily basis or so.

I'll see how this goes for a while and we can think about having a different machine run these and pushing to gh-pages or something.

Jason
moorepants.info
+01 530-601-9791

Ondrej

--
You received this message because you are subscribed to the Google Groups "sympy" group.

To unsubscribe from this group and stop receiving emails from it, send an email to sympy+un...@googlegroups.com.
To post to this group, send email to sy...@googlegroups.com.
Visit this group at http://groups.google.com/group/sympy.

To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/CADDwiVDukTrcuPZz38gWqDvTKs6Ot5D88O-vGhW3XnS6jkG16w%40mail.gmail.com.

[Peter Brady]

If we increase the default cache size and it speeds things up it might be worthwhile to revisit the travis test splits again.