sage-5.0.beta8 released

92 views
Skip to first unread message

Jeroen Demeyer

unread,
Mar 13, 2012, 10:09:11 AM3/13/12
to sage-r...@googlegroups.com
Dear Sage lovers,

We're releasing Sage 5.0.beta8.

Source archive:

http://boxen.math.washington.edu/home/release/sage-5.0.beta8/sage-5.0.beta8.tar

Upgrade path:

http://boxen.math.washington.edu/home/release/sage-5.0.beta8/sage-5.0.beta8/

The source and upgrade path can also be found on the mirror network
(you might need to wait a while before the mirrors are synchronized):

http://www.sagemath.org/download-latest.html


Please build, test, and report! We'd love to hear about your
experiences with this release.

== Tickets ==

* We closed 292 tickets in this release. For details, see

http://boxen.math.washington.edu/home/release/sage-5.0.beta8/tickets.html

Closed tickets:

#2999: Some packages don't respect the CC environment variable [Reviewed
by Michael Orlitzky, R. Andrew Ohana]
#3000: Some packages don't respect the CXX environment variable
[Reviewed by Michael Orlitzky, R. Andrew Ohana]
#3631: Delete *.pyc files when building Sage specific spkgs like extcode
[Reviewed by Jeroen Demeyer]
#7626: delete PBUILD code in local/bin/sage-sage script [Reviewed by
Jeroen Demeyer]
#11303: Fix the documentation of attach [Reviewed by Florent Hivert]

Merged in sage-5.0.beta8:

#9128: Florent Hivert: Sphinx should be aware of all.py to find its
links [Reviewed by Andrey Novoseltsev, Nicolas M. Thiéry]
#10296: Simon King: Singular interface wasting time by waiting for the
prompt too often [Reviewed by Martin Albrecht]
#10682: Dima Pasechnik: Upgrade maxima to 5.26 [Reviewed by Jean-Pierre
Flori, Nils Bruin]
#10817: Christian Stump: implementation of the generalized associahedron
as a polyhedral complex [Reviewed by Frédéric Chapoton, Nicolas M. Thiéry]
#10976: Christopher Swenson: computing order of a certain subgroup of a
permutation group is double dog slow (compared to Magma) [Reviewed by
William Stein]
#12202: Sebastian Pancratz, David Loeffler: Bug in
hecke_operator_on_basis [Reviewed by Jan Vonk]
#12392: David Roe: Doctest fix in sage/categories/modules_with_basis.py
[Reviewed by Jim Stark]
#12397: David Roe: Change doctests to remove trailing backslashes
[Reviewed by Jim Stark]
#12405: Jeroen Demeyer: Add $SAGE_LOCAL/lib64 to LD_LIBRARY_PATH
[Reviewed by Volker Braun]
#12470: Jeroen Demeyer: Remove scripts related to the Debian
distribution [Reviewed by Punarbasu Purkayastha]
#12480: David Roe: NTL segfault on OS X 10.7 [Reviewed by William Stein,
Jeroen Demeyer]
#12519: Jeroen Demeyer: cvxopt should not add -lcblas and -latlas on
Darwin [Reviewed by Dmitrii Pasechnik]
#12562: Jeroen Demeyer: In Singular spkg-install, disable -pipe on SunOS
[Reviewed by John Palmieri]
#12564: Daniel Krenn: documentation of SR wildcard: n instead of i
[Reviewed by David Loeffler]
#12581: Karl-Dieter Crisman: Fix contour and other plot default aspect
ratio [Reviewed by Benjamin Jones, David Loeffler]
#12585: Hugh Thomas: Bring matrix/matrix0.pyx to 100% coverage [Reviewed
by David Loeffler, Karl-Dieter Crisman]
#12616: Nathann Cohen: The LP are not deallocated because of cyclic
references ! [Reviewed by Simon King]
#12618: Jeroen Demeyer: Don't delete dist/sage-rsync directory in
sage-rsyncdist script [Reviewed by David Roe]
#12625: David Roe: Conversion of pari elements to Sage fails on some
negative valuation elements [Reviewed by Xavier Caruso]
#12626: David Coudert: Kautz, Imase and Itoh, and Generalized de Bruijn
digraph generators [Reviewed by Nathann Cohen]
#12629: Jeroen Demeyer: Completely disable the LinBox commentator
[Reviewed by Martin Albrecht]
#12632: David Loeffler: bug comparing trivial Dirichlet characters
[Reviewed by Jonathan Bober]
#12633: Nils Bruin: Fix doc of attach [Reviewed by Justin Walker]
#12635: Jeroen Demeyer: Remove pbuild files [Reviewed by Punarbasu
Purkayastha]
#12637: John Palmieri: Follow-up to #4949: don't delete the current
working directory [Reviewed by Jeroen Demeyer]
#12642: Nils Bruin: magma_free interface is broken [Reviewed by William
Stein]
#12645: Simon King: Fix rst markup for sage/combinat/sf/sf.py (and add
to manual) and sage/structure/dynamic_class.py [Reviewed by Nicolas M.
Thiéry]

Minh Nguyen

unread,
Mar 14, 2012, 3:02:04 AM3/14/12
to sage-r...@googlegroups.com
Hi,

On Wed, Mar 14, 2012 at 1:09 AM, Jeroen Demeyer <jdem...@cage.ugent.be> wrote:
> Please build, test, and report! We'd love to hear about your
> experiences with this release.

Built fine on Ubuntu 11.10, Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz

$ uname -a
Linux melb 3.0.0-16-generic-pae #29-Ubuntu SMP Tue Feb 14 13:56:31 UTC
2012 i686 i686 i386 GNU/Linux

Both the HTML and PDF versions of the documentation built OK. All
tests passed with "ptestlong".

--
Regards,
Minh Van Nguyen
http://sage.math.washington.edu/home/mvngu/

leif

unread,
Mar 14, 2012, 3:27:18 AM3/14/12
to sage-r...@googlegroups.com
Minh Nguyen wrote:
> Hi,
>
> On Wed, Mar 14, 2012 at 1:09 AM, Jeroen Demeyer<jdem...@cage.ugent.be> wrote:
>> Please build, test, and report! We'd love to hear about your
>> experiences with this release.
>
> Built fine on Ubuntu 11.10, Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz

Also passed ptestlong on

Ubuntu 10.04.4 LTS x86_64 (AMD E-450, GCC 4.4.3, native code)


-leif

>
> $ uname -a
> Linux melb 3.0.0-16-generic-pae #29-Ubuntu SMP Tue Feb 14 13:56:31 UTC
> 2012 i686 i686 i386 GNU/Linux
>
> Both the HTML and PDF versions of the documentation built OK. All
> tests passed with "ptestlong".
>


--
() The ASCII Ribbon Campaign
/\ Help Cure HTML E-Mail

davidloeffler

unread,
Mar 14, 2012, 5:54:02 AM3/14/12
to sage-r...@googlegroups.com
Built fine with SAGE_CHECK set, and passed ptestlong, on a 64-bit Debian box. Already running a patchbot chomping through needs_review patches on trac.

David

David Loeffler

unread,
Mar 14, 2012, 7:40:18 AM3/14/12
to sage-r...@googlegroups.com
I get a funny warning when copying/moving a Sage 5.0.beta8 build tree:

The Sage installation tree may have moved
(from /storage/masiao/sage-5.0.beta8 to /storage/masiao/sage-5.0.beta8-steinwatkins).
Changing various hardcoded paths...
(Please wait at most a few minutes.)
DO NOT INTERRUPT THIS.
Error: sage_location: update_pkgconfig_files():
  File "libR.pc" doesn't contain a definition of SAGE_ROOT.
  Skipping it...
Done resetting paths.
Loading Sage library. Current Mercurial branch is: scratch

Any idea what's behind this? (I don't know if this is specific to beta8.)

David

Justin C. Walker

unread,
Mar 14, 2012, 9:41:08 AM3/14/12
to sage-r...@googlegroups.com

On Mar 13, 2012, at 07:09 , Jeroen Demeyer wrote:

> Dear Sage lovers,
>
> We're releasing Sage 5.0.beta8.
>
> Source archive:
>
> http://boxen.math.washington.edu/home/release/sage-5.0.beta8/sage-5.0.beta8.tar

Built from scratch on Mac OS X, 10.6.8 (Dual 6-core Xeon): no problems. All tests ('ptestlong') passed!

Justin

--
Justin C. Walker
Curmudgeon-at-large
--
Network, n., Difference between work
charged for and work done

leif

unread,
Mar 14, 2012, 3:01:46 PM3/14/12
to sage-r...@googlegroups.com


Well, what's funny about that message?

More importantly, how does your $SAGE_ROOT/local/lib/pkgconfig/libR.pc
look like?


-leif

David Loeffler

unread,
Mar 14, 2012, 6:08:57 PM3/14/12
to sage-r...@googlegroups.com


On Wednesday, 14 March 2012 19:01:46 UTC, leif wrote:

Well, what's funny about that message?

Just that it probably shouldn't be there.
 

More importantly, how does your $SAGE_ROOT/local/lib/pkgconfig/libR.pc
look like?

The copied version still contains the path to the old version -- it's not been updated as it should have been.

David

leif

unread,
Mar 15, 2012, 1:48:30 AM3/15/12
to sage-r...@googlegroups.com


Did you do anything special (like reinstalling the R spkg) with your
original installation before you made the copy, or did anything unusual
happen during the build?


The .pc files get "initialized"* (the $SAGE_ROOT part of any paths
factored out into a SAGE_ROOT variable) during the first start-up of
Sage, which usually happens right after the build (if you type 'make'
rather than 'make build'); you can normally see this from the timestamps
of $SAGE_ROOT/local/lib/sage-started.txt and the .pc files (in
$SAGE_ROOT/local/lib/pkgconfig/), which are (almost) identical.

But maybe you just did 'make build' and made the copy before running
Sage once (running 'make doc' or 'make *test*' has the same effect),
which you [currently] shouldn't do... :-)


You should also check whether the libR.pc file of your original
installation is sane (i.e., got "initialized" as described above); if
not, try running Sage and take a second look at it.


-leif

_____
* in case they aren't yet; in principle an spkg's spkg-install script
should already set up the SAGE_ROOT variable there, and make all paths
relative to it.


P.S.: My (slightly redundant but correct) libR.pc looks like this:


SAGE_ROOT=/data/leif/Sage/sage-5.0.beta8
rhome=${SAGE_ROOT}/local/lib/R
rlibdir=${rhome}/lib
rincludedir=${SAGE_ROOT}/local/lib/R/include

Name: libR
Description: R as a library
Version: 2.14.0
Libs: -L${rlibdir} -lR
Cflags: -I${rincludedir} -I${rincludedir}
Libs.private:

David Loeffler

unread,
Mar 15, 2012, 5:09:05 AM3/15/12
to sage-r...@googlegroups.com

On Thursday, 15 March 2012 05:48:30 UTC, leif wrote:David Loeffler wrote:
> On Wednesday, 14 March 2012 19:01:46 UTC, leif wrote:
>     More importantly, how does your $SAGE_ROOT/local/lib/
pkgconfig/libR.pc
>     look like?
>
> The copied version still contains the path to the old version -- it's
> not been updated as it should have been.


Did you do anything special (like reinstalling the R spkg) with your
original installation before you made the copy, or did anything unusual
happen during the build?

 
I did no funny business whatsoever with the R spkg, and this build of Sage had already been used several times before I copied it. Here's a transcript of the session:

masiao@fermat:~$ cd /storage/masiao
masiao@fermat:/storage/masiao$ cat sage-5.0.beta8/local/lib/pkgconfig/libR.pc
rhome=/storage/masiao/sage-5.0.beta8/local/lib/R
rlibdir=${rhome}/lib
rincludedir=/storage/masiao/sage-5.0.beta8/local/lib/R/include


Name: libR
Description: R as a library
Version: 2.14.0
Libs: -L${rlibdir} -lR
Cflags: -I${rincludedir} -I${rincludedir}
Libs.private:
masiao@fermat:/storage/masiao$ cp -r sage-5.0.beta8 sage-5.0.beta8-copy
masiao@fermat:/storage/masiao$ cd sage-5.0.beta8-copy/
masiao@fermat:/storage/masiao/sage-5.0.beta8-copy$ ./sage
----------------------------------------------------------------------
| Sage Version 5.0.beta8, Release Date: 2012-03-13                   |                                                            
| Type notebook() for the GUI, and license() for information.        |
----------------------------------------------------------------------
**********************************************************************
*                                                                    *
* Warning: this is a prerelease version, and it may be unstable.     *
*                                                                    *
**********************************************************************

The Sage installation tree may have moved
(from /storage/masiao/sage-5.0.beta8 to /storage/masiao/sage-5.0.beta8-copy).

Changing various hardcoded paths...
(Please wait at most a few minutes.)
DO NOT INTERRUPT THIS.
Error: sage_location: update_pkgconfig_files():
  File "libR.pc" doesn't contain a definition of SAGE_ROOT.
  Skipping it...
Done resetting paths.
sage:
Exiting Sage (CPU time 0m0.10s, Wall time 0m42.20s).
Exiting spawned Gap process.
masiao@fermat:/storage/masiao$ cat sage-5.0.beta8-copy/local/lib/pkgconfig/libR.pc
rhome=/storage/masiao/sage-5.0.beta8/local/lib/R
rlibdir=${rhome}/lib
rincludedir=/storage/masiao/sage-5.0.beta8/local/lib/R/include


Name: libR
Description: R as a library
Version: 2.14.0
Libs: -L${rlibdir} -lR
Cflags: -I${rincludedir} -I${rincludedir}
Libs.private:

So the update_pkgconfigfiles() script is failing to update this file as it should.

David

leif

unread,
Mar 15, 2012, 5:51:28 AM3/15/12
to sage-r...@googlegroups.com


Well, the problem is that the .pc file can [currently] only be updated
(i.e., paths adapted, or more precisely, the definition of SAGE_ROOT
changed) if it's previously been "initialized", which should have
happened in your original installation, as mentioned in my previous post.

To cure your installation(s), it should be sufficient to delete
$SAGE_ROOT/local/lib/sage-current-location.txt of your original
installation, run its Sage once, make a fresh copy and run the Sage of
the copy to this time really update all hard-coded paths.


I still wonder why your libR.pc didn't get "initialized" in the first place.

Do the [other] .pc files (except the symlinks) in
$SAGE_ROOT/local/lib/pkgconfig/ all have the same timestamp as
$SAGE_ROOT/local/lib/sage-started.txt?

(And did you build Sage with 'make build' or just 'make'?)


-leif

David Loeffler

unread,
Mar 15, 2012, 6:31:13 AM3/15/12
to sage-r...@googlegroups.com
The timestamps are:

masiao@fermat:/storage/masiao/sage-5.0.beta8$ ls -lt local/lib/sage-started.txt
-rw-r--r-- 1 masiao masiao 50 2012-03-13 17:02 local/lib/sage-started.txt
masiao@fermat:/storage/masiao/sage-5.0.beta8$ ls -lt local/lib/pkgconfig/
total 52
-rw-r--r-- 1 masiao masiao  268 2012-03-13 17:10 libR.pc
-rw-r--r-- 1 masiao masiao  319 2012-03-13 17:02 bdw-gc.pc
-rw-r--r-- 1 masiao masiao  337 2012-03-13 17:02 freetype2.pc
-rw-r--r-- 1 masiao masiao 1200 2012-03-13 17:02 gnutls-extra.pc
-rw-r--r-- 1 masiao masiao  987 2012-03-13 17:02 gnutls.pc
-rw-r--r-- 1 masiao masiao  352 2012-03-13 17:02 gsl.pc
-rw-r--r-- 1 masiao masiao  300 2012-03-13 17:02 libpng12.pc
-rw-r--r-- 1 masiao masiao  312 2012-03-13 17:02 m4ri.pc
-rw-r--r-- 1 masiao masiao  965 2012-03-13 17:02 opencdk.pc
-rw-r--r-- 1 masiao masiao  329 2012-03-13 17:02 pynac.pc
-rw-r--r-- 1 masiao masiao  317 2012-03-13 17:02 python-2.7.pc
-rw-r--r-- 1 masiao masiao  330 2012-03-13 17:02 sqlite3.pc
-rw-r--r-- 1 masiao masiao  316 2012-03-13 17:02 zlib.pc
 
I have no idea why libR.pc has a more recent timestamp than the others! I think I built with "make ptestlong", actually, in order to build and test in one go. I'm doing another test build now, to see if I can replicate the problem consistently.

David

Alexander Dreyer

unread,
Mar 15, 2012, 9:42:25 AM3/15/12
to sage-r...@googlegroups.com
Hi,
built and made "make ptestlong" successfully on a Power-Mac ppc running
OS X 10.5.

Best regards,
Alexander

> links [Reviewed by Andrey Novoseltsev, Nicolas M. Thi�ry]


> #10296: Simon King: Singular interface wasting time by waiting for the
> prompt too often [Reviewed by Martin Albrecht]
> #10682: Dima Pasechnik: Upgrade maxima to 5.26 [Reviewed by Jean-Pierre
> Flori, Nils Bruin]
> #10817: Christian Stump: implementation of the generalized associahedron

> as a polyhedral complex [Reviewed by Fr�d�ric Chapoton, Nicolas M. Thi�ry]

> Thi�ry]
>


--
Dr. rer. nat. Dipl.-Math. Alexander Dreyer

Abteilung "Systemanalyse, Prognose und Regelung"
Fraunhofer Institut f�r Techno- und Wirtschaftsmathematik (ITWM)
Fraunhofer-Platz 1
67663 Kaiserslautern

Telefon +49 (0) 631-31600-4318
Fax +49 (0) 631-31600-1099
E-Mail alexande...@itwm.fraunhofer.de
Internet http://www.itwm.fraunhofer.de/sys/dreyer.html

David Loeffler

unread,
Mar 15, 2012, 5:33:28 PM3/15/12
to sage-r...@googlegroups.com


On Thursday, 15 March 2012 10:31:13 UTC, David Loeffler wrote:

I have no idea why libR.pc has a more recent timestamp than the others! I think I built with "make ptestlong", actually, in order to build and test in one go. I'm doing another test build now, to see if I can replicate the problem consistently.

I can't replicate the problem, so it must have been just some weird random glitch. Apologies for the noise,

David 

Georg Grafendorfer

unread,
Mar 20, 2012, 1:35:55 PM3/20/12
to sage-release
Hi,

Fedora 15 on AMD Phenom II X4,
sage5.0.beta8, built from scratch ok,
doctest failure while performing make ptestlong,
error does not appear in sage5.0beta6, for the beta7 I don't know, can
tell you tomorrow if necessary,

here are the last lines of ptestlong.log:

sage -t --long -force_lib devel/sage/sage/sets/family.py
[1.7 s]
sage -t --long -force_lib devel/sage/sage/tests/interrupt.pyx
*** *** Error: TIMED OUT! PROCESS KILLED! *** ***

[1800.2 s]

----------------------------------------------------------------------
The temporary doctesting directory
/hg/u/ggeorg/.sage/tmp/maschke-18150
was not removed: it is not empty, presumably because doctests
failed or doctesting was interrupted.

----------------------------------------------------------------------

The following tests failed:

sage -t --long -force_lib devel/sage/sage/tests/interrupt.pyx # Time
out
----------------------------------------------------------------------
Total time for all tests: 3153.7 seconds


lg, Georg



On Mar 13, 3:09 pm, Jeroen Demeyer <jdeme...@cage.ugent.be> wrote:
> Dear Sage lovers,
>
> We're releasing Sage 5.0.beta8.
>
> Source archive:
>
> http://boxen.math.washington.edu/home/release/sage-5.0.beta8/sage-5.0...
>
> Upgrade path:
>
> http://boxen.math.washington.edu/home/release/sage-5.0.beta8/sage-5.0...
>
> The source and upgrade path can also be found on the mirror network
> (you might need to wait a while before the mirrors are synchronized):
>
> http://www.sagemath.org/download-latest.html
>
> Please build, test, and report!  We'd love to hear about your
> experiences with this release.
>
> == Tickets ==
>
> * We closed 292 tickets in this release. For details, see
>
>  http://boxen.math.washington.edu/home/release/sage-5.0.beta8/tickets....

Volker Braun

unread,
Mar 20, 2012, 1:42:48 PM3/20/12
to sage-r...@googlegroups.com
You need to increase the timeout if your processor is this slow (sorry ;-)

Georg Grafendorfer

unread,
Mar 20, 2012, 2:51:21 PM3/20/12
to sage-release
yes, my AMD quad quore does not satisfy sage's minimal requirements :-
(

thanks anyway, Georg




On Mar 20, 6:42 pm, Volker Braun <vbraun.n...@gmail.com> wrote:
> You need to increase the timeout if your processor is this slow (sorry ;-)
>
> See SAGE_TIMEOUT inhttp://www.sagemath.org/doc/installation/source.html

Justin C. Walker

unread,
Mar 20, 2012, 2:58:51 PM3/20/12
to sage-r...@googlegroups.com

It's hard to imagine what kind of processor could so slow that it times out on the kind of tests run in 'interrupt.pyx'. 30 minutes?

Isn't this kind of failure more indicative of a lost interrupt (or something similar)?

Justin

--
Justin C. Walker
Director
Institute for the Enhancement of the Director's Income
--
Fame is fleeting, but obscurity
just drags on and on. F&E

leif

unread,
Mar 20, 2012, 3:38:25 PM3/20/12
to sage-r...@googlegroups.com
Volker Braun wrote:
> You need to increase the timeout if your processor is this slow (sorry ;-)

I guess you didn't mean this seriously...

If interrupt.pyx takes more than 30 minutes, this means it hangs.


I btw. noticed I get (busy) orphans on timeouts; this is relatively new,
i.e., had IMHO been solved a while ago.

Andrey Novoseltsev

unread,
Mar 21, 2012, 1:49:55 AM3/21/12
to sage-r...@googlegroups.com


On Tuesday, 20 March 2012 13:38:25 UTC-6, leif wrote:
Volker Braun wrote:
> You need to increase the timeout if your processor is this slow (sorry ;-)

I guess you didn't mean this seriously...

If interrupt.pyx takes more than 30 minutes, this means it hangs.


Actually, I think that something is waiting for something that goes way slower than it should, as on different AMD processors from quite old Athlon 64 to quite new Phenom II X6 some tests take forever without doing anything. The worst offender seems to be
sage -t -long sage/sandpiles/sandpile.py
When I run this test, I can see the process in the top ouput which is almost always sleeping. There is also this command
Singular-3-1-3 -t --ticks-per-sec 1000
which seems to be associated to this doctest. So - no CPU activity, no disk activity, but this test takes like 8 minutes and used to take 20 on a 3.2GHz CPU, so to get things going I was using -tp 24 (despite of only 6 cores) in which case all long tests were done in 20 min. CPU is not slow...

Best regards,
Andrey

Dima Pasechnik

unread,
Mar 21, 2012, 3:01:37 AM3/21/12
to sage-r...@googlegroups.com
could it be a bug (platform-specific, maybe) in Singular interface, or an interface-related bug in sandpile code which calls SIngular?
(I know it does call Singular)

These tests take about 30sec on my relatively slow Macbook Air running OSX 10.6.8.

Dima


 

Best regards,
Andrey

Jonathan Bober

unread,
Mar 21, 2012, 4:02:29 AM3/21/12
to sage-r...@googlegroups.com
On Tue, Mar 20, 2012 at 10:35 AM, Georg Grafendorfer
<georg.gra...@gmail.com> wrote:
> Hi,
>
> Fedora 15 on AMD Phenom II X4,
> sage5.0.beta8, built from scratch ok,
> doctest failure while performing make ptestlong,
> error does not appear in sage5.0beta6, for the beta7 I don't know, can
> tell you tomorrow if necessary,
>
> here are the last lines of ptestlong.log:
>
> sage -t  --long -force_lib devel/sage/sage/sets/family.py
>         [1.7 s]
> sage -t  --long -force_lib devel/sage/sage/tests/interrupt.pyx
> *** *** Error: TIMED OUT! PROCESS KILLED! *** ***
>
>         [1800.2 s]
>

I have seen this before, on a core i7. It went away when I tried
again, and I haven't seen it again, so I didn't think much of it. No,
your CPU is not too slow.

Is the timeout actually reproducible? My guess is no. That file seems
to be have some imperfectly designed tests with race conditions that
could cause occasional failures. For example, the function

cdef void infinite_malloc_loop():
cdef size_t s = 1
while True:
sage_free(sage_malloc(s))
s *= 2
if (s > 1000000): s = 1

will ignore an interrupt if it is received on either of the last two
lines, I think, and the tests are of the form "run this function and
then interrupt it to make sure that it can be interrupted."

(And this test will also leak memory if it is interrupted after the
malloc() but before the free().)

David Loeffler

unread,
Mar 21, 2012, 5:03:29 AM3/21/12
to sage-r...@googlegroups.com
On Wednesday, 21 March 2012 05:49:55 UTC, Andrey Novoseltsev wrote:

Actually, I think that something is waiting for something that goes way slower than it should, as on different AMD processors from quite old Athlon 64 to quite new Phenom II X6 some tests take forever without doing anything. The worst offender seems to be
sage -t -long sage/sandpiles/sandpile.py
When I run this test, I can see the process in the top ouput which is almost always sleeping. There is also this command
Singular-3-1-3 -t --ticks-per-sec 1000
which seems to be associated to this doctest. So - no CPU activity, no disk activity, but this test takes like 8 minutes and used to take 20 on a 3.2GHz CPU, so to get things going I was using -tp 24 (despite of only 6 cores) in which case all long tests were done in 20 min. CPU is not slow...

Best regards,
Andrey


I think this is probably orthogonal to Georg's problem in interrupt.pyx, but certain functions that call external packages such as Singular or Gap seem to take forever on certain machines, and sandpile.py is one of the worst offenders. Here at Warwick we have two boxes (fermat and selmer) which are used by the number theory group, which are not that dissimilar in architecture and CPU speed; but the sandpile.py test takes about four times longer on fermat than on selmer, and regularly exceeds the default 360-second timeout for standard (non-long) doctests.

(A quick diagnostic is that "GL(4, 3).random_element()" takes about 3 sec on fermat, but only 0.78 sec on selmer. This function calls Gap to do something incredibly trivial -- the actual Gap execution time is about 0.07 sec on both machines -- so something is killing us in the interface between Sage and Gap, and that something seems to be very machine-dependent.)

The interrupt.pyx issue, on the other hand, is clearly different because interrupt.pyx doesn't actually do any real computation -- the purpose is to check that processes can be properly interrupted, so if it's timing out, there's clearly interrupts getting lost! I've also found what Leif reports -- on recent Sage beta versions, doctest timeouts sometimes seem to leave a busy orphan process, that monopolizes a core until hunted down and killed by hand.

David

leif

unread,
Mar 21, 2012, 5:28:10 AM3/21/12
to sage-r...@googlegroups.com


So fermat runs Ubuntu 10.04, as opposed to selmer?

David Loeffler

unread,
Mar 21, 2012, 5:33:37 AM3/21/12
to sage-r...@googlegroups.com


On Wednesday, 21 March 2012 09:28:10 UTC, leif wrote:


So fermat runs Ubuntu 10.04, as opposed to selmer?


I don't know how you knew that, but fermat does indeed run Ubuntu 10.04.3, while Selmer (which is older, although faster) runs Ubuntu 9.04. Is this a known issue with Ubuntu?

David

Dima Pasechnik

unread,
Mar 21, 2012, 5:34:17 AM3/21/12
to sage-r...@googlegroups.com


On Wednesday, 21 March 2012 17:03:29 UTC+8, David Loeffler wrote:
On Wednesday, 21 March 2012 05:49:55 UTC, Andrey Novoseltsev wrote:

Actually, I think that something is waiting for something that goes way slower than it should, as on different AMD processors from quite old Athlon 64 to quite new Phenom II X6 some tests take forever without doing anything. The worst offender seems to be
sage -t -long sage/sandpiles/sandpile.py
When I run this test, I can see the process in the top ouput which is almost always sleeping. There is also this command
Singular-3-1-3 -t --ticks-per-sec 1000
which seems to be associated to this doctest. So - no CPU activity, no disk activity, but this test takes like 8 minutes and used to take 20 on a 3.2GHz CPU, so to get things going I was using -tp 24 (despite of only 6 cores) in which case all long tests were done in 20 min. CPU is not slow...

Best regards,
Andrey


I think this is probably orthogonal to Georg's problem in interrupt.pyx, but certain functions that call external packages such as Singular or Gap seem to take forever on certain machines, and sandpile.py is one of the worst offenders. Here at Warwick we have two boxes (fermat and selmer) which are used by the number theory group, which are not that dissimilar in architecture and CPU speed; but the sandpile.py test takes about four times longer on fermat than on selmer, and regularly exceeds the default 360-second timeout for standard (non-long) doctests.

it's known that Debian/Ubuntu kernels are very slow for pexpect interface,
as opposed to Redhat/Fedora/Centos, etc.
It can be cured by a kernel patch.

It was discussed on sage-devel at length, by Simon King and others.

leif

unread,
Mar 21, 2012, 5:54:33 AM3/21/12
to sage-r...@googlegroups.com
Dima Pasechnik wrote:
> On Wednesday, 21 March 2012 17:03:29 UTC+8, David Loeffler wrote:
> I think this is probably orthogonal to Georg's problem in
> interrupt.pyx, but certain functions that call external packages
> such as Singular or Gap seem to take forever on certain machines,
> and sandpile.py is one of the worst offenders. Here at Warwick we
> have two boxes (fermat and selmer) which are used by the number
> theory group, which are not that dissimilar in architecture and CPU
> speed; but the sandpile.py test takes about four times longer on
> fermat than on selmer, and regularly exceeds the default 360-second
> timeout for standard (non-long) doctests.
>
>
> it's known that Debian/Ubuntu kernels are very slow for pexpect interface,
> as opposed to Redhat/Fedora/Centos, etc.
> It can be cured by a kernel patch.

Well, Debian fixed this relatively quickly, while Ubuntu didn't (in the
10.04 series; later releases never had this problem).

I run Ubuntu 10.04.4 LTS with a 2.6.38 kernel, so do no longer have this
problem.


> It was discussed on sage-devel at length, by Simon King and others.

And here as well IIRC.

leif

unread,
Mar 21, 2012, 6:02:26 AM3/21/12
to sage-r...@googlegroups.com
leif wrote:
> I run Ubuntu 10.04.4 LTS with a 2.6.38 kernel, so do no longer have this
> problem.

(The 2.6.38 kernel is not from the .4 release; the latter has 2.6.32.)

John Cremona

unread,
Mar 21, 2012, 6:27:45 AM3/21/12
to sage-r...@googlegroups.com
Of our two machines David was mentioning:

@ selmer (older) is running Ubuntu 9.04 with 2.6.28-13-generic kernel
and gcc version 4.3.3 (Ubuntu 4.3.3-5ubuntu4)
@ fermat (less old) is running Ubuntu 10.04.3 LTS with
2.6.32-37-server kernel and gcc version 4.4.3 (Ubuntu
4.4.3-4ubuntu5.1)

Both are rather heavily used, and also physically inaccessible to us
without some hassle, so do not get their software updates as often as
one might hope for.

John

> --
> You received this message because you are subscribed to the Google Groups
> "sage-release" group.
> To post to this group, send email to sage-r...@googlegroups.com.
> To unsubscribe from this group, send email to
> sage-release...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/sage-release?hl=en.
>

Georg Grafendorfer

unread,
Mar 21, 2012, 6:45:09 PM3/21/12
to sage-release
its not reproducible, I ran the ptestlong again, now without any
errors,

Georg
Reply all
Reply to author
Forward
0 new messages