Just wanted to point out something that might not be clear in
case someone things there is something wrong in the data.
When checking how many integrals a CAS failed to solve, for example,
using Fricas
sqlite> select count(*) from main where fricas_pass=1;
64582
But this gives %pass of 75.55% but that is not the actual pass %. The
reason is that in final report, integrals which are not integrable
are counted as passed. But in the database itself, only the
initial score is recorded. The database only contains the raw
data.
The database has
sqlite> select count(*) from main where has_known_anti=0;
3561
i.e. there are 3,561 integrals that are non-integrable. So any
cas that fail these _within the time limit_, is counted as
passed, not failed.
So to obtain the correct number of passed integrals for cas
the command is
sqlite> select count(*) from main where fricas_pass=1
or (fricas_pass=0 and has_known_anti=0);
67589
And now this gives percentage of 79.07% which is the correct % for fricas.
THe same thing should be done for other CASes.
Note that in this update, Fricas results of 0 for anti-derivative
are detected now and counted as failed. Before there were counted
as passed. This only reduced Fricas score by just about 0.14% as
there was only 125 such integrals.
sqlite> select count(*) from main where fricas_anti=0;
125
--Nasser