Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

FYI, new SQLlite interface to the Independent CAS integration tests available

20 views
Skip to first unread message

Nasser M. Abbasi

unread,
Aug 24, 2022, 5:40:42 AM8/24/22
to
FYI

posted at https://groups.google.com/g/fricas-devel and
https://groups.google.com/g/sci.math.symbolic
---------------------------

<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>


To make it easier to query the Independent CAS integration tests results,
there is now an SQLite database which contains all relevant results
generated during testing. This is meant to complement the reports
and the webpages and not replace them.

The database and the reports were all generated from the same CSV tables
after running the integration tests. But using the SQL database it
is much easier to obtain the information needed by issuing SQL commands.

To use the database requires the free sqlite3 software. There is
also a free GUI interface.

There is an initial release of the database now with information how to
install it and the software needed use it at the above link.

The database is not fully populated yet, but can be used immediately.
It will take about another 1-2 weeks. The above page will indicate
when the database is completed.

Examples are given on the above page how to use it.

Any problems/bugs please let me know.

--Nasser

Nasser M. Abbasi

unread,
Sep 22, 2022, 7:39:21 AM9/22/22
to
Fyi,

CAS integrations tests SQL database is now fully build.

<http://localhost/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>

After extracting the zip file, the size of the db is 1.3 GB.

Total number of intergrals in the database is

sqlite> select COUNT(*) from main;
85479

Any problems please let me know.

--Nasser

Nasser M. Abbasi

unread,
Sep 22, 2022, 8:28:29 AM9/22/22
to
On 9/22/2022 6:39 AM, Nasser M. Abbasi wrote:

>
> CAS integrations tests SQL database is now fully build.
>
> <http://localhost/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>
>
> After extracting the zip file, the size of the db is 1.3 GB.
>
> Total number of intergrals in the database is
>
> sqlite> select COUNT(*) from main;
> 85479
>
> Any problems please let me know.
>

Just wanted to point out something that might not be clear in
case someone things there is something wrong in the data.

When checking how many integrals a CAS failed to solve, for example,
using Fricas

sqlite> select count(*) from main where fricas_pass=1;

64582

But this gives %pass of 75.55% but that is not the actual pass %. The
reason is that in final report, integrals which are not integrable
are counted as passed. But in the database itself, only the
initial score is recorded. The database only contains the raw
data.

The database has

sqlite> select count(*) from main where has_known_anti=0;

3561

i.e. there are 3,561 integrals that are non-integrable. So any
cas that fail these _within the time limit_, is counted as
passed, not failed.

So to obtain the correct number of passed integrals for cas
the command is

sqlite> select count(*) from main where fricas_pass=1
or (fricas_pass=0 and has_known_anti=0);

67589

And now this gives percentage of 79.07% which is the correct % for fricas.
THe same thing should be done for other CASes.

Note that in this update, Fricas results of 0 for anti-derivative
are detected now and counted as failed. Before there were counted
as passed. This only reduced Fricas score by just about 0.14% as
there was only 125 such integrals.

sqlite> select count(*) from main where fricas_anti=0;
125

--Nasser






0 new messages