Interesting Point regarding Genius 4/3 and SSDF:
In the past Genius 3 (P90) has a better SSDF ranking.
Now (SSDF list 9):
Genius 4 (P90) same ranking as Genius 3 (P90)
Genius 4 (486) better than Genius 3 (486)
Now Genius 4 seems to be no step back (some people believe that) and
Genius 5 seems to be a big step further!
Hansjoerg
>Hi,
>Last week I got my Chess Genius 5 copy from Gambit Soft
>http://www.gambitsoft.com (Germany). To get a first impression I made
>some games between Genius 5 against MChess 6 and Fritz 4 (30min Games on
>a Penium 133). MChess 6 seems to have no chance against Genius (Genius
>won four games, 2 remis). Same impression against Fritz. But in 4 games
>Genius (3 won) there was one lost (Genius came with a -2 pawn evaluation
>out of book). The lost game wasn't repeatable (learning feature!).
>The games were on a single machine without permanent brain and equal
>hash table size. Games with longer time controls on two machines may
>produce different results - but Genius 5 did much better than Genius 4
>under same conditions!
[snip]
As long as you are testing on the same machine the result is unreliable
as CPU time is not equally for both programs
Regards /hhg
--
************** Hans-Henrik Grand ****************
** ** ** Computer Science Department ** ** **
** ** ** Aarhus University ** ** **
*********** email: h...@daimi.aau.dk ****************
I make intensive checks to verify that both programs have nearly same
conditions (hash tables, permanent brain out, same slowdown for both
programs, dos box configuration,..).
I also made postgame analysis (it shows me that the programs had made
same moves if running alone!)
But I also think that running the programs on two equal machines would
give more reliable results.
Hansjoerg
--
Hansjoerg Zech
Internet: zech...@sni.de
X.400: c=DE;a=DBP;p=SCN;o=SNI;ou1=PDB1;ou2=S1;s=ZECH;g=HANSJOERG
SNI ASW C8, Heinz Nixdorf Ring 1, 33106 Paderborn
Phone: +49 5251 8 14926 Fax: +49 5251 8 14902
depends on the type of programs: I was running crafty vs. gbuchess via
winboard, and I could also check the CPU time used with some windows
tools. It comes out that essentially the share 50% of the CPU time
(actually crafty is a bit smarter).
So I think in this case it makes a lot of sense: even a 5% difference
in the CPU time would not affect the overall result.
regards
Franz
--
Francesco Di Tolla, Center for Atomic-scale Materials Physics
Physics Departement, Build. 307, Technical Univesity of Denmark,
DK-2800 Lyngby, Denmark, Tel.: (+45) 4525 3208 Fax: (+45) 4593 2399
mailto:dit...@fysik.dtu.dk http://www.fysik.dtu.dk/persons/ditolla.html
For crafty, yes. However, some like (apparently) CM5000 really hog the
cpu all of the time somehow. and can really screw up the game result...
>I make intensive checks to verify that both programs have nearly same
>conditions (hash tables, permanent brain out, same slowdown for both
>programs, dos box configuration,..).
>I also made postgame analysis (it shows me that the programs had made
>same moves if running alone!)
>But I also think that running the programs on two equal machines would
>give more reliable results.
That`s the only serious way ;-)
-Peter
Make sure that that the 2 equal machines are really equal by getting
exact copies made by the same manufacturer. One Pentium 90 is not
necessarily the same as another Pentium 90 if the manufacturers
are different. Even with the same identical machine, there can be
differences.
--
Komputer Korner
The komputer that kouldn't keep a password safe from
prying eyes, kouldn't kompute the square root of 36^n,
kouldn't find the real motive in ChessBase and missed
the real learning feature of Nimzo. Long live Nimzo!!!!!!