Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Testsuites

Author: Manfred Meiler

Date: 03:35:00 07/19/03

Go up one level in this thread


On July 18, 2003 at 18:13:12, Tord Romstad wrote:

>On July 17, 2003 at 17:24:44, Michael Yee wrote:
>
>>For linux, I think gnumeric and openoffice excel files...

>
>You are probably right -- but I am not sure they are easy to install without
>root access, or that my available disk quota is big enough.  I prefer to use
>the limited space I have available to store a big opening book for my program
>:-)
>
>I think I will try to find some other nice tests instead.  Installing a big
>spreadsheat application just to run my program through a test suite seems like
>to much of an overkill.


Who said that you have to install a big spreadsheat application just to run the
"WM-Test" ?
My MS-Excel charts include "only" my results of 187 engines including the
possibility to get the "rating WM-Test" automaticly.
The test suite itself you can run of course "stand alone" - the formula of
WM-Test:

rating WM-Test = 2600 + 2*LQ - 5*GZ/100

LQ (Lösungsquote) = solve quota (sum of solved test positions)
GZ (Gesamtzeit)   = sum of used thinking time (in minutes)

Another method to measure/compare the results is EloStatTS by Dr. Frank Schubert
(also known from EloStat).
EloStatTS is a freeware program for fully automated analysis of computer chess
test sets given in PGN format. It produces an Elo rating list and several other
statistical parameters of the tested programs and of the positions examined.
Free download of EloStatTS at http://www.computerschach.de/freeware/index.htm

Manfred



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.