Monday, July 24, 2006

Scientific Test, Part V: Results

Classification of targets

TFC positive means that a target scored highest in target feature count. TFC negative means that a target scored less than highest. True means that Deep Shredder classified the target according to TFC. False means that Deep Shredder disagreed with TFC.

TFCtrue      false      
positive     6621

87 targets in 74 positions scored highest. In 61 positions, there was only one top scoring target. In 12 positions, there were two top targets, and in one position there were three top targets.

In most cases, Deep Shredder agreed with TFC, either in the positive way (a target scoring highest is to be attacked by the best move) or in the negative way (a target scoring less than highest is not to be attacked by the best move).

The TFC test has a sensitivity of 89 percent: If a target is rated top by Deep Shredder, the probability is 89% that it will score highest in TFC.

The TFC test has a specificity of 86 percent: If a target scores highest in TFC, the probability is 86% that it will be rated top by Deep Shredder.

More about the calculation of sensitivity and specificity ...

Note that the TFC test does not say anything about moves. If a target scores top there may be a number of moves to attack it, and only one of them is the best one.


At 11:15 PM, Blogger generalkaia said...

so, do these targets that you mention, did you just take the targets that appear when the position is about equal? or what?

At 9:44 AM, Blogger Mousetrapper said...

No, only if there was a favourable move, as rated by Deep Shredder, that is an advantage for one side. My method is only useful in such positions. In equal positions it is useless, therefore I did not test it in such positions.

At 11:01 AM, Blogger Temposchlucker said...

During a game you don't know how Shredder would score the position. How do you know it's time for TFC? Or is this question too premature?

At 11:10 AM, Blogger Mousetrapper said...

Will be a subject of discussion. Just for the moment, in brief: TFC can be done all the time, because most of the time there are only 3 targets scoring 3 or more. If the position is tactical, it is a matter of pattern recognition to find the right moves.

At 6:17 PM, Blogger Temposchlucker said...

Do I understand it well that there were 8 out of 135 cases where Shredder decided to attack a target with negative TFC?

At 6:20 PM, Blogger Temposchlucker said...

And that Shredder decided in 21 of 87 cases NOT to attack a target with a positive TFC? What kind of move was made then?

At 7:52 AM, Blogger Mousetrapper said...

Tempo, right, in 8 cases the move was either positional or directed to a target with a low sum of features, but these were more important than others. TFC does not weight features but treats them all as same value. And right, in 21 cases there were more than one target that rated top in TFC. Only one of them was the best. In TFC, unlike tennis, there is no tie break.


Post a Comment

<< Home