17.08.2007 14:52, Dave:
But I've added code that will determine
if the difference in score between two moves is really real
('statistically significant') , or if it could be due to chance.

Two important factors are completely ignored in this calculation:
development over time and strength of the involved players. The first is
important because once a refuation or at least a very strong answer for
a move is found, its frequency drops. So, the old statistics of this
move stay unchanged over a long time - possibly with a favourable result
for this move, although it might be well known that this move should be
avoided.

The second factor is quite obvious: games of higher rated players tend
to be less erratic, so that those results are more expressive.
Therefore, if I look at numbers, I check the average Elo and the
performance.

Greetings,
Ralf