I tried again to play a game to start to triangulate on a rating for
GitClub. Here's what happened. I thought I would try ChessMaster 10
with its rated personalities (who knows how good the ratings are and
under what conditions they were taken, but what the heck). I used a
personality with an 1193 rating and set the game for 2/6 Fischer time,
with CM as black, GC as white; GC at "easy" level (40 seconds per move
in theory). Here is the game:

White -- Black
(easy) -- (CM 1193)

1. d2-d4{34} e7-e5{24}
2. d4-e5{28} Bf8-c5{18}
3. Nb1-c3{26} Ng8-f6{20}
4. Ng1-f3{74} Rh8-g8{14}
5. e5-f6{20} Qd8-f6{12}
6. Nc3-d5{32} Qf6-d8{14}
7. Bc1-f4{32} d7-d6{28}
8. Qd1-d3{36} c7-c6{12}
9. Qd3-h7{42} Ke8-f8{12}
10. Nd5-c3{22} Qd8-e7{18}
11. Qh7-g8{20}

I never actually saw GC's 11th move; the board disappeared and GC
claimed a win when it had in fact just thrown away its queen (I looked
up the move in GC's move records afterwards). I guess GC thought this
was checkmate even though the white queen is unprotected.

Now, up to this point I was reasonably impressed. ChessMaster was
doing its usual stupid thing of throwing away material to lower its
rating, but GitClub was handily taking advantage of it (though when CM
threw away a knight GC waited an extra move to pick it up; luckily CM
left it hanging). Still, under these conditions thus far in the game
it seemed like GC was on the way to victory.

But with stupid bugs like claiming a checkmate in error, who has the
patience to try to evaluate GC properly, with a long enough series of
games under controlled conditions? I was about to do that but I was
frustrated again.

No doubt Sanny will fix this bug and proclaim the program better than
ever and ready to trounce Rybka in the future, but I'm about ready to
give it all up. After so many months the program ought to at least
play by the rules. And it would be really nice to show the final
position and not just delete the board and say "game over."