[Pachi] Regression ?
pasky at ucw.cz
Fri Apr 8 18:37:36 CEST 2016
On Fri, Apr 08, 2016 at 05:57:52PM +0200, lemonsqueeze wrote:
> Thanks, i'll give it a try.
> In the meantime i played fast single threaded games on 15x15, and here
> everything looks fine (50% winrate on 2500 games, no large patterns though)
> so i'm wondering if it might not be a threading issue instead. Do you think
> it's possible recent changes might have broken thread synchronization ?
Well, to be fair, your DCNN changes are only enabled for 19x19.
I've started some tests too, my results:
/ 78 0.538 0.056 15--45.5-1-gnugo10-pm-32e02-_500-playout=moggy
/ 96 0.5 0.051 15--45.5-1-gnugo10-pm-febab-_500-playout=moggy
. 222 0.432 0.033 19--45.5-1-gnugo10-pm-32e02-_600-playout=moggy
. 208 0.361 0.033 19--45.5-1-gnugo10-pm-febab-_600-playout=moggy
(single-thread, against gnugo with -45.5 komi; 15x15 with -t _500, 19x19
with -t _600; these are my standard autoplay settings)
So nothing really definite came out of that. Someone really well versed
with statistics could probably think of paired test that'd tell us at
this point, but that's not me without a few hours pouring over textbooks
and the internet. :) I'll switch 19x19 to threads=2 as you suggest.
It's also possible your original results are a statistical fluke, though
not terribly likely. :-) (I feel silly asking again - but are you sure
your binaries couldn't be mixed up with some that use caffe?)
If you have good ideas, good data and fast computers,
you can do almost anything. -- Geoffrey Hinton
More information about the Pachi