Yes it is cool. I think my decisions up to now were quite lucky. Caffe seems to work fine, the caffe community is not responsive, so no help from there, but I figured out most problems myself...
I am running the the big Clark and Storkey at the moment without features (only two input layers with stone positions) and it seems to be trained reasonable on a 60000 kgs games selection.
I follow their arguments and avoid using the last moves features. I also avoid liberties at the moment, as I want to start using the CNN additionally to our actual features, something like oldgamma*(CNN*a+b)
I will try to include this into oakfoam today (I have holidays till tomorrow, and in opposite to you the holidays are the time I can work on such bigger projects:) Then I will see, if linking against caffe is as easy as it should be, again with little help from caffe community:)
The iPad has impressive GPU power, but it still does not support openCL :( But it also has accelerated framework with e. g. convolution functions, which is run on a neon vector processor. As it will take some time: neon will be an option, maybe the summer iOS release will support openCL, and if I am really bored I can use openGL shaders to do it on the GPU :) this is ugly, but I played around with this for an airflow app (but did not use it, as the calculations were to complex, and there was not a lot speedup that time (3years ago, the iPad gpu should be faster now by a factor of >50)
By the way, most work was, that I had to change my linux distribution after 15 years! I was so Debian, now I have to use Ubuntu, as it is one of the Nvidia supported OSs....