Hello, nice to see you interested, have a look at the scripts in /scripts/CNN they are modifications of /scripts/features, which are better documented. mainly you create file with all game file names than cat allgamenames.txt| ./CNN-data-collection.sh initial.gamma 13
allPositions.txt
they should already be randomized (the initial.gamma and the 13 are not really necessary for CNN, it is just because I tried to minimalize differences to the scripts in /scripts/features) next step to produce the leveldb database cat allPositions.txt | python ./generate_sample_data_leveldb.py produces the leveldb database I am not sure, if the produced database is consitant with the net code in the actual oakfoam version, it is very much a work in progress at the moment, and pushes to the repository are more or less "backups". pretrained nets http://physik.de/net.tgz http://physik.de/net2.tgz even here, I am not sure if it is read by the actual version of oakfoam, but should be simple to figure out Have fun, Detlef
allPositions.txt
2016년 4월 6일 수요일 오후 11시 29분 25초 UTC+9, Detlef Schmicker 님의 말:
--
You received this message because you are subscribed to the Google Groups "Oakfoam" group.
To unsubscribe from this group and stop receiving emails from it, send an email to oakfoam+u...@googlegroups.com.
To post to this group, send email to oak...@googlegroups.com.
Visit this group at https://groups.google.com/group/oakfoam.
For more options, visit https://groups.google.com/d/optout.
thank you, finally i make the leveldb file.i want to know there are few question.1. i make the allPosition.txt, but in generate_sample_data_leveldb.py's split location is difference. i don't know what made the file correctly.
2. in lenet_train_test.prototxt, i don't know why composed of two input (train set composed of leveldb, test set composed of hdf5 format)how the two may be constructed in the same format?
3. using my data(549 of sgf file) from caffe, result is iteration 5000 to 9%.(leveldb and hdf5 data is same file allPosition.txt).i don't know it is correctly result,
hi detlef
i'm sorry to late write readme file. but I'm not that good at english. so I don't know whether I wrote for the sentence. :)
https://drive.google.com/file/d/0B6wWJs0EGrqsN05xeGpodGxsVmc/view?usp=sharing
It encourages, you to modify. :)
and i have some question,
do you upload bot in kgs go server? what is bot's name?
your method's feature plain and facebook computer go feature plain are same?
thank you, i have question change paramerter.
param playouts_per_move 8000
param playouts_per_move_max 8000
param playouts_per_move_min 4000
above this parameter, MCTS search count? if i increase this parameter, win rate is increase?
and i don't know uct parameter...
gogui-adapter "$OAKFOAM"
My guesses: gogui is very old, or
OAKFOAM="$WD/../../oakfoam --nobook --log $TEMPOUTPUT"
../../oakfoam is not the executable and gogui is not producing an error message?!
so you habe to change this in CNN-data.sh.
if you really want to use all scripts it might be a good idea, to change to Linux! you will probably get even more problems, if you try to compile with cnn support under cygwin!
The standard compilation does not have cnn support (it is not needed for the script, so this is not the problem.) but if you try to run with a cnn oakfoam has to be configured --with-caffe= cafffe disteibution directory, and I really dont know what happens to caffe under cygwin!
OAKFOAM="$WD/../../oakfoam --nobook --log $
TEMPOUTPUT"
defines that ../../oakfoam is executed
might be
OAKFOAM="$WD/../../oakfoam.exe --nobook --log $TEMPOUTPUT"
in your case
than
gogui-adapter "$OAKFOAM"
uses oakfoam.exe
But really, change to Ubnuntu 14.04lts :)
2. gogui-adapter "$OAKFOAM"
uses oakfoam.exe
=> gogui-adapter "$OAKFOAM.exe" right?
P.S: sorry for my stupidity :(
I still don't understand1. OAKFOAM="$WD/../../oakfoam --nobook --log $TEMPOUTPUT" - What does this code mean?
WD="$(dirname "$0")"
patterns_circ_........)
this log file will contain info used for producing the database files !!
gogui-adapter "$OAKFOAM" is than translated to
gogui-adapter "../../oakfoam --nobook --log patterns_circ_........"
but it should in your case be translated to
gogui-adapter "../../oakfoam.exe --nobook --log patterns_circ_........"
therefore my suggestion: probably you have to change line 10 to
OAKFOAM="$WD/../../oakfoam.exe --nobook --log $TEMPOUTPUT"
use ubuntu 14.04 :)
there are classify.py samples, which use caffe module and the net definitions use the hdf5 files for training.
just do one of the samples, have a look at the prototxt files ...
the lenet_train_test.prototxt demonstrates to use both types in the beginning.
you will need a training and a test dataset.....
this is how it looks like if caffe really can open the database
I0731 08:27:59.678020 22207 net.cpp:399] mnist -> data_1
I0731 08:27:59.678027 22207 net.cpp:399] mnist -> label
I0731 08:28:00.103323 22214 db_leveldb.cpp:18] Opened leveldb test_4d_valueb/
I0731 08:28:00.164263 22207 data_layer.cpp:41] output data size: 64,23,19,19
I0731 08:28:00.168335 22207 net.cpp:141] Setting up mnist
I0731 08:28:00.168395 22207 net.cpp:148] Top shape: 64 23 19 19 (531392)
I0731 08:28:00.168413 22207 net.cpp:148] Top shape: 64 (64)
I0731 08:28:00.168422 22207 net.cpp:156] Memory required for data: 2125824
I0731 08:28:00.168433 22207 layer_factory.hpp:77] Creating layer slice
I0731 08:28:00.168457 22207 net.cpp:91] Creating Layer slice
I0731 08:28:00.168469 22207 net.cpp:425] slice <- data_1
I think it schauld output every 1000 something....
you might turn on some output in generate...
And I dont know, but can you thrust leveldb on cygwin, I read it is not officially supportes?
Hi Detlef,--I have a question. When I make position file, my computer crash, so it is incomplete. I have a collectione_circ tmp file and lots of patterns_circ tmp files, but allPositions.txt is empty. What can I do to sort and combine patterns to allPositions.txt?
You received this message because you are subscribed to the Google Groups "Oakfoam" group.
To unsubscribe from this group and stop receiving emails from it, send an email to oakfoam+u...@googlegroups.com.
To post to this group, send email to oak...@googlegroups.com.
Visit this group at https://groups.google.com/group/oakfoam.
For more options, visit https://groups.google.com/d/optout.
use line 33 of the cnn-data-colect script,cat colect_circ | sort -R > allPositions.txt(the script weites the number of lines into the first line, but I think this is not ncessary anymore)
sort -R can take quite long and is using a lot of temp space (in the /tmp directory). it randomizes all lines of collect_circ, in big databases it can take some days (200GB)if for some reason your /tmp directory is in ram (I dont know cygwin defaults and am to lazy too google them) you might have to choose another directory!export TMPDIR=/home/where_ever_you_have_lotsof_GBDetlef
Hi Detlef,I have a question. When I make position file, my computer crash, so it is incomplete. I have a collectione_circ tmp file and lots of patterns_circ tmp files, but allPositions.txt is empty. What can I do to sort and combine patterns to allPositions.txt?
--
You received this message because you are subscribed to the Google Groups "Oakfoam" group.
To unsubscribe from this group and stop receiving emails from it, send an email to oakfoam+unsubscribe@googlegroups.com.
To post to this group, send email to oak...@googlegroups.com.
Visit this group at https://groups.google.com/group/oakfoam.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "Oakfoam" group.
To unsubscribe from this group and stop receiving emails from it, send an email to oakfoam+unsubscribe@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to oakfoam+u...@googlegroups.com.