Where to find log files?

[James Guo]

Hello guys,

I'm currently using Caffe to train CNN, after training I want to check training and validation loss, which were written into LOG(INFO). I've noticed that Caffe use Google glog library to log information but I couldn't find these files. Anyone can tell me where to find these logging files or how to turn on logging? Thank you very much!

Best,

James

[Manuel Lopez Antequera]

Unless otherwise specified, glog writes to the filename "/tmp/<program name>.<hostname>.<user name>.log.<severity level>.<date>.<time>.<pid>" (e.g., "/tmp/hello_world.example.com.hamaji.log.INFO.20080709-222411.10474"). By default, glog copies the log messages of severity level ERROR or FATAL to standard error (stderr) in addition to log files.

source: https://google-glog.googlecode.com/svn/trunk/doc/glog.html

[James Guo]

Thanks Manuel, but still, I didn't see any tmp folder after I finish training with Caffe. So maybe Caffe has its own folder to store log file or has some specific flag to use?

[Manuel Lopez Antequera]

You could call the caffe executable with the --log_dir=yourdesiredpath as well.

[James Guo]

Problem solved by add "2>&1 | tee your_name.log" at the end of command, i.e. "
./build/tools/caffe train --solver=/path/to/my_solver.prototxt 2>&1 | tee your_name.log"

[James Guo]

Problem solved, thanks a lot!!

[Comma]

Very Helpful. thank you very much!

在 2014年12月16日星期二 UTC-5上午11:07:13，James Guo写道：

[Zhao.Kai]

Hi:

But how to specify the log file DIR in python interface ?
thanks in advance !

[James Guo]

You can call python subprocess module, something like this

subprocess.call(".build/tools/caffe train You/solver/path 2>&1 | tee You/log/path", shell=True)

[Marianne]

When resuming training the log file is overwritten and information about the former training progress is lost.
You may want to use

... | tee -a your_name.log

instead.