The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 |
From: David Warde-Farley <d.warde.far...@gmail.com>
Date: Sat, 20 Oct 2012 23:49:02 -0400
Local: Sat, Oct 20 2012 11:49 pm
Subject: Re: [pylearn-dev] Printed output on clusters
On Sat, Oct 20, 2012 at 6:00 PM, Ian Goodfellow
<goodfellow....@gmail.com> wrote:
http://docs.python.org/library/logging.html
> Does anyone have a good solution to the problem of logs on the cluster not > appearing / not being in sync, etc? > It seems like most of the time I have a problem on the cluster, it is hard > to debug, because a good portion of > the output from the program doesn't get copied into the log file, or the log > file just never appears. > Usually this seems to be the fault of the job management software, since > usually the filesystem is working just > fine, and if I change my code to write out files at a pre-specified > location, the writes show up. > I'm thinking maybe we should make a logging module for pylearn2, so that the > stuff pylearn2 currently prints to > stdout could be easily redirected to a file when running on the cluster. > Before I do that, I thought I should check if there is any existing logging > system we should aim to be compatible with, > or just use. For example, is this something that jobman solves? I've been meaning to move all print statements over to appropriate log
IIRC there are other more specialized modules that implement this API
David
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
| |||||||||||||