leaderboard updated

1 view
Skip to first unread message

David Weiss

unread,
Nov 24, 2009, 12:21:36 AM11/24/09
to cis52...@googlegroups.com
note: remember that each group only gets one score, which is taken arbitrarily from any set of multiple submissions based on pennkey ID. 

also, if your status says "OVERTIME", that indicates that your code is taking too long -- not for prediction, but due to training at test time (which you are explicitly instructed not to do) or getting into some erroneous state whereby matlab is stalled. so there is *no explicit time limit* for evaluating predictions, but if you submit code that still needs to run training and I see the output is "cross validation loop", I will stop the analysis there.

best,
David

Mayank Bansal

unread,
Nov 24, 2009, 8:40:50 AM11/24/09
to cis52...@googlegroups.com
Hi David,

Is it possible for you to take the most recent submission from a group (like you were doing before) and not base in on the pennkey ID? In the current scheme, if the lowest pennkey ID person submitted once, the team has to submit every new submission through his/her login to overwrite that submission.

Thanks,
Mayank

David Weiss

unread,
Nov 24, 2009, 10:35:59 AM11/24/09
to cis52...@googlegroups.com
hi Mayank,

The simplest thing to do is simply to overwrite any submission you don't want scored with an empty file -- then it won't be counted as a submission. To do so, use the following commands on eniac:

touch empty
turnin -c cis520 -p leaderboard empty

(the "touch" command creates an empty file if it doesn't exist)

best,
David
Reply all
Reply to author
Forward
0 new messages