nightly checkpoint up

[David Weiss]

hey all,

nightly checkpoint results are up:

http://alliance.seas.upenn.edu/~cis520/fall09/checkpoints/nightly_checkpoint_html/

one point of note: due to (1) me realizing that the multiple-submissions checking code isn't working exactly right just yet, and (2) repeated requests, I've decided to allow one submission PER PERSON for groups for debugging purposes only, so that way each person can debug their contribution to the project. note that for all graded checkpoints, you still only get ONE submission per GROUP, so you have to make it your "best shot."

*********************************************

**THE FOLLOWING IS IMPORTANT***

if you see "name.txt not found" by your submission, that means that you did not submit name.txt properly to identify your group, and to be graded properly you MUST do so before the checkpoint. in order to check for multiple submissions we need to know which group each submission belongs to; this is not possible without name.txt, and so we will simply disqualify any submissions that still do not have a name.txt by the checkpoint time.

to submit name.txt, use the command:

turnin -c cis520 -p proj_groups name.txt

where name.txt is a plain text file that just contains a single line containing your group name. 

**********************************************

finally, I'm going to run another checkpoint at ~6pm tomorrow , maybe early if requests come in, so you have one last chance to debug. note: these will not remove any existing submissions, it simply gives you the opportunity to update your submission before then to see how it performs.

best,

David

[David Weiss]

hey everyone,

people rightly pointed out that my previous email was confusing -- by "tomorrow", as it was past midnight, I meant tomorrow, Wednesday, Nov 18, so that the official checkpoint schedule is as following:

11:59pm, Tuesday, Nov 17 - nightly_checkpoint (one per person)

6:00pm    Wednesday, Nov 18 - nightly_checkpoint (one per person)

11:59pm  Wednesday, Nov 18 *** project_checkpoint1 (one per GROUP, GRADED CHECKPOINT)

also: I don't mind running the nightly checkpoint more often, depending on my schedule. In fact, I enjoy seeing how the groups are doing. I reserve the right to run the nightly_checkpoint whenever I have a few spare minutes and I notice that a few submissions have been updated. if I do so, I will send an email to the group, so that people can check the new scores if they wish. if your submission crashed and you've since fixed the cause and resubmitted, feel free to email me and let me know. 

for example: before sending this email, I ran the checkpoint again, so you can see your score if you submitted again last night after 12:10 or so.

Best,

David

[David Weiss]

see at: http://alliance.seas.upenn.edu/~cis520/fall09/checkpoints/nightly_checkpoint_html/

[Fan Deng]

David Weiss wrote:
> see at:
> http://alliance.seas.upenn.edu/~cis520/fall09/checkpoints/nightly_checkpoint_html/
> <http://alliance.seas.upenn.edu/%7Ecis520/fall09/checkpoints/nightly_checkpoint_html/>

HI:
If I beat 2 baselines out of 4, should I turnin the /code to
project_checkpoint1 directly then I can test new
feature generation and algorithms through nightly_checkpoint?
Best
Fan



__________ Information from ESET NOD32 Antivirus, version of virus signature database 4623 (20091119) __________

The message was checked by ESET NOD32 Antivirus.

http://www.eset.com

[David Weiss]

hi all,

I ran the nightly checkpoint again and you can check out the results.

best,

David

[David Weiss]

[David Weiss]

good job everyone! a lot of groups are beating all 4 baselines now.

[Aline Normoyle]

What is the maximum time that our classifier can run? Is this combined
for all our classifiers?

Aline

[David Weiss]

which group are you? there's an error in the roederer submission that causes it to enter a strange state where matlab is still running but the analysis has failed. I'm not actually enforcing a time limit, just that I noticed that that particular submission keeps running forever. If yours takes more than 30 minutes to run you should let me know beforehand, but really it shouldn't be a problem provided that it *does* finish eventually.

best,

David

[Aline Normoyle]

Ok, we are considering submitting something that might take a few
minutes to run and wanted to make sure there wasn't an explicit time limit,

thanks,
Aline