Phase 5 setup questions

7 views

Skip to first unread message

Damir Jajetić

unread,

Apr 26, 2016, 3:12:27 AM4/26/16

to AutoML

Dear organizers,

Will phase 5 data have both valid and test dataset, and same property files as other phases of competition?
I’m asking this because there is no Tweakathon phase for phase 5 and my current code expects both valid and test dataset and properties of their size in property file.

Does time budget includes scoring, and files handling or just time of run.py from start to finish?
I’m asking this because my last “results only” submission takes 140 seconds and since this is not negligible time I’m now not sure if should I left several minutes for prediction handling before and after “run.py”. I can affect and estimate but not measure time outside code running.