Time measurement in agile track

12 views
Skip to first unread message

Jendrik Seipp

unread,
Sep 25, 2014, 5:19:30 AM9/25/14
to ipc2014-de...@googlegroups.com
Hi everyone,

our Cedalion portfolio that we submitted to the agile track keeps running even after a solution is found, since we assumed the IPC scripts would take into account the time for finding the *first* solution and didn't want to bother to change Fast Downward's portfolio execution behaviour. A recent discussion made us wonder if that is really the case. Do you consider the time for the first solution or the total runtime?

Cheers,
Jendrik

Mauro Vallati

unread,
Sep 25, 2014, 5:25:48 AM9/25/14
to ipc2014-de...@googlegroups.com
Hello Jendrik,

thank you for your question.
Actually, a number of planners found more than one solution.
Since Agile track aimed to evaluate planners w.r.t. their ability to quickly find a solution, in that track time is stopped when the planner finishes to write the solution file. In case more solution files are generated, first one is considered.

Mauro

Isabel Cenamor

unread,
Sep 25, 2014, 5:49:01 AM9/25/14
to ipc2014-de...@googlegroups.com
Hello Jendrik, 

my portfolios (IBaCoP) in agile track keep running all the time too. And I checked the logs for my planner and effectively only take into account the first solution. 

Cheers

--
You received this message because you are subscribed to the Google Groups "IPC2014-deterministic" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ipc2014-determin...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Isabel Cenamor
Universidad Carlos III de Madrid
Reply all
Reply to author
Forward
0 new messages