Time measurement in agile track

[Jendrik Seipp]

Hi everyone,

our Cedalion portfolio that we submitted to the agile track keeps running even after a solution is found, since we assumed the IPC scripts would take into account the time for finding the *first* solution and didn't want to bother to change Fast Downward's portfolio execution behaviour. A recent discussion made us wonder if that is really the case. Do you consider the time for the first solution or the total runtime?

Cheers,

Jendrik

[Mauro Vallati]

Hello Jendrik,

thank you for your question.
Actually, a number of planners found more than one solution.
Since Agile track aimed to evaluate planners w.r.t. their ability to quickly find a solution, in that track time is stopped when the planner finishes to write the solution file. In case more solution files are generated, first one is considered.

Mauro

[Isabel Cenamor]

Hello Jendrik, 

my portfolios (IBaCoP) in agile track keep running all the time too. And I checked the logs for my planner and effectively only take into account the first solution. 

Cheers

--
You received this message because you are subscribed to the Google Groups "IPC2014-deterministic" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ipc2014-determin...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Isabel Cenamor

Universidad Carlos III de Madrid

http://www.plg.inf.uc3m.es/~icenamor/