Doubts about timing

[nico.rod...@gmail.com]

Hi Manuel,

I am Nicolás Rodriguez, from Universidad Rey Juan Carlos, member of GRAFO.

I have been conducting experiments with the new version of irace.

Essentially, I am repeating an experiment conducted with version 3.5 of irace, but now with version 4.2. There are some minor differences, such as an additional operator, or some changes if an external file (jMetal) is used.

The times between the experiment in one version and another are really different. Is there anything that needs to be changed in the scenario or similar? I have attached tables.

# Version: 3.5.6863679

+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+
| | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar|
+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+
|x| 1| 400| 158| -1.000000000| 400|00:09:45| NA| NA| NA|
|x| 2| 400| 170| -0.8946369763| 800|00:10:29|+0.01|0.50|0.9790|
|x| 3| 400| 170| -0.7916753146| 1200|00:08:34|+0.07|0.38|0.9114|
|x| 4| 400| 170| -0.7132601982| 1600|00:08:42|+0.10|0.33|0.8876|
|x| 5| 400| 170| -0.6624542789| 2000|00:08:28|+0.10|0.28|0.9089|
|x| 6| 400| 170| -0.5520452324| 2400|00:08:03|+0.08|0.23|0.9259|
|x| 7| 400| 68| -0.3903492907| 2800|00:07:50|+0.08|0.21|0.9325|
|x| 8| 400| 4| -0.4061584600| 3200|00:07:43|+0.08|0.19|0.9326|
|-| 9| 165| 4| -0.3610297422| 3600|00:08:28|-0.07|0.05|1.0344|
|=| 10| 165| 4| -0.3874214823| 3765|00:04:43|-0.05|0.05|1.0284|
|=| 11| 165| 4| -0.3522013475| 3930|00:04:17|-0.05|0.05|1.0254|
+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+

# Version: 4.2.0.9000.33c09692662b45042c479f53a182ebcc1c6643d1

+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+
| | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar|
+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+
|x| 1| 400| 1| 0.000000000| 400|04:21:59| NA| NA| NA|
|x| 2| 400| 254| -0.07346980462| 800|02:22:48|+0.00|0.50|0.4988|
|x| 3| 400| 86| -0.2291593171| 1200|00:51:01|+0.28|0.52|0.4582|
|x| 4| 400| 158| -0.2378631627| 1600|01:34:22|+0.37|0.53|0.4206|
|x| 5| 400| 158| -0.1902905301| 2000|04:22:05|+0.28|0.42|0.4020|
|x| 6| 400| 158| -0.2085416807| 2400|00:50:03|+0.35|0.46|0.3994|
|x| 7| 400| 158| -0.1951063032| 2800|02:21:05|+0.37|0.46|0.4019|
|x| 8| 400| 158| -0.2407116044| 3200|00:52:03|+0.41|0.48|0.3981|
|-| 9| 78| 158| -0.2139658706| 3600|04:22:35|+0.02|0.13|0.6459|
|=| 10| 78| 158| -0.2026156225| 3678|00:46:41|+0.02|0.12|0.6778|
|-| 11| 23| 158| -0.1941477924| 3756|00:45:22|-0.04|0.05|0.7259|
|=| 12| 23| 158| -0.1953140999| 3779|00:08:07|-0.03|0.05|0.7491|
|=| 13| 23| 158| -0.1802899384| 3802|00:41:33|-0.03|0.05|0.6891|
+-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+

As always, thanks in advance.

Best regards,

Nico

[Manuel Lopez-Ibanez]

Hi,

Could you open an issue in https://github.com/MLopez-Ibanez/irace/issues ?

Please attach the full logs of both runs to the issue.

Best wishes,

Manuel.

---

From: irace-...@googlegroups.com <irace-...@googlegroups.com> on behalf of nico.rod...@gmail.com <nico.rod...@gmail.com>
Sent: Tuesday, September 23, 2025 11:11:15 AM
To: The irace package: Iterated Racing for Automatic Configuration <irace-...@googlegroups.com>
Subject: [irace-package] Doubts about timing

 

Hi Manuel, I am Nicolás Rodriguez, from Universidad Rey Juan Carlos, member of GRAFO. I have been conducting experiments with the new version of irace. Essentially, I am repeating an experiment conducted with version 3. 5 of irace, but now with

--
You received this message because you are subscribed to the Google Groups "The irace package: Iterated Racing for Automatic Configuration" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irace-packag...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/irace-package/e9fbec83-f67a-49cc-8fb7-433f2d1191d8n%40googlegroups.com [groups.google.com].