Minimum number of instances

32 views
Skip to first unread message

fobe...@gmail.com

unread,
Oct 14, 2022, 2:31:46 PM10/14/22
to The irace package: Iterated Racing for Automatic Configuration
Hi,

What is the minimum number of training instances that I must consider in order to have an accurate run in IRACE.

Manuel López-Ibáñez

unread,
Oct 14, 2022, 3:04:33 PM10/14/22
to The irace package: Iterated Racing for Automatic Configuration
That is the same as asking: how much data do I need to train my ML model to have enough prediction accuracy? It is an impossible question to answer. Nevertheless, irace enforces a minimum number of experiments using a formula that you can find in the original paper. But the minimum is just a rule-of-thumb, it does not give any guarantees.

Best,

Manuel.
Reply all
Reply to author
Forward
0 new messages