Hi Manuel,
I applied the irace package successfully, thanks for your help. I was planning to use it to configure cplex options in my matheuristic algorithm yet instead, I did use it to configure its other parameters.
I am not sure if it is an important feedback but I would like to share my struggle to follow the tutorial as a windows user. The tutorial I read is linux-orieented. I tried to execute corresponding steps in windows yet I couldn't succeed somehow. Therefore, I had to resort to linux and run the irace in a linux environment.
My another observation is regarding the configurations generated/tried. I have given quite wide ranges for numerical parameters yet the configurations suggested by irace at the end are very similar. Of course, it is expected to observe similarities in best configurations but the point I am surprised is as to irace generating so many similar configurations in the first place. For my algorithm, small changes in parameters do not have substantial impacts therefore, configurations with slight differences are expected to yield very similar results. To this end, I would prefer an irace option to determine how distinct configurations should be (I am sorry if there is already such an option and I miss it). "Forbidden values" can be used for this aim yet a simpler option for configuration distinctness would may be more preferrable.
I just wanted to share my experience if it is of any help.
Thanks very much again.
Cheers,
Istenc