Gini´s coefficient

22 views
Skip to first unread message

angel b.

unread,
Apr 16, 2021, 6:10:40 AM4/16/21
to HeuristicLab
Hello
I am new to HL.
I am trying to use the Gini coefficient in Genetic Programming - Symbolic Regression. 
I have three doubts: 
  • Each solution has a Gini coefficient (G0). When I try to simplify that solution, the coefficient changes (even when the solution has not been modified, since the simplification has been canceled. Simply by double clicking on a terminal, the coefficient changes, generally decreases). 
  • After having simplified a solution and having obtained its Gini coefficient (G1 <> G0), I export the data to excel. In excel I calculate AUC and from this measure I deduce the Gini coefficient. Again the value obtained G2 is different from G1 and G0. 
  • On the other hand, within the excel file, another measure of the Gini coefficient appears - average (estimated values) - that does not coincide with the previous ones.
Could you help me with the calculation method in each case? 
Thanks in advance

Gabriel Kronberger

unread,
Apr 16, 2021, 6:52:39 AM4/16/21
to noreply-spamdigest via HeuristicLab
Hello Angel,
thanks for bringing this to our attention. Probably there are differences in the way the value is calculated.
If you could send me an .hl file that showcases the problem and the value that you would expect then I can have a closer look at it.
Best, Gabriel
--
You received this message because you are subscribed to the Google Groups "HeuristicLab" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heuristiclab...@googlegroups.com.

angel b.

unread,
Apr 19, 2021, 5:09:28 AM4/19/21
to HeuristicLab
Hello Gabriel
I cannot post the reply message with the file. Can I send it to you in some other way?
Best Angel

Gabriel Kronberger

unread,
Apr 19, 2021, 5:15:03 AM4/19/21
to noreply-spamdigest via HeuristicLab
Hello Angel,
please send direct questions to sup...@heuristiclab.com
Best, Gabriel

Gabriel Kronberger

unread,
Apr 23, 2021, 12:07:34 PM4/23/21
to noreply-spamdigest via HeuristicLab
Hello Angel,
thanks for providing a file to test the behaviour. We have fixed the bug in the daily build version of HL (see https://dev.heuristiclab.com/trac.fcgi/ticket/3120)
The build with the fixed functionality should be available tomorrow.

Background: we have two different ways of calculating the Gini coefficient. One way is to use the class values produced by a classifier and the other way uses the outputs of the underlying discriminant function.

In your case the values were the result when using the class values. However, when manipulating the model in the simplified these values were overwritten with the result when using the discriminant function values.

We now report both results. With the updated HL version you should be able to open your file and when you view the results for the solution you will find the two different Gini coefficients.

Have a nice weekend,
Gabriel

angel beade torreiro

unread,
May 10, 2021, 10:19:02 AM5/10/21
to heuris...@googlegroups.com

Hello Gabriel,

When calculating the Gini coefficient using the results of the underlying discriminant function.

Are the above results based on the bounded values or the unbounded values?

 

Will it be possible to visualise the value of the Gini coefficient using the results of the underlying discriminant function when conducting an experiment and analysing the runs in a table?

 

Best, Angel

 

Enviado desde Correo para Windows 10

 

De: Gabriel Kronberger
Enviado: viernes, 23 de abril de 2021 18:07
Para: noreply-spamdigest via HeuristicLab
Asunto: Re: Gini´s coefficient

 

Hello Angel,

thanks for providing a file to test the behaviour. We have fixed the bug in the daily build version of HL (see https://dev.heuristiclab.com/trac.fcgi/ticket/3120)

The build with the fixed functionality should be available tomorrow.

 

Background: we have two different ways of calculating the Gini coefficient. One way is to use the class values produced by a classifier and the other way uses the outputs of the underlying discriminant function

 

In your case the values were the result when using the class values. However, when manipulating the model in the simplified these values were overwritten with the result when using the discriminant function values.

angel beade torreiro

unread,
May 10, 2021, 10:43:20 AM5/10/21
to heuris...@googlegroups.com

Hello Gabriel,

Sorry for the inconvenience

Which numerical integration rule is used in the calculation of the gini coefficient using the results of the underlying discriminant function?

Thanks

 

Angel

 

Enviado desde Correo para Windows 10

 

Gabriel Kronberger

unread,
May 12, 2021, 10:51:18 AM5/12/21
to noreply-spamdigest via HeuristicLab
Hello Angel,

the code is exactly the same for calculating the Gini index for the class values and the Gini index for the outputs of the discriminant function. 

The Gini coefficient is calculated for the bounded values for classification solutions produced via genetic programming (called symbolic classification in HL).

Yes, in fact both Gini values are included in the Run collection views (e.g. in the Table including all parameters and results for all runs).

Best, Gabriel
Reply all
Reply to author
Forward
0 new messages