Benchmarking
Landis and Koch (1977) |
|
Altman, DG (1991) |
|
Textbook Fleiss et al (2003) |
|
0.81 – 1.00 |
Almost perfect |
0.81 – 1.00 |
Very good |
0.75 – 1.00 |
Very good |
0.61 – 0.80 |
Substantial |
0.61 – 0.80 |
Good |
0.41 – 0.75 |
Fair to good |
0.41 – 0.60 |
Moderate |
0.41 – 0.60 |
Moderate |
<0.40 |
Poor |
0.21 – 0.40 |
Fair |
0.21 – 0.40 |
Fair |
|
|
0.00 – 0.20 |
Slight |
< 0.20 |
Poor |
|
|
< 0.00 |
Poor |
|
|
|
|
Gwet’s Benchmarking System for the AC1
Benchmark Scale |
Description |
Gwet Scale for AC1 |
Landis and Koch |
Substantial |
Moderate |
Altman |
Good |
Moderate |
Fleiss |
Intermediate to Good |
Intermediate to Good |
Cohen’s Type Kappa
Benchmark Scale |
Description |
Gwet Scale for AC1 |
Landis and Koch |
Substantial |
Moderate |
Altman |
Good |
Moderate |
Fleiss |
Intermediate to Good |
Intermediate to Good |
Fleiss’ Type Kappa
Benchmark Scale |
Description |
Gwet Scale for AC1 |
Landis and Koch |
Almost Perfect |
Substantial |
Altman |
Very Good |
Good |
Fleiss |
Excellent |
Intermediate to Good |
Bennett’s Type S
Benchmark Scale |
Description |
Gwet Scale for AC1 |
Landis and Koch |
Almost Perfect |
Substantial |
Altman |
Very Good |
Good |
Fleiss |
Excellent |
Intermediate to Good |
Gwet’s AC1
References:
Altman, D. (1991). Practical statistics for medical research. Chapman and Hall.
Landis, J., & Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174.
Fleiss, J. L., Levin, B., & Park, M. C. (2003). Statistical methods for rates and proportions (3rd edition). John Wiley & Sons, Inc.
Gwet, K. (2014). Handbook of inter-rater reliability. Advanced Analytics Press. ISBN: 9 780970 806284.
--
--
To post a new thread to MedStats, send email to MedS...@googlegroups.com .
MedStats' home page is http://groups.google.com/group/MedStats .
Rules: http://groups.google.com/group/MedStats/web/medstats-rules
---
You received this message because you are subscribed to the Google Groups "MedStats" group.
To unsubscribe from this group and stop receiving emails from it, send an email to medstats+u...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/medstats/3a83daa6-054a-42a5-8ed2-cc8bc7ecf15en%40googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/medstats/2165772e-b6ab-4699-9a1d-51d5aae9944dn%40googlegroups.com.