International DivisionH
unread,Aug 30, 2011, 1:05:23 AM8/30/11Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to AERA.DivisonH.International
Basically, I recall reading in my Thorndike textbook many decades ago
that reliability/standard error is less an issue when you are talking
about group data, than when you are talking about an individual score.
In the 2nd edition of Ed. Measurement, Stanley states: A low level of
reliability that would make scores, especially difference scores,
largely meaningless can be tolerated when one is interested in
comparing mean differences. Here, the emphasis should be on the
standard (or the variance) or error of measurement of the mean, not on
the reliability coefficient. The variance error of a mean due to
errors of measurement is 1/nth the variance error of measurement of
the single scores. ...where n is the number of examinees. P. 392
1. Has this changed? If so why?
2. If not, then wouldn't this mean that when looking at large groups
(i.e. several hundred respondents), one could have greater faith in a
smaller set of items? Wouldn't this logic explain why groups like
Harris or Gallup can make assertions based on responses to single
questions?
Thank you for any responses you can provide.