Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Message from discussion Publication -> Gadermann, Guhn & Zumbo, Estimating Ordinal Reliability

Received: by 10.180.20.138 with SMTP id n10mr2496975wie.3.1326809400782;
        Tue, 17 Jan 2012 06:10:00 -0800 (PST)
X-BeenThere: pareonline-l@googlegroups.com
Received: by 10.216.150.147 with SMTP id z19ls3844624wej.0.gmail; Tue, 17 Jan
 2012 06:09:45 -0800 (PST)
Received: by 10.180.84.1 with SMTP id u1mr1853756wiy.2.1326809385635;
        Tue, 17 Jan 2012 06:09:45 -0800 (PST)
Received: by 10.180.84.1 with SMTP id u1mr1853753wiy.2.1326809385618;
        Tue, 17 Jan 2012 06:09:45 -0800 (PST)
Return-Path: <lmrud...@gmail.com>
Received: from mail-ww0-f47.google.com (mail-ww0-f47.google.com [74.125.82.47])
        by gmr-mx.google.com with ESMTPS id u6si8109511wiu.0.2012.01.17.06.09.45
        (version=TLSv1/SSLv3 cipher=OTHER);
        Tue, 17 Jan 2012 06:09:45 -0800 (PST)
Received-SPF: pass (google.com: domain of lmrud...@gmail.com designates 74.125.82.47 as permitted sender) client-ip=74.125.82.47;
Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of lmrud...@gmail.com designates 74.125.82.47 as permitted sender) smtp.mail=lmrud...@gmail.com; dkim=pass header...@gmail.com
Received: by mail-ww0-f47.google.com with SMTP id dt10so2512121wgb.28
        for <PAREOnline-L@googlegroups.com>; Tue, 17 Jan 2012 06:09:45 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=fQf+1/QrDncV3RADy8jMXuF/GmKLeNxf04z9PzGrzKg=;
        b=pCgpv+ANFus7Zrl8x8BmvB5FtcvhnZW84+ghC/bT/1lP9mJkrf4RjVO0IcVw6xgG/x
         xV0H2w84jprasvqtXPvU1h0YilfntCzRhmypGY37SFBePoNtMQQSaJtsf3asFHDyIkp1
         Q0q4BXIJYnist2PTRhouoiaXYZaTAPKQj4Sn8=
MIME-Version: 1.0
Received: by 10.180.19.138 with SMTP id f10mr35268676wie.3.1326809385541; Tue,
 17 Jan 2012 06:09:45 -0800 (PST)
Received: by 10.216.49.200 with HTTP; Tue, 17 Jan 2012 06:09:45 -0800 (PST)
Date: Tue, 17 Jan 2012 09:09:45 -0500
Message-ID: <CAJjc7A04fQX1N=mNWx=zW2O1fVHT+GQttqTFZQVBUOnLaA+B6Q@mail.gmail.com>
Subject: Publication -> Gadermann, Guhn & Zumbo, Estimating Ordinal Reliability
From: Lawrence Rudner <lmrud...@gmail.com>
To: PAREOnline-L@googlegroups.com
Content-Type: multipart/alternative; boundary=bcaec53d550d1c21d804b6b9e2fb

--bcaec53d550d1c21d804b6b9e2fb
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

*Practical Assessment, Research & Evaluation* is a peer-reviewed scholarly
journal freely accessible on the Internet at
http://PareOnline.net<http://pareonline.net/>.
PARE has just published:



*Estimating ordinal reliability for Likert-type and ordinal item response
data: A conceptual, empirical, and practical guide*

Anne M. Gadermann, *Harvard Medical School*

Martin Guhn & Bruno D. Zumbo, *University of British Columbia*



This paper provides a conceptual, empirical, and practical guide for
estimating ordinal reliability coefficients for ordinal item response data
(also referred to as Likert, Likert-type, ordered categorical, or rating
scale item responses). Conventionally, reliability coefficients, such as
Cronbach=92s alpha, are calculated using a Pearson correlation matrix.
Ordinal reliability coefficients, such as ordinal alpha, use the polychoric
correlation matrix (Zumbo, Gadermann, & Zeisser, 2007). This paper presents
(i) the theoretical-psychometric rationale for using an ordinal version of
coefficient alpha for ordinal data; (ii) a summary of findings from a
simulation study indicating that ordinal alpha more accurately estimates
reliability than Cronbach=92s alpha when data come from items with few
response options and/or show skewness; (iii) an empirical example from real
data; and (iv) the procedure for calculating polychoric correlation
matrices and ordinal alpha in the freely available software program R. We
use ordinal alpha as a case study, but also provide the syntax for
alternative reliability coefficients (such as beta or omega).



-----------------------------------------------------------------------

Lawrence M. Rudner,
coedit...@pareonline.net<https://rac.gmac.com/owa/,DanaInfo=3Dexc00.main.gm=
ac.com,SSL+redir.aspx?C=3D573729ba409a46bbb153d66bbf65839c&URL=3Dhttps%3a%2=
f%2fmail.gmac.com%2fOWA%2fredir.aspx%3fC%3dc72e59eb78d440e9afe38ecb73b6c440=
%26URL%3dmailto%253acoeditor1%2540pareonline.net>

William D. Schafer

Co-editors
*Practical Assessment Research and Evaluation*
**
**

--bcaec53d550d1c21d804b6b9e2fb
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font size=3D"3"><font =
face=3D"Times New Roman"><em>Practical Assessment, Research &amp; Evaluatio=
n</em> is a peer-reviewed scholarly journal freely accessible on the Intern=
et at </font></font><font color=3D"#800080" size=3D"3" face=3D"Times New Ro=
man"><a href=3D"http://pareonline.net/">http://PareOnline.net</a></font><fo=
nt size=3D"3"><font face=3D"Times New Roman"><span style=3D"COLOR:purple">.=
 </span>PARE has just published:</font></font></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font size=3D"3"><font =
face=3D"Times New Roman">=A0</font></font></p>
<p style=3D"TEXT-ALIGN:center;MARGIN:0in 0in 12pt" class=3D"MsoNormal" alig=
n=3D"center"><b><span style=3D"FONT-FAMILY:&#39;Garamond&#39;,&#39;serif&#3=
9;;COLOR:blue;FONT-SIZE:18pt">Estimating ordinal reliability for Likert-typ=
e and ordinal item response data: A conceptual, empirical, and practical gu=
ide</span></b><span style=3D"FONT-FAMILY:&#39;Garamond&#39;,&#39;serif&#39;=
;FONT-SIZE:11pt"></span></p>

<p style=3D"TEXT-ALIGN:center;MARGIN:0in 0in 0pt" class=3D"MsoNormal" align=
=3D"center"><span style=3D"FONT-FAMILY:&#39;Garamond&#39;,&#39;serif&#39;">=
Anne M. Gadermann, <i style>Harvard Medical School</i></span></p>
<p style=3D"TEXT-ALIGN:center;MARGIN:0in 0in 6pt" class=3D"MsoNormal" align=
=3D"center"><span style=3D"FONT-FAMILY:&#39;Garamond&#39;,&#39;serif&#39;">=
Martin Guhn &amp; Bruno D. Zumbo, <i style>University of British Columbia</=
i></span></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font size=3D"3"><font =
face=3D"Times New Roman">=A0</font></font></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"FONT-FAM=
ILY:&#39;Garamond&#39;,&#39;serif&#39;;FONT-SIZE:11pt"><span style=3D"FONT-=
FAMILY:&#39;Garamond&#39;,&#39;serif&#39;;FONT-SIZE:11pt">This paper provid=
es a conceptual, empirical, and practical guide for estimating ordinal reli=
ability coefficients for ordinal item response data (also referred to as Li=
kert, Likert-type, ordered categorical, or rating scale item responses). Co=
nventionally, reliability coefficients, such as Cronbach=92s alpha, are cal=
culated using a Pearson correlation matrix. Ordinal reliability coefficient=
s, such as ordinal alpha, use the polychoric correlation matrix (Zumbo, Gad=
ermann, &amp; Zeisser, 2007). This paper presents (i) the theoretical-psych=
ometric rationale for using an ordinal version of coefficient alpha for ord=
inal data; (ii) a summary of findings from a simulation study indicating th=
at ordinal alpha more accurately estimates reliability than Cronbach=92s al=
pha when data come from items with few response options and/or show skewnes=
s; (iii) an empirical example from real data; and (iv) the procedure for ca=
lculating polychoric correlation matrices and ordinal alpha in the freely a=
vailable software program R. We use ordinal alpha as a case study, but also=
 provide the syntax for alternative reliability coefficients (such as beta =
or omega).</span></span><font size=3D"3"><font face=3D"Times New Roman">=A0=
</font></font></p>

<p style=3D"TEXT-ALIGN:center;MARGIN:0in 0in 0pt" class=3D"MsoNormal" align=
=3D"center"><font size=3D"3"><font face=3D"Times New Roman">=A0</font></fon=
t></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font size=3D"3"><font =
face=3D"Times New Roman">--------------------------------------------------=
---------------------</font></font></p>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><span style=3D"FONT-SIZ=
E:7.5pt"><font face=3D"Times New Roman">Lawrence M. Rudner, </font></span><=
a href=3D"https://rac.gmac.com/owa/,DanaInfo=3Dexc00.main.gmac.com,SSL+redi=
r.aspx?C=3D573729ba409a46bbb153d66bbf65839c&amp;URL=3Dhttps%3a%2f%2fmail.gm=
ac.com%2fOWA%2fredir.aspx%3fC%3dc72e59eb78d440e9afe38ecb73b6c440%26URL%3dma=
ilto%253acoeditor1%2540pareonline.net" target=3D"_blank"><span style=3D"FON=
T-SIZE:7.5pt"><font face=3D"Times New Roman">coedit...@pareonline.net</font=
></span></a></p>

<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font face=3D"Times New=
 Roman"><span style=3D"FONT-SIZE:7.5pt">William D. Schafer</span></font></p=
>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font face=3D"Times New=
 Roman"><span style=3D"FONT-SIZE:7.5pt">Co-editors</span></font></p>
<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font face=3D"Times N=
ew Roman"><em><span style=3D"FONT-SIZE:7.5pt">Practical Assessment Research=
 and Evaluation</span></em></font></div>
<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font face=3D"Times N=
ew Roman"><em><span style=3D"FONT-SIZE:7.5pt"></span></em></font>=A0</div>
<div style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font face=3D"Times N=
ew Roman"><em><span style=3D"FONT-SIZE:7.5pt"></span></em></font>=A0</div>
<p style=3D"MARGIN:0in 0in 0pt" class=3D"MsoNormal"><font size=3D"3"><font =
face=3D"Times New Roman">=A0</font></font></p>

--bcaec53d550d1c21d804b6b9e2fb--