Speeding RAPM: Tatel et al 2022
145 views
Skip to first unread message
Gwern Branwen
Apr 11, 2022, 6:55:45 PM4/11/22
to N-back
https://www.gwern.net/docs/iq/2022-tatel.pdf "Process differences as a
function of test modifications: Construct validity of Raven's advanced
progressive matrices under standard, abbreviated and/or speeded
conditions—A meta-analysis", Tatel et al 2022:
> - Altering the speed of a test may alter the cognitive processes measured.
> - Speed/length of Raven's Progressive Matrices influence construct validity.
> - Estimated validity of an abbreviated ability tests requires addressing reliability
> - Researchers should consider speed and length when selecting or modifying a test.
>
> Historically, there has been substantial disagreement about the importance of speed vs. level in determining individual differences in intelligence---a disagreement that persists across various different modern assessment measures of intellectual abilities.
>
> The current investigation considers whether changes to the administration constraints (time limitations or speededness, and total test length) of the Raven's Advanced Progressive Matrices test---which has been identified as a measure highly saturated with general intelligence---results in differences to the underlying ability determinants of test performance.
>
> A review of empirical studies was conducted, where versions of Raven's Advanced Progressive Matrices Tests were administered under various time constraints and item lengths. Meta-analytic techniques were used to determine whether introducing speed constraints or shortening the length of the test changes the construct validity of the tests (as indicated by differences in convergent and discriminant correlations with other ability traits).
>
> The meta-analysis combined results from 142 studies composed of a total of 26,848 participants. Substantial differences were found for correlations of Raven's Advanced Progressive Matrices and Spatial Visualization (as large as _p̂_ = 0.26), Memory (as large as _p̂_ = 0.08), and Perceptual Speed (as large as _p̂_ = 0.34) abilities under speeded conditions and shorter test lengths.
>
> Examinees may draw on different strategies for test performance, that in turn, draw on different combinations of abilities, when the test is abbreviated or substantial time constraints are introduced. Implications for using this test under different conditions are discussed.
--
gwern
function of test modifications: Construct validity of Raven's advanced
progressive matrices under standard, abbreviated and/or speeded
conditions—A meta-analysis", Tatel et al 2022:
> - Altering the speed of a test may alter the cognitive processes measured.
> - Speed/length of Raven's Progressive Matrices influence construct validity.
> - Estimated validity of an abbreviated ability tests requires addressing reliability
> - Researchers should consider speed and length when selecting or modifying a test.
>
> Historically, there has been substantial disagreement about the importance of speed vs. level in determining individual differences in intelligence---a disagreement that persists across various different modern assessment measures of intellectual abilities.
>
> The current investigation considers whether changes to the administration constraints (time limitations or speededness, and total test length) of the Raven's Advanced Progressive Matrices test---which has been identified as a measure highly saturated with general intelligence---results in differences to the underlying ability determinants of test performance.
>
> A review of empirical studies was conducted, where versions of Raven's Advanced Progressive Matrices Tests were administered under various time constraints and item lengths. Meta-analytic techniques were used to determine whether introducing speed constraints or shortening the length of the test changes the construct validity of the tests (as indicated by differences in convergent and discriminant correlations with other ability traits).
>
> The meta-analysis combined results from 142 studies composed of a total of 26,848 participants. Substantial differences were found for correlations of Raven's Advanced Progressive Matrices and Spatial Visualization (as large as _p̂_ = 0.26), Memory (as large as _p̂_ = 0.08), and Perceptual Speed (as large as _p̂_ = 0.34) abilities under speeded conditions and shorter test lengths.
>
> Examinees may draw on different strategies for test performance, that in turn, draw on different combinations of abilities, when the test is abbreviated or substantial time constraints are introduced. Implications for using this test under different conditions are discussed.
--
gwern
Pontus Granström
Apr 12, 2022, 10:35:49 AM4/12/22
to Dual N-Back, Brain Training & Intelligence
Different "discussions" not much interesting here.
--
You received this message because you are subscribed to the Google Groups "Dual N-Back, Brain Training & Intelligence" group.
To unsubscribe from this group and stop receiving emails from it, send an email to brain-trainin...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/brain-training/CAMwO0gxsG%2BkLNopaBERc58uWAqTLbTDXg5H74H%2Bb2mocZPbV9g%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages