On Sat, Jun 30, 2012 at 12:34 AM, XFMQ902SF <
kei...@aol.com> wrote:
> I believe Jausovec 2012 had an active control group with plenty of
> transfer later on.
With a weird testing procedure, and it's one of the few to show much.
But more importantly, are there any Chinese readers here? All the
numbers seem to be provided, I just need to know what is what...
Working with a Chinese-reading acquaintance on IRC, this is what I have learned:
< MrEmile> lucidian: considerign the (relative) success of things like
siri and Google Translate, I expect that there has been a good deal of
progress these last few years
<gwern> MrEmile: the pg24 4.5.4 table could be IQ before/after
scores... but I have no idea. I think pg25 & 26 probably isn't right
because the numbers are too high
<gwern> pg30 is another possibility
<gwern> MrEmile: as is pg31, now that I check
< MrEmile> gwern: are the page numbers you refer to those on the
paper, or those of the web reader?
<gwern> MrEmile: the web reader itself
< lucidian> MrEmile: I'm just having trouble understanding what it
would mean for a problem to be solved. It seems like accuracy could
always get better, unless we manage to make a tool that gets 100%
accuracy on everything, which is never going to happen.
<gwern> MrEmile: I can't read the page numbers in the paper itself :)
< lucidian> MrEmile: I mean, there does seem to be a point beyond
which further effort is a waste of time, but still.
<gwern> lucidian: since humans don't understand perfectly either,
there's an upper bound!
< MrEmile> gwern: the columns are before (M), before (SD) (I assume
mean and standard deviation), after (M), after (SD)
<gwern> MrEmile: yeah, I guessed as much, but I don't know what the
rows indicate
<gwern> MrEmile: the 5/10/etc probably indicate # of training
days/experimental group
<gwern> MrEmile: but why are there 3 rows for each group? I have no idea
<gwern> 3 or more
< MrEmile> gwern: (on page 24 btw) the lines are (5 days): visual
single task, simultaneous double task, double-sense (I assume sight
and sound) attention task, and control task
< MrEmile> (and the same for 10, 15 and 20 days)
<gwern> MrEmile: hm. that's not what I was expecting. I can guess that
visual single task = single n-back, and double-sense = dual n-back,
but control task seems to imply they did something and I don't know
what simultaneous double task or attention task would be
< MrEmile> gwern: better names would be "single task of visual working
memory", "working memory dual n-back", and "dual-channel attention
task"
< MrEmile> (those are the terms used in the abstract, and the Chinese
abstract uses the terms in the table at the same place)
<gwern> MrEmile: after checking the abstract, looks like the
dual-channel thing is some new task I haven't heard of. I guess it's
not important
< MrEmile> Anything else you need?
<gwern> MrEmile: so that just leaves the next two tables with the 90s
- what are those? - and how many participants they have in each group
<gwern> MrEmile: I've been scanning the text hoping for some
convenient n=x, but no dice so far
< MrEmile> table 5 (with the 90s) looks like success rates on an
english test, before and after the training
<gwern> MrEmile: ah, that must be the reading comprehension test
<gwern> but in a foreign language - english - scores? well, I guess
that makes sense in china
<gwern> (numbers make sese. 90/100 etc, no SDs putting anyone over 100)
< MrEmile> nope
< MrEmile> got it werong
< MrEmile> What they did is have students go through the major exam
before and after training
< MrEmile> table 5 is language (not english), table 6 is maths
<gwern> 'major exam'?
< MrEmile> it's like the exam to get into university
< MrEmile> I dunno the english equivalent
<gwern> ah, so the big end of highschool thing
< MrEmile> I assume it was a simulation of the exam, though they don't say
< MrEmile> yeah
<gwern> I was assuming these were like elementary school kids
< MrEmile> They don't specifiy the year, actually it's the exam you
always get at the end of a year to go to the next one
< MrEmile> they don't specify the age either
< MrEmile> (well, they probably do, somewhere else :P)
<gwern> so are pg23/24 basically the same data, reporting IQ scores
before/after, just with different subjects? I'm otherwise confused why
the two tables look so identical
<gwern> I almost hope they aren't because that makes finding the
subject number even more difficult - 4 groups including control, in 2
experiments, is 8 separate groups, and then I'd need to pool their
means and standad deviations
< MrEmile> table 3 is remembering words, table 4 is remembering
numbers apparently
<gwern> ;_; so where are the damn IQ scores
< MrEmile> Dunno. There doesn't seem to be any in any table
<gwern> table 3 is verbal WM, table 4 is digit span, table 5 is
language scores, table 6 is math scores; so that leaves table 2 on
pg22 and table 7 & 8 on pg30
< MrEmile> actually table 2 is fluid intelligence
<gwern> 8's numbers look way too small
<gwern> MrEmile: oh, great.
<gwern> you already translated the 4 groups, so I guess the last
remaining detail is how many kids were in each of the 4 - the single &
dual n-back groups, the dual-task attention group, and the control
group
< MrEmile> 7 is fluid intelligence too, 8 is probably reading (or word
memorisation)
<gwern> wait, 7 is gf too?
< MrEmile> yup
<gwern> MrEmile: what are the 4 groups on table 7? x, control, y, and control?
< MrEmile> dual n back
< MrEmile> (first column is num. days)
<gwern> x and y are both dual n-back, but then why are the first
characters different? in the second column
< MrEmile> they aren't, the top of the first char of x is just badly printed
<gwern> oh
< MrEmile> I don't know about the N though
< MrEmile> I couldn't find a section called "experimental setup"
< MrEmile> and gotta get away from the computer for a bit now
<gwern> ok, thanks
< MrEmile> ah wait
< MrEmile> section 5.2 mentions 74 kids in fifth grade, 39 boys, 35 girls
<gwern> 5.2, so I guess that would apply only to the second table
< MrEmile> section 4.2 says fifth grade too, 283: 146 boys, 137 girls
<gwern> wow. good sample sizes
<gwern> not what one expects from a master's thesis in the states, anyway
< MrEmile> The Chinese have more raw material to work with. They do
have a bit of a reputation for academic fraud too though.
<gwern> MrEmile: yeah. I'm actually in the middle of trying to get the
raw data for Qiu et al 2009 and all the authors are ignoring me. I
can't tell whether it's their email addresses are dead (no bounces
though) or their weird graphs do in fact indicate some fraud or
sloppiness
<gwern> MrEmile: but neither of those are evenly divisible by 4, so
there must be some breakdown into the experimentals and control
group...
< MrEmile> Section 3.2.1 says 48 fifth-graders, 26 boys, 22 girls,
average age 10.35
If no Chinese-readers here feel like volunteering to check
http://www.doc88.com/p-397166703921.html for details, I'll probably
wind up entering this study into the meta-analysis as 2 studies; I'll
assume the 4 groups were evenly divided, and in each, I will pool the
single group with the dual n-back group and the dual-attention task
group with the control group. He didn't mention anything that
indicated the control group was not no-contact, so that stays the
same.
--
gwern
http://www.gwern.net