I certainly agree that there's no real way to get scientific rigor
without full-blown scientific techniques such as large double-blind
trials, but if you're just interested in whether you personally should
continue to devote time to n-back, I don't think it would be all that
hard to do (by which I mean, get better than coin-flipping results).
The point of n-back is to get 'transfer' to g. g is supposed to give
you general performance on all sorts of puzzles, while training on
specific puzzles does not 'transfer' to other puzzles.
So what you could do, if you don't have a couple dozen IQ tests handy,
is assemble a battery of puzzles and periodically go through them and
track your performance.
If you're just training on one puzzle, then you'll see just that one
rise. But if n-back is giving you real improvements in working memory
& thence to g, then you could hope to observe a rise in all the puzzle
scores.
(The obvious counterpoint here is that if you play all the puzzles in
a session and repeat sessions periodically, aren't you training on
those puzzles and so will observe an increase anyway? Yes, but often
the increase is short. For example, the puzzle software I would use
here is Gbrainy - Free, packaged for Ubuntu, and not too shabby - and
back when I was playing with polyphasic sleep and using Gbrainy to
test my general mental state, I noticed that even when I was back to
normal sleep, my scores plateaued pretty quickly and hardly budged
after that. So if I were to start playing gbrainy, I would expect to
see low gbrainy scores, over a week increase to the usual plateau, and
then any further improvements I could tentatively attribute to
n-back.)
--
gwern
So I went looking for a quote about that. Here's what I found in Jaeggi 2008:
"The finding that the transfer to Gf remained even after taking
the specific training effect into account seems to be counterin-
tuitive, especially because the specific training effect is also
related to training time. The reason for this capacity might be
that participants with a very high level of n at the end of the
training period may have developed very task specific strategies,
which obviously boosts n-back performance, but may prevent
transfer because these strategies remain too task-specific (5, 20).
The averaged n-back level in the last session is therefore not
critical to predicting a gain in Gf; rather, it seems that working
at the capacity limit promotes transfer to Gf."
That's certainly encouraging - 'it's not how well you do but how hard
you're trying!'.
--
gwern
True enough. We have the research papers handy; I wonder if anyone is
feeling energetic enough to draw up an FAQ?
Usage & effect questions would be a good place to start - 'how much
should I practice? as much as you want, but the more the better' 'my
n-back is small, am I wasting my time? no, the benefits come from
exercising/stressing your mind, not simply playing at a high level'
'does this *really* improve my intelligence? sure looks like it,
jaeggi reports transfer to other tests correlated with g' 'what sorts
of effects have people reported? increased curiosity, vivid dreams,
greater ease of learning' etc.
--
gwern