Here is a relevant article on wikipedia.
The key point I was missing: Once you find the median of medians, use
that as
a PIVOT to split the list into two parts. We can argue that, by the
median of medians
property, at least a constant fraction of the list will be on each
side of the pivot, and
hence the subproblem remaining is substantially smaller.
Tom