As far as I know, that's not possible. The number of guesses is either the number of answers or infinite, with nothing in between.
That's a feature I would like to see -- that the quizmaker can specify the number of guesses before the game ends. I think there are a lot of clickable quizzes that could be much improved with such a choice, particularly multi-column matching.