Diagnostic test intermittent bug

[adelle colbourn]

Hi there

I recently created my first diagnostic test. A colleague who tested it noticed that strange things occasionally happen if you enter an answer, fail to click on Save, and just move to the next question instead (she was modelling what a student might do). I am assuming that the answer should automatically be saved in this instance, then the test proceeds normally.

I created a tiny version of the test, with only two learning outcomes and a handful of questions in order to try to catch the bug. The tiny test is this one.

1. Sometimes you have to click on Move to next question twice, as the first click doesn't work. This is not a major issue. See this video clip (Diagnostic double move).

2. Occasionally a question that has been answered correctly behaves as if the answer is incorrect - the Make a choice retry box pops up. If I elect not to retry the question, the correct answer appears to have been recorded. But this could be very confusing for students as they may use up a retry attempt unnecessarily, and also doubt their abilities. See this video clip (Diagnostic bug) where the bug manifests in question 50.

Note that the same version of question 50 appears in both clips but the same answer is treated differently. I have checked the question and it should only ever expect the answer 21. The individual question is this one. 

I have noticed the second bug happen for other questions too - it is not just Q50.

I would like to release this diagnostic test to students, but am not confident that it is behaving as it should.

Regards

Adelle.

[Christian Lawson-Perfect]

I think these problems are related to automatic submission of answers. If you write an answer and then immediately click on the "move to the next question" button, the answer has not yet been marked, so Numbas thinks you just haven't answered it and offers to retry or move on.

I'll have a look at whether we can run the automatic submission handler before trying to move on.

--
You received this message because you are subscribed to the Google Groups "Numbas Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to numbas-users...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/numbas-users/c2d5c5b4-c40a-4597-8757-50b4c3b5a886n%40googlegroups.com.