Tests & Quizzes export function

12 views
Skip to first unread message

Tonco Tijdeman

unread,
Feb 23, 2021, 8:20:03 AM2/23/21
to Sakai Users Group
Hello all,

When performing an export on a Test & Quizzes exam, the export does show  'Final score' and 'Part x score' columns. The most important one needed for assessment analysis, the questions scores, are missing in the export however.

In order to be able to calculate the Cronbach's alpha, P value and Rit value, mean and standard deviation (all necessary to determine validity and reliability of the exam and its individual questions), the individual question scores need to be part of the export.

In the 'item analysis' and in the 'statistics', some of this information is available based upon individual question scores, so it seems like the information is available, just not in the export file.

Would it be possible to have minimally the question scores added, since it is becoming very important in the quality cycle of assessments to perform this on exams in this time of increasing numbers of assessments taken online.

It would be even better if the Cronbach's alpha, P value, Rit value, mean and variance could be part of a report or the export as well. That means providing the necessary means to look at the reliability and validity of questions and exams with the most common used values automatically. Less manual work and thus less chance of manual error for these values to be calculated...

Export file.png

Kind regards,

Tonco Tijdeman
Hotelschool The Hague

Stull, Tiffany (tls6u)

unread,
Feb 23, 2021, 11:12:10 AM2/23/21
to Tonco Tijdeman, Sakai Users Group

Hi Tonco,

 

The existing export file does include the data from the Item Analysis screen – you can find it in the “Item Analysis” tab of the spreadsheet.

 

At UVA, we had multiple requests from instructors for improved export.  We recently put into production locally a new formatted export for Tests & Quizzes that includes details such as individual question scores and correctness.  I have details about it with screenshots in our help article How do I export a spreadsheet with assessment scores and student responses? I can create a Sakai jira in hopes that it could be contributed back in the future.

 

Tiffany Stull

 

Kind regards,

Tonco Tijdeman

Hotelschool The Hague

--
You received this message because you are subscribed to the Google Groups "Sakai Users Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sakai-user+...@apereo.org.
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/sakai-user/6dc2f7a2-b251-48f5-839c-0181c20b834dn%40apereo.org.

Jesus Maria Mendez Perez

unread,
Feb 24, 2021, 4:21:03 AM2/24/21
to Stull, Tiffany (tls6u), Tonco Tijdeman, Sakai Users Group
Hi Tiffany,

It looks awesome!! 
It could be great if someone could contribute this feature request.

I created some months ago a jira to improve the export functionality:

Great job.

Regards Jesús.


Tonco Tijdeman

unread,
Feb 25, 2021, 6:06:30 PM2/25/21
to Sakai Users Group, tls6u, Tonco Tijdeman
Hello Tiffany,

It does indeed, for 'automatically graded' questions only though. For 'Short answer/essay' type of open questions, the actual question scores can still help determine the validity and reliability but the question scores are not part of the 'Item Analysis' tab, so also no analysis is available on those questions.

The formatted report indeed is a major improvement! Would love to see this contributed. This will really help in providing the information needed for the assessment committee to improve quality in the exam cycle.

Kind regards,
Tonco
Reply all
Reply to author
Forward
0 new messages