Event Log and Longsight events data...
Laura Gekeler
| sam.assessment.take |
| sam.assessment.submit.from_last |
| sam.assessment.graded.auto |
| sam.assessment.submit |
| sam.assessment.submit.click_sub |
| sam.assessment.submit.checked |
| sam.assessment.submit.noti |
| sam.assessment.review |
Jennifer Loudiana
We use the events log mostly for did they log in during the time. Did they start something such as click sam.assessment.take and when did the item submit. I would think it would also depend on the settings of the instructor as well, did they allow more than 1 take, did they allow automatic feedback, etc…
I would agree we don’t have descriptions for each event type and which events are human clicks and which are LMS auto for example, when you load a page a bunch of things can load and show in the events but the student didn’t click on them.
At one point a small group was going to review all the events and types and work on putting a dictionary together.
From: sakai...@apereo.org [mailto:sakai...@apereo.org]
On Behalf Of Laura Gekeler
Sent: Wednesday, December 1, 2021 9:23 AM
To: sakai-user <sakai...@apereo.org>
Subject: [sakai-user] Event Log and Longsight events data...
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
--
You received this message because you are subscribed to the Google Groups "Sakai Users Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
sakai-user+...@apereo.org.
To view this discussion on the web visit
https://groups.google.com/a/apereo.org/d/msgid/sakai-user/CAB%3D-X1z7mU7%2B1Ca0y2beWjqXK90KuM7Fago2mg0oAceTSV71ww%40mail.gmail.com.
Stull, Tiffany (tls6u)
Hi Laura,
Actually, Sakai logging can answer some of your questions. That said, I don’t know which events you have available – some of the “access” type events (GET and POST) may not be available to you depending on what is provided for you to view.
- Did they show/hide the timer? – No, there is no event logged for this.
- Did they change their M/C answer selection? (What were their choices and what did they change them to?) – No, as answers do not save individually upon selecting them, and the tool may need significant rewrites to be able to store that data without performance impact, there is no event logged for this activity. However, if the assessment was successfully submitted, you can identify in the Scores > Questions tab for a question the timestamp when its answer was last saved under the Date column. For illustrated steps: How do I grade Tests & Quizzes submissions by question? Of course, if the questions were all on one page, the timestamp will be the same for all of them.
- Did they access the Feedback tab? – A sam.assessment.review event will indicate feedback page access, as well as the assessment ID for the assessment with the feedback being reviewed.
- Did they access the test from a Lesson or from the tool or from a particular HTML page? Or Resource URL? – If the student begins the assessment directly within Tests & Quizzes, the action of selecting Begin Assessment will trigger a sam.assessment.take event. If the student begins the assessment via a link, the event will instead be sam.assessment.take.via_url. You can also use surrounding events to ascertain from where they accessed the assessment. For example, accessing the main page of samigo will trigger a GET /portal/site/siteid/tool/toolid/jsf/index/mainIndex event, whereas accessing Lessons pages should have a lesson builder-related event.
- Did they have two tabs open and switch back and forth between them? – UVA has some custom logging to give us a rough idea of whether multiple tabs were open at once, with each tab open for 10 seconds or more. However, there is no way to discern what exactly was open in each tab, so if they open a document added as a file attachment to a quiz, they may trigger a tab count increase that is appropriate for the assessment.
I have a list of events pertaining to student activities that are typically of interest here: What are the Tests & Quizzes user events for students?
And for instructor activities: What are the Tests & Quizzes user events for instructors?
Some additional notes:
- All logging pertaining to date/time exceptions was set up at UVA with the work in SAK-34323 that has not yet been contributed back.
- The logging for instructors editing content in question pools is also a UVA customization that has not been contributed back – let me know if you’d like me to create a Sakai jira for contrib of the question pools logging.
I hope this helps!
Tiffany
From: sakai...@apereo.org <sakai...@apereo.org>
On Behalf Of Laura Gekeler
Sent: Wednesday, December 1, 2021 9:23 AM
To: sakai-user <sakai...@apereo.org>
Subject: [sakai-user] Event Log and Longsight events data...
Hi Everyone,
--
Matthew Jones
To view this discussion on the web visit https://groups.google.com/a/apereo.org/d/msgid/sakai-user/BL3PR13MB5161D5A1D00849B5CC4BE61D8D699%40BL3PR13MB5161.namprd13.prod.outlook.com.
Laura Gekeler
Stull, Tiffany (tls6u)
Hi Matthew,
I agree – a pure log analysis is usually not sufficient to prove guilt in cheating. However, once in a while, there’s an obvious red flag (e.g., an IP access log that shows a student’s login taking a test in one country, and a few minutes later, accessing that same test from an IP in a different country).
I’ve noticed in looking at Canvas and Brightspace that Brightspace has amazing instructor-facing logging for quizzes, including details of when answers to each question were saved: https://instructionaldesignthatworks.com/2021/03/03/view-quiz-submissions-and-event-log-in-brightspace/
The Sakai help article is actually the same article as the one I sent, with a different title. However, I’ve updated my local copy to include more events and to modify some that have had their names changed between Sakai 12 and Sakai 20 😉. I can send Wilma a new copy to Sakai Screensteps for use.
Tiffany