Where to get events in a readable way?

107 views
Skip to first unread message

Mohammad Khalil

unread,
Oct 25, 2018, 9:41:40 AM10/25/18
to General Open edX discussion
Hi all,

We are working with an Open edX platform that hosts MOOCs. I asked for events log files from one MOOC. The file I got afterward was with an extension of .gz. So, after unzipping the file and opening it with Notepad ++, I got JSON logs with many events that are hard to handle for detailed analysis (Learning Analytics).

I once worked with edX, where one guy created a database and imported log files from edX and then based on the daily logs of specific MOOCs, the data from the edx platform was converted to many tables. for instance, log events of videos go to the video table, forum events go to the discussion forum table...etc.

So, my question, is there any place or a script I can find around that can make doing analytics on students events easier? is there a good manual or way to do this?

I hope you get what I mean,
Thank you very much

Nate Aune

unread,
Oct 26, 2018, 9:24:18 PM10/26/18
to edx-...@googlegroups.com
There are two paths I'd recommend:

1) You can send all the events from Open edX to Segment by adding your Segment key to the edX settings. From within Segment, you can specify a destination for this event data to be sent to, which could be a data warehouse like Redshift, Bigquery or Snowflake. Once the events are in the data warehouse, you can query them as you would any other database.

2) You can use xAPI to send the events to a learning record store (LRS). We have a very preliminary edX-to-xAPI bridge that can send events like problem submissions, course enroll/unenroll, course completion, navigation and video events. We've been testing with Learning Locker (an open source LRS), but any xAPI compliant LRS should work.  

The LRS is not as easily queryable as a database, but the advantage is that it's specifically designed for tracking learning analytics events, whereas the data warehouse is just a general data store.

If you're interested in learning more about option 1 or 2, let me know and I can send further details.

Nate
--
You received this message because you are subscribed to the Google Groups "General Open edX discussion" group.
To view this discussion on the web visit https://groups.google.com/d/msgid/edx-code/fa33f86d-3f51-4dcc-b48d-87f4e03788a3%40googlegroups.com.


--

Mohammad Khalil

unread,
Oct 29, 2018, 5:06:14 AM10/29/18
to General Open edX discussion
Hi Nate,

Thank you for your informative reply. I liked both options! Since I am not moderating the open edx platform but I am receiving the daily logs, would Segment fit my needs?

Hearing more about the xAPI and LRS is also interesting in the future for me. So, it is kind of you elaborating on these :)

Thanks a lot
Mohammad  

Georgios Psathas

unread,
Jun 25, 2019, 8:37:27 AM6/25/19
to General Open edX discussion
Mohammad Hi.

Did you find the solution to your problem?

I encounter the same issue.

Can you help me with that?
Reply all
Reply to author
Forward
0 new messages