Logs of programmers editing

36 views
Skip to first unread message

bam

unread,
Jan 10, 2018, 10:15:17 AM1/10/18
to PPIG Discuss

Does anyone have or know of any keystroke logs of programmers editing code? I have heard that some on-line (web based) editors make a complete keystroke log - does anyone know which ones do that? What about any regular desktop IDEs or code editors? 

 

Is there a repository anywhere with existing logs? Logs could be class programming projects but it would be better to get logs of real work, e.g., on open-source software systems.

Ideally the logs would be at the command level (delete-expression) rather than the keystroke level (ctrl-alt-D).

 

A number of years ago, we couldn't find anything, so we built our own for Eclipse, http://www.cs.cmu.edu/~fluorite/ which was used a few times in ours and other research, but I am hoping there is an easier way now! A Google search didn’t bring up anything relevant, except our 2011 paper.

 

Thanks!

Brad A. Myers

Professor

Human-Computer Interaction Institute

School of Computer Science

Carnegie Mellon University

5000 Forbes Avenue

Pittsburgh, PA  15213-3891

(412) 268-5150

FAX: (412) 268-1266

b...@cs.cmu.edu

Felienne

unread,
Jan 10, 2018, 10:18:17 AM1/10/18
to bam, PPIG Discuss
I know Kave that monitors a lot but I am not sure it is keystroke level -> http://www.kave.cc/

--
You received this message because you are subscribed to the Google Groups "PPIG Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ppig-discuss+unsubscribe@googlegroups.com.
To post to this group, send email to ppig-d...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Lindsay Marshall

unread,
Jan 10, 2018, 10:19:00 AM1/10/18
to PPIG Discuss, bam
A student of mine has been doing keystroke logging but it is for beginner programmers in a tutor system so probably no use to you.

L.
--

You received this message because you are subscribed to the Google Groups "PPIG Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ppig-discuss...@googlegroups.com.

Zéphyrin SOH

unread,
Jan 10, 2018, 10:41:32 AM1/10/18
to bam, PPIG Discuss
Don't know if this can help ... Eclipse UDC (https://eclipse.org/epp/usagedata/)?

Finally, be careful on noise in these kind of (monitoring) data (https://link.springer.com/article/10.1007/s10664-017-9529-x)

Regards,

--
You received this message because you are subscribed to the Google Groups "PPIG Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ppig-discuss+unsubscribe@googlegroups.com.

To post to this group, send email to ppig-d...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
-----
Zéphyrin

Guzdial, Mark

unread,
Jan 10, 2018, 10:41:32 AM1/10/18
to bam, PPIG Discuss

Probably the best source of pedagogical use is the BlueJ Black Box: https://www.bluej.org/blackbox.html


There is lots of other work in this space.  I recommend looking at work by Matt Jadud, Neil Brown, and Jaime Spacco.  There was a BOF on this topic at last year's SIGCSE: https://doi.org/10.1145/3017680.3022366.


- Mark


From: ppig-d...@googlegroups.com <ppig-d...@googlegroups.com> on behalf of bam <myers...@gmail.com>
Sent: Tuesday, January 9, 2018 11:04:32 PM
To: PPIG Discuss
Subject: [ppig-discuss] Logs of programmers editing
 
--
You received this message because you are subscribed to the Google Groups "PPIG Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ppig-discuss...@googlegroups.com.

Alan Blackwell

unread,
Jan 10, 2018, 11:07:15 AM1/10/18
to bam, Alan Blackwell, PPIG Discuss
I’ve done keystroke logging of web edit sessions using Sang Won Lee’s “Live Writing” tools.
http://web.eecs.umich.edu/~snaglee/live-writing/

He made a custom version for us, as an extension to the Gollum wiki editor. I’m sure we can get source code for this if of interest.

Alan
> --
> You received this message because you are subscribed to the Google Groups "PPIG Discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to ppig-discuss...@googlegroups.com.
> To post to this group, send email to ppig-d...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

--
Alan Blackwell
Professor of Interdisciplinary Design, University of Cambridge
Further details from www.cl.cam.ac.uk/~afb21/




Arto Hellas

unread,
Jan 10, 2018, 12:11:26 PM1/10/18
to myers...@gmail.com, ppig-d...@googlegroups.com

The ITiCSE working group from 2015 outlined some systems and data: https://dl.acm.org/citation.cfm?id=2858798 -- the issue with completely public keystroke-level data sets is that it's actually quite straightforward to identify students from the data. There was a paper on this at Koli Calling, see https://dl.acm.org/citation.cfm?id=2828960

We have some keystroke-level data sets, but they are mostly from Finnish CS1/CS2 (logged using Test My Code either in NetBeans, Eclipse or IntelliJ). If you're interested in digging into such data, let me know.

Best,

-Arto

--

John Zabroski

unread,
Feb 24, 2018, 12:18:47 PM2/24/18
to Arto Hellas, myers...@gmail.com, ppig-d...@googlegroups.com
Brad,

A few online interview Web tests record and replay a candidates exact key strokes. 
Reply all
Reply to author
Forward
0 new messages