Here is the LTI colloquium guest speaker for this week:
Who: Emily Mower Provost
Where: Doherty Hall 2315
When: Friday 22nd, 2019
Human-Centered Computing: Using Speech to Understand Behavior
Engineering approaches to human behavior analysis are complicated by the lack of a one-to-one mapping between the behavioral cues that an individual generates and how an external observer interprets those cues. This many-to-many mapping injects noise into both the data and ground truth. As a result, many of the models and assumptions used in traditional machine learning and signal processing must be used with caveats or adapted to meet the needs of this domain. I will discuss our work on algorithmic approaches to characterize and predict how humans perceive signals that modulate spoken communication, focusing on emotion and mood. I will highlight our efforts in tracking mood for individuals with bipolar disorder. These technologies have the potential to forward diagnosis and treatment by providing constrained, repeatable, and easily modifiable assessment protocols, objective measures, and interaction scenarios.
Emily Mower Provost is an Associate Professor in Computer Science and Engineering at the University of Michigan. She received her B.S. in Electrical Engineering (summa cum laude and with thesis honors) from Tufts University, Boston, MA in 2004 and her M.S. and Ph.D. in Electrical Engineering from the University of Southern California (USC), Los Angeles, CA in 2007 and 2010, respectively. She is a member of Tau-Beta-Pi, Eta-Kappa-Nu, and a member of IEEE and ISCA. She has been awarded a National Science Foundation CAREER Award (2017), a National Science Foundation Graduate Research Fellowship (2004-2007), the Herbert Kunzel Engineering Fellowship from USC (2007-2008, 2010-2011), the Intel Research Fellowship (2008-2010), the Achievement Rewards For College Scientists (ARCS) Award (2009 – 2010), and the Oscar Stern Award for Depression Research (2015). She is a co-author on the paper, "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition," winner of Best Student Paper at ACM Multimedia, 2014, and a co-author of the winner of the Classifier Sub-Challenge event at the Interspeech 2009 emotion challenge. Her research interests are in human-centered speech and video processing, multimodal interfaces design, and speech-based assistive technology. The goals of her research are motivated by the complexities of the perception and expression of human behavior.