Lecture-Wednesday, April 14, 1999
Abbeygail Lynn Talbot
THERE ARE TWO ANNOUNCEMENTS ON THIS MESSAGE.
PLEASE SCROLL DOWN ALL THE WAY.
THIS IS FOR PHIL COHEN AND SHARON OVIATT.
***********************************************************************
*NOTE NON-STANDARD DAY, TIME, AND LOCATION*
UNIVERSITY OF UTAH
COMPUTER SCIENCE DEPARTMENT
COLLOQUIUM
Wednesday, April 14, 1999
Alumni House-Tanner Dining Room
Refreshments 11:45 AM
Lecture 12:00 PM
Principles, Practice, and Impact of Multimodal Interaction
Phil Cohen
Center for Human-Computer Communication
Oregon Graduate Institute
A new generation of systems is emerging in which the user is able to employ
natural communication modalities, including speech and pen-based gesture, in
addition to the usual graphical user interface technologies. Multimodal systems
incorporating pen and voice communication are advantageous for both very small
and very large devices, for spatially oriented applications, and for contexts
emphasizing user mobility. These advantages will be illustrated through
QuickSet - a handheld, collaborative, multimodal system that allows continuous
speech and pen-based gesturing as input. QuickSet uses distributed agent
architecture, runs on personal computers, and is scalable from wearable to wall
-sized systems. The core of QuickSet is a principled method for combining
information derived from different modes. We discuss how a set of meaning
fragments produced by recognizers for multiple modes can be unified to
determine the best joint interpretation. This unification process will be shown
to support multimodal discourse and mutual interaction, a study will be
described in which expert users completed map-based military tasks using both a
graphical user interface and QuickSet. In brief, with the multimodal interface,
users positioned entities on a map 3-8 times faster than with the graphical
user and for its precision in drawing. To illustrate the QuickSet technology
and its applications, a video and demonstration of the system will be given.
Biography:
Philip R. Cohen received his BA degree in mathematics from Cornell University,
and his M. Sc. and Ph.D. degrees in computer science from the University of
Toronto. Dr. Cohen has been a researcher or faculty member at Bolt Beranek and
Newman, Inc., Oregon State University, the University of Illinois, Fairchild
Laboratory for Artificial Intelligence Research, and SRI International. He is
currently a professor and co-director of the Center for Human-Computer
Communication in the Dept. of Computer Science at the Oregon Graduate Institute
of Science and Technology. His research interests include multimodal
interaction, multiagent systems, dialogue, natural language processing, and
theories of collaboration and communication. Cohen is currently President of
the Association for Computational Linguistics, and is a Fellow of the American
Association for Artificial Intelligence.
*NOTE NON-STANDARD DAY, TIME, AND LOCATION*
UNIVERSITY OF UTAH
COMPUTER SCIENCE DEPARTMENT
COLLOQUIUM
Wednesday, April 14, 1999
Alumni House-Tanner Dining Room
Refreshments 11:45 AM
Lecture 12:00 PM
Ten Myths of Multimodal Interaction
Sharon Oviatt
Center for Human-Computer Communication
Oregon Graduate Institute
Our ability to develop robust multimodal systems will depend on knowledge of
the natural integration patterns that typify people's combined use of different
input modes. This talk will begin by giving an overview of the research goals,
methods, and results of our recent research on users' multimodal interaction
while speaking and writing to interactive map systems. The results of this work
address basic issues such as: (1) when users do and do not interact
multimodally, (2) how multimodal input is integrated and synchronized, (3) what
propositional content is carried by different modes, and (4) whether users are
consistent and similar to one another in their integration patterns. Based on
the empirical evidence from this research as well as what the linguistics
literature indicates about natural multimodal communication, I will summarize
what we currently know about multimodal integration from a cognitive science
perspective. Then I will discuss ten currently fashionable computational
"myths" about multimodal integration - and how they run contrary to the
reality of empirical evidence. The long-term goal of this research is the
development of predictive models of natural modality integration to guide the
design of emerging multimodal architectures.
Biography:
Dr. Sharon Oviatt is an associate professor and one of the co-founders of the
Center for Human-Computer Communication (CHCC) in the Dept. of Computer Science
at the Oregon Graduate Institute of Science & Technology (OGI). She previously
has taught and conducted research at the Artificial Intelligence Center at SRI
International, and the Universities of Illinois, California, and Oregon State.
Her current research focuses on human-computer interaction, interface design
for multimodal/multimedia systems and speech systems, portable &
telecommunication devices, and highly interactive systems. This work is funded
primarily by grants and contracts from the National Science Foundation, DARPA,
Intel, Microsoft, Boeing, NTT Data, Southwestern Bell, and other corporate
sources. She is an active member of the international HCI and speech
communities, has published over 50 scientific articles, and has served on
numerous government advisory panels and editorial boards. Her work is featured
in recent special issues on "Multimodal Interfaces" appearing in both IEEE
Multimedia and Human-Computer Interaction. The content of this talk will
appear in an upcoming 1999 issue of Communications of the ACM. Further
information about Dr. Oviatt and CHCC is available at
http://www.cse.ogi.edu/CHCC.
--
--------------------------------------------------------------------
Abbey Talbot
Secretary
50 S. Central Campus Drive
3190 MEB
Salt Lake City, UT 84112-9205
(801)581-8224
(801)581-5843,fax
tal...@cs.utah.edu