Cornell Information Science contact | cis home
   home  about us  undergrad programs  grad programs  research  faculty and researchers
 About Us

 Overview
 Colloquium
      IS-SIGCHI Series
      IS Brown Bag Series
 Facilities
 Contact

 Information Science Colloquium
Using Visual Information to Coordinate Speech and Action in Collaborative Physical Tasks

Speaker:
Susan R. Fussell, Research Scientist, Carnegie Mellon University

Date:
Wednesday, October 5, 2005   4:15 - 5:15p

Location:
301 College Avenue, Seminar Room

Abstract:
Collaborative physical tasks are tasks in which two or more individuals jointly perform actions on concrete objects in the three-dimensional world. For example, an expert might guide a worker's performance of emergency aircraft repairs in a remote location or an emergency room team may join forces to save a patient's life. Collaborative physical tasks require substantial coordination among participants’ actions and talk. In face-to-face settings, much of this coordination is managed through visual information. Visual information plays at least two inter-related roles. First, it helps people maintain situation awareness of the state of the task and environment. Second, it helps people communicate, by aiding conversational grounding, or the development of mutual understanding between collaborators.

Different visual cues, such as a partner’s face or task objects, vary in their importance for awareness and conversational grounding. In order to build successful technologies for remote collaboration on physical tasks, we must understand when and how people use different types of visual information to coordinate their activities. We take a decompositional approach to this problem, in which we strive to specify the different types of visual cues available to collaborators in face-to-face and computer-mediated settings and identify how these cues influence situation awareness, communication, and task performance. I will first describe the basic components of this model. Then, I will present a series of behavioral studies examining people’s use of visual information in different media. I will conclude by highlighting the implications of our findings for the design of video systems for remote collaboration on physical tasks and describing our current work developing intelligent video systems that show the right visual information at the right time.

Bio:
Susan R. Fussell is a Research Scientist in the Human Computer Interaction Institute at Carnegie Mellon University. She earned her PHD in social and cognitive psychology from Columbia University in 1990. In her earlier work, she examined how people take one another’s perspective in face-to-face conversation. Her current research projects include designing multimodal systems for remote collaboration, developing tools to support coordination in hospital settings, understanding the effects of culture on computer-mediated communication, and evaluating the benefits and costs of participating in online support chatrooms.

[handout]

If you would like to meet with Susan, or for more information, please contact Jeff Hancock.