Natural Behavior of a Listening Agent
Lecture notes in computer sciencePublished 1 January 2005
R. M. Maatman, Jonathan Gratch, Stacy Marsella
Citations129
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper will illustrate that appropriate listening behavior can also be generated by other features of a speaker's behavior that are available in real time such as speech quality, posture shifts and head movements.
Abstract
In contrast to the variety of listening behaviors produced in human-to-human interaction, most virtual agents sit or stand passively when a user speaks. This is a reflection of the fact that although the correct responsive behavior of a listener during a conversation is often related to the semantics, the state of current speech understanding technology is such that semantic information is unavailable until after an utterance is complete. This paper will illustrate that appropriate listening behavior can also be generated by other features of a speaker's behavior that are available in real time such as speech quality, posture shifts and head movements. This paper presents a mapping from these real-time obtainable features of a human speaker to agent listening behaviors.
Keywords
PsychologyComputer Science
The MIT Press eBooksEmbodied Conversational Agents
1,788 Citations2000
This book describes research in all aspects of the design, implementation, and evaluation of embodied conversational agents as well as details of specific working systems.
Journal of Nonverbal BehaviorThe Chameleon Effect as Social Glue: Evidence for the Evolutionary Significance of Nonconscious Mimicry
960 Citations2003Jessica L. Lakin, Valerie E. Jefferis +2 more
It is argued that mimicry played an important role in human evolution and has now evolved to serve a social function, and nonconscious behavioral mimicry increases affiliation, which serves to foster relationships with others.
Psychological ScienceMimicry and Prosocial Behavior
677 Citations2004Rick B. van Baaren, Rob W. Holland +2 more
The results suggest that the effects of mimicry are not simply due to increased liking for the mimicker, but are due toincreased prosocial orientation in general.
Embodiment in conversational interfaces
557 Citations1999Justine Cassell, Timothy Bickmore +5 more
It is argued that the only way to fullymodel the richness of human I&+ to-face communication is torely on conversational analysis that describes sets of conversational behaviors as fi~lfilling conversational functions, both interactional and propositional.
Cognitive PsychologyRepeating Words in Spontaneous Speech
437 Citations1998Herbert H. Clark, Thomas Wasow
It is argued that the principles governing these stages are general and not specific to repeats, and that speakers are more likely to make a premature commitment, immediately suspending their speech, as both the local constituent and the constituent containing it become more complex.
Journal of PragmaticsProsodic features which cue back-channel responses in English and Japanese
426 Citations2000Nigel G. Ward, Wataru Tsukahara
IEEE Intelligent SystemsCreating interactive virtual humans: some assembly required
384 Citations2002Jonathan Gratch, Jeff Rickel +4 more
The issues and available tools in three key areas of virtual human research: face-to-face conversation, emotions and personality, and human figure animation are overviewed.
Autonomous RobotsRecognition of Affective Communicative Intent in Robot-Directed Speech
245 Citations2002Cynthia Breazeal, Lijin Aryananda
This paper presents an approach for recognizing four distinct prosodic patterns that communicate praise, prohibition, attention, and comfort to preverbal infants and integrates this perceptual ability into the authors' robot's “emotion” system, thereby allowing a human to directly manipulate the robot's affective state.
Journal of Speech Language and Hearing ResearchRespiratory Markers of Conversational Interaction
227 Citations2001David H. McFarland
Inspiratory duration was found to be the most consistent and sensitive measure for discriminating quiet breathing from speech breathing and cross-correlation analyses of the respiratory movements of conversational partners provided an index of Conversational synchrony.
Life-like characters : tools, affective functions, and applications
219 Citations2004Helmut Prendinger, 満 石塚
Journal of Nonverbal BehaviorEmotional Empathy as Related to Mimicry Reactions at Different Levels of Information Processing
203 Citations2003Marianne Sonnby‐Borgström, Peter Jönsson +1 more
The MIT Press eBooksNudge Nudge Wink Wink: Elements of Face-to-Face Conversation for Embodied Conversational Agents
200 Citations2000Justine Cassell
It will not be possible to apply exactly the same teaching process to the machine as to a normal child, so that it could not send the creature to school without the other children making excessive fun of it.
Non-verbal cues for discourse structure
179 Citations2001Justine Cassell, Yukiko Nakano +3 more
Journal of Nonverbal BehaviorThe Importance of Nonverbal Cues in Judging Rapport
169 Citations1999Jon Grahe, Frank J. Bernieri
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)Phonetic Consequences of Speech Disfluency
108 Citations1999Elizabeth Shriberg
Analyses of American English show that disfluency affects a variety of phonetic aspects of speech, including segment durations, intonation, voice quality, vowel quality, and coarticulation patterns, which provide clues about production processes and can guide methods for disfluencies processing in speech recognition applications.
Journal of Nonverbal BehaviorRhythmic organization of social interaction and observer ratings of positive affect and involvement
98 Citations1987Rebecca M. Warner, Daniel M. Malloy +3 more
Dynamic patterns in communication processes
98 Citations1996James H. Watt, C. Arthur VanLear
This chapter discusses methods for indexing pattern over time and the Emergence of Shared Interpretations in Organizations from a Self-Organizing Systems Perspective.
A shallow model of backchannel continuers in spoken dialogue
84 Citations2003Nicola Cathcart, Jean Carletta +1 more
DSpace@MIT (Massachusetts Institute of Technology)A computational model for the automatic recognition of affect in speech
75 Citations2004Raul Castro Fernandez, Rosalind W. Picard
It is argued that modeling the affective prosodic variation of speech can be approached by integrating acoustic parameters from various prosodic time scales, summarizing information from more localized to more global prosodic phenomena, and proposed a framework for the recognition of affective qualifiers from prosodic-acoustic parameters extracted from spoken language.
Cognitive technologiesExpressive Behaviors for Virtual Worlds
52 Citations2004Stacy Marsella, Jonathan Gratch +1 more
The goal is to create virtual humans that convey significant information to people while interacting with them in virtual worlds that respond dynamically to the events surrounding them, which are fundamentally influenced by users’ actions, while providing an illusion of human-like behavior.
Pitch-based emphasis detection for segmenting speech recordings
41 Citations1994Barry Arons
A technique to automatically locate emphasized segments of a speech recording based on pitch that adapts to the pitch range of a speaker, then automatically selects the regions of highest pitch activity as a measure of emphasis.