Conceptual Design Scheme for Virtual Characters
Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications EngineeringPublished 1 January 2010
Gino Brunetti, Rocco Servidio
Citations11
SJR quartileQ4
SJR score0.16
SNIP0.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A taxonomy is described that explores the principal cognitive and computational parameters involved in the design, development and evaluation of a virtual character.
Abstract
The aim of this paper is to describe some theoretical considerations about virtual character design. In recent years, many prototypes of cognitive and behavioral architectures have been developed to simulate human behavior in artificial agents. Analyzing recent studies, we assume that there exists a variety of computational models and methods in order to increase the cognitive abilities of the virtual characters. In our opinion, it is necessary to perform a synthesis of these approaches in order to improve the existing models and avoiding the application of new approaches. Considering these aspects, in this paper we describe a taxonomy that explores the principal cognitive and computational parameters involved in the design, development and evaluation of a virtual character.
Keywords
PsychologyComputer ScienceEngineering
Trends in NeurosciencesLanguage within our grasp
2,809 Citations1998Giacomo Rizzolatti, Michael A. Arbib
It is proposed here that an observation/execution matching system provides a necessary bridge from'doing' to'communicating', as the link between actor and observer becomes a link between the sender and the receiver of each message.
IEEE Transactions on Pattern Analysis and Machine IntelligenceRecognizing action units for facial expression analysis
1,741 Citations2001Yingli Tian, Takeo Kanade +1 more
An Automatic Face Analysis (AFA) system to analyze facial expressions based on both permanent facial features and transient facial features in a nearly frontal-view face image sequence and Multistate face and facial component models are proposed for tracking and modeling the various facial features.
ACM Transactions on GraphicsSynthesis and evaluation of linear motion transitions
1,539 Citations2008Jing Wang, Bobby Bodenheimer
This article develops methods for determining visually appealing motion transitions using linear blending, and assess the importance of these techniques by determining the minimum sensitivity of viewers to transition durations, the just noticeable difference, for both center-aligned and start-end specifications.
Gesture and Thought
1,137 Citations2005David McNeill
Proceedings of the National Academy of SciencesRapid perceptual integration of facial expression and emotional body language
675 Citations2005Hanneke K. M. Meeren, Corné C. R. J. van Heijnsbergen +1 more
It is shown that observers judging a facial expression are strongly influenced by emotional body language, and an enhancement of the occipital P1 component as early as 115 ms after presentation onset points to the existence of a rapid neural mechanism sensitive to the degree of agreement between simultaneously presented facial and bodily emotional expressions, even when the latter are unattended.
International Journal of Human-Computer StudiesComputers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent
508 Citations2005Scott Brave, Clifford Nass +1 more
Emppathic emotion was found to have a significant effect on the agent's likability, trustworthiness, and perceived caring, as well as on the user's felt support, independent of the presence of self-oriented emotion.
EmotionBody expressions influence recognition of emotions in the face and voice.
461 Citations2007Jan Van den Stock, Ruthger Righart +1 more
The findings illustrate the importance of emotional whole-body expressions in communication either when viewed on their own or, as is often the case in realistic circumstances, in combination with facial expressions and emotional voices.
Brain and LanguageNeural evidence for the interplay between language, gesture, and action: A review
385 Citations2007Roel M. Willems, Peter Hagoort
An overview of studies in cognitive neuroscience that examine the neural underpinnings of links between language and action is given, concluding that there is strong evidence on the interaction between speech and gestures in the brain.
Stepping into Virtual Reality
369 Citations2008Mario Gutiérrez, Frédéric Vexo +1 more
This book looks at how to generate advanced virtual reality worlds, beginning with basic definitions, and then moving on to the latest results from current research and exploring the social implications of these.
PhysiologyBroca’s Region: From Action to Language
320 Citations2005Nobuyuki Nishitani, Martin Schürmann +2 more
Broca's region, classically considered a motor speech-production area, is involved in action understanding and imitation and it also seems to help in sequencing of actions.
ACM Transactions on GraphicsGesture modeling and animation based on a probabilistic re-creation of speaker style
234 Citations2008Michael Neff, Michael Kipp +2 more
A system that, with a focus on arm gestures, is capable of producing full-body gesture animation for given input text in the style of a particular performer, which was successfully validated in an empirical user study.
Computer Animation and Virtual Worlds
227 Citations2006
A new approach to realistic hand modeling and deformation with real-time performance, by means of sweeps which follow a simplified skeleton, which demonstrates the naturalism of its results by comparative images of modeled and real hands, including several challenging poses.
Interacting with ComputersThe effects of affective interventions in human–computer interaction
191 Citations2004Timo Partala, Veikko Surakka
The results suggest that both types of affective intervention had beneficial effects over ignoring the user and further that positive intervention may be especially useful.
Haar Features for FACS AU Recognition
167 Citations2006Jacob Whitehill, Christian W. Omlin
Empirical results showed that the Haar+Adaboost method yields AU recognition rates comparable to those of the Gabor+SVM method but operates at least two orders of magnitude more quickly.
International Journal of Human-Computer StudiesUsing human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game
153 Citations2005Helmut Prendinger, Junichiro Mori +1 more
The results of the study indicate that empathic character response can significantly decrease user stress and that affective behavior may have a positive effect on users' perception of the difficulty of a task.
International Journal of Human-Computer StudiesModeling and evaluating empathy in embodied companion agents
152 Citations2007Scott McQuiggan, James C. Lester
Care, a data-driven affective architecture and methodology for learning models of empathy by observing human-human social interactions is presented and it is suggested that the Care paradigm can provide the basis for effective empathetic behavior control in embodied companion agents.
Journal of Neuroscience MethodsAmygdala activation at 3T in response to human and avatar facial expressions of emotions
145 Citations2006Ewald Moser, Birgit Derntl +4 more
It is suggested that avatars could be a useful tool in neuroimaging studies of facial expression processing because they elicit amygdala activation similarly to human faces, yet have the advantage of being highly manipulable and fully controllable.
IEEE Computer Graphics and ApplicationsA Sketch-Based Interface for Clothing Virtual Characters
132 Citations2007Emmanuel Turquin, Jamie Wither +3 more
This interactive system for garment creation determines a garment's shape and how the character wears it based on a user-drawn sketch and uses distances between the 2D garment silhouette and the character model to infer remaining distance variations in 3D.
Interacting with an embodied emotional character
114 Citations2003Christoph Bartneck
The presence of emotional expressions significantly increased the Enjoyability of the interaction with the robotic character and the embodiment had no significant influence on the enjoyability.
EURASIP Journal on Advances in Signal ProcessingParameterized Facial Expression Synthesis Based on MPEG-4
110 Citations2002Amaryllis Raouzaiou, Nicolas Tsapatsoulis +2 more
International Journal of Human-Computer StudiesSubtle emotional expressions of synthetic characters
106 Citations2005Christoph Bartneck, Juliane Reichenbach
The results of this study are of particular importance for the developers of synthetic characters and might help them to create more subtle characters.
Brain and LanguageAn intentional stance modulates the integration of gesture and speech during comprehension
91 Citations2006Spencer D. Kelly, Sarah Ward +2 more
The results demonstrate that pragmatic knowledge about the intentional relationship between gesture and speech modulates controlled neural processes during the integration of the two modalities.
Virtual RealityMixed feelings: expression of non-basic emotions in a muscle-based talking head
85 Citations2005Irene Albrecht, Marc L. Schröder +2 more
An algorithm for generating facial expressions for a continuum of pure and mixed emotions of varying intensity is presented and a variety of life-like intermediate facial expressions captured as snapshots from the system demonstrate the appropriateness of the approach.
Human-computer interaction seriesEmbodied Conversational Agents on a Common Ground
81 Citations2004Zsófia Ruttkay, Claire Dormann +1 more
This chapter proposes a common taxonomy of the relevant design and evaluation aspects of ECAs, and refers to recent works to elicit evaluation concepts and discuss measurement issues.
Lecture notes in computer scienceWriting with Your Eye: A Dwell Time Free Writing System Adapted to the Nature of Human Eye Gaze
74 Citations2008Nikolaus Bee, Elisabeth André
Quikwriting, which was originally designed for handhelds, is proposed as a method for text input that meets the requirements of eye gaze controlled input best and some guidelines for the design of future Quikwriting-based eye gazecontrolled applications are formulated.
This computer responds to user frustration
71 Citations1999Jonathan Klein, Youngme Moon +1 more
A human-computer interaction agent was designed and built to support users in their ability to recover from negative emotional states, particularly frustration.
Interacting with ComputersThe effects of speech–gesture cooperation in animated agents’ behavior in multimedia presentations
67 Citations2007Stéphanie Buisine, Jean‐Claude Martin
Although speech-gesture cooperation was not consciously perceived, it proved to influence users' recall performance and subjective evaluations: redundancy increased verbal information recall, ratings of the quality of explanation, and expressiveness of agents.
Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation
60 Citations2001Sumedha Kshirsagar, S. Garchery +1 more
The goal of this paper is to present a robust and fast geometric mesh deformation algorithm that can be applied to enable the animation of various mesh objects defined by the placement of their feature points.
Information and Software TechnologyEmotional agents: A modeling and an application
58 Citations2006Khulood Abu Maria, Raed Abu Zitar
The study shows that systems with proper model of emotions can perform in many cases better than systems without emotions and if emotions as they exist in ''real intelligence'' can be helpful for ''artificial intelligence''.
A motivational model of action selection for virtual humans
55 Citations2005Étienne de Sevin, Daniël Thalmann
This paper describes in detail a motivational model of action selection for autonomous virtual humans in which overlapping hierarchical classifier systems, working in parallel to generate coherent behavioral plans, are associated with the functionalities of a free flow hierarchy to give reactivity to the hierarchical system.
Design and Evaluation of Embodied Conversational Agents: A Proposed Taxonomy
43 Citations2002Katherine Isbister, Patrick Doyle
It is suggested that researchers in this field could benefit from carefully identifying their own areas of expertise and contribution, and then looking for ways to collaborate on standards and share advances within these sub- areas within this field.
New Challenges for Character-Based AI for Games
37 Citations2002Bruce Blumberg
It is believed that character-based AI systems can draw from and contribute to the state of the art in such areas as pattern recognition and planning.
Lecture notes in computer scienceAre Computer-Generated Emotions and Moods Plausible to Humans?
37 Citations2006Patrick Gebhard, Kerstin H. Kipp
The results indicate that ALMA provides authentic believable emotions and moods that can be used for modules that control cognitive processes and physical behavior of virtual humans in order to improve their lifelikeness and their believable qualities.
Computer Animation and Virtual WorldsEmotional face expression profiles supported by virtual human ontology
34 Citations2006Alejandra García-Rojas, Frédéric Vexo +6 more
Inside this ontology the knowledge of some of those approaches inside an ontology in order to support the modeling of emotional facial animation in virtual humans (VH) are laid out.
Virtual shapers & movers
33 Citations2007Rachel McDonnell, Sophie Jörg +3 more
It is found that both form and motion influence sex perception for these characters: for neutral synthetic motions, form determines perceived sex, whereas natural motion affects the perceived sex of both androgynous and realistic forms.
Personal and Ubiquitous ComputingMixed reality participants in smart meeting rooms and smart home environments
31 Citations2007Anton Nijholt, Job Zwiers +1 more
The modeling and simulation of interacting participants in a virtual meeting room, how remote meeting participants can take part in meeting activities and they have some observations on translating research results to smart home environments are discussed.
Intelligent Decision TechnologiesIntelligent virtual humans with autonomy and personality
15 Citations2007KasapZerrin, Magnenat-ThalmannNadia
Intelligent virtual characters has been subject to exponential growth in the last decades and they are utilized in many application areas such as education, training, human-computer interfaces and more.
IEEE Transactions on Visualization and Computer GraphicsThe Impact of a Character Posture Model on the Communication of Affect in an Immersive Virtual Environment
14 Citations2008Vinoba Vinayagamoorthy, Anthony Steed +1 more
The quantitative results indicate that posture plays an important role in the communication of affect by virtual characters and the importance of designing holistically congruent virtual characters especially in immersive settings is discussed.
INTERACTIVE AGENTS FOR MULTIMODAL EMOTIONAL USER INTERACTION
14 Citations2007Eva Cerezo, Sandra Baldassarri +1 more
Maxine virtual agents can establish emotional communication with the user through their facial expressions, the modulation of the voice and expressing the answers of the agents according to the information gathered by the system: noise level in the room, observer's position, emotional state of the observer, etc.
What can i do with this?
11 Citations2007Pedro Sequeira, Marco Vala +1 more
SOTAI - Smart ObjecT-Agent Interaction is described, a framework that will help agents to identify possible interactions with unknown objects based on their past experiences and show that their agents are able to acquire valid conceptual knowledge.
Adaptive Agents and Multi-Agents SystemsUser's gestural exploration of different virtual agents' expressive profiles
11 Citations2008Matthieu Courgeon, Jean‐Claude Martin +1 more
This paper describes the platform that enables a virtual character to display blended facial expressions of emotions as realtime continuous reactions to users' gesture input and explains the techniques underlying the computation of intermediate facial expression of emotion.
Data Archiving and Networked Services (DANS)Imparting Individuality to Virtual Humans
10 Citations2002Arjan Egges, Vipul Kshirsagar +1 more
An integrated method of linking personality and emotion with the response generation and expression synthesis of Virtual Humans, which depends not only on input given by a user, but also on its personality and emotional state.
International Joint Conference on Natural Language ProcessingPOLLy: A Conversational System that uses a Shared Representation to Generate Action and Social Language.
8 Citations2008Swati Gupta, Marilyn Walker +1 more
A demo of the conversational system POLLy (POliteness in Language Learning) which uses a common planning representation to generate actions to be performed by embodied agents in a virtual environment and to generate spoken utterances for dialogues about the steps involved in completing the task.
A Theoretical Framework of Rational and Emotional Agent for Ubiquitous Computing
6 Citations2006Xianwei Lai, Shan-Li Hu
An improved model of concurrent game structure is given, mental states of agent are brought into new multi-agent cooperation logics, multi-subset semantics of individual intention are given and extended to give the semantics to group intentions.
Lecture notes in computer scienceFacial Deception in Humans and ECAs
6 Citations2008Isabella Poggi, Radosław Niewiadomski +1 more
A definition of deception and of its functions in terms of a model of cognition and social action is presented and an ECA is presented that can simulate, mask, or suppress facial expressions of emotions.
MPEG-4 Facial Expression Synthesis based on Appraisal Theory
5 Citations2006Lori Malatesta, Amaryllis Raouzaiou +1 more
MPEG-4 facial animation parameters are used in order to evaluate theoretical predictions for intermediate expressions of a given emotion episode, based on Scherer's appraisal theory, and the results of the synthesis process can be applied to Embodied Conversational Agents (ECAs), rendering their interaction with humans, or other ECAs, more affective.
An Emotional Model for Nonverbal Communication Based on Fuzzy Dynamic Bayesian Network
5 Citations2006Hua Zhang, Rui Li +1 more
Fuzzy logic system which is a modification of the dynamic Bayesian network (DBN) is adopted to solve the two crucial problems to creating agents that display believable emotions and to increase the believability of virtual human to a great extent.
User's Gestural Exploration of Different Virtual Agents' Expressive Profiles (Short Paper)
1 Citations2008Matthieu Courgeon, Jean‐Claude Martin +1 more
Digital Library (University of West Bohemia)Visualization of Dynamic Behaviour of Multi-Agent Systems
1 Citations2004David Řehoř, Pavel Slavı́k +2 more
An extension of the research on analysis of a single agent or agent communities combining advanced methods of visualization with traditional AI techniques is presented, which addresses the problem of not suitable well to present the dynamics of the MAS by visualizing the changes of theMAS along with their quality and context.