AffectAura
Published 5 May 2012
Daniel McDuff, Amy Karlson, Ashish Kapoor, Asta Roseway, Mary Czerwinski
Citations238
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown that users could reason forward and backward in time about their emotional experiences using the interface, and found this useful.
Abstract
We present AffectAura, an emotional prosthetic that allows users to reflect on their emotional states over long periods of time. We designed a multimodal sensor set-up for continuous logging of audio, visual, physiological and contextual data, a classification scheme for predicting user affective state and an interface for user reflection. The system continuously predicts a user's valence, arousal and engage-ment, and correlates this with information on events, communications and data interactions. We evaluate the interface through a user study consisting of six users and over 240 hours of data, and demonstrate the utility of such a reflection tool. We show that users could reason forward and backward in time about their emotional experiences using the interface, and found this useful.
Keywords
PsychologyNeuroscience
Journal of Behavior Therapy and Experimental PsychiatryMeasuring emotion: The self-assessment manikin and the semantic differential
9,415 Citations1994Margaret M. Bradley, Peter J. Lang
Reports of affective experience obtained using SAM are compared to the Semantic Differential scale devised by Mehrabian and Russell (An approach to environmental psychology, 1974), which requires 18 different ratings.
Computer Vision and Image UnderstandingActive Shape Models-Their Training and Application
7,187 Citations1995T.F. Cootes, Chris Taylor +2 more
This work describes a method for building models by learning patterns of variability from a training set of correctly annotated images that can be used for image search in an iterative refinement algorithm analogous to that employed by Active Contour Models (Snakes).
IEEE Transactions on Pattern Analysis and Machine IntelligenceActive appearance models
5,433 Citations2001T.F. Cootes, G. Edwards +1 more
Handbook of Affective Sciences
5,093 Citations2002
American PsychologistBeyond pleasure and pain.
4,357 Citations1997E. Tory Higgins
Regulatory focus is distinguished from regulatory anticipation and regulatory reference, 2 other principles underlying the different ways that people approach pleasure and avoid pain.
Real-time human pose recognition in parts from single depth images
3,508 Citations2011Jamie Shotton, Andrew Fitzgibbon +6 more
Annals of NeurosciencesMemory: A Contribution to Experimental Psychology
2,809 Citations2013Hermann Ebbinghaus
The first scientific text on the psychology of memory, Hermann Ebbinghaus extended the province of systematic, experimental research to the higher mental processes.
Neighbourhood Components Analysis
1,729 Citations2004Jacob Goldberger, Geoffrey E. Hinton +2 more
A novel method for learning a Mahalanobis distance measure to be used in the KNN classification algorithm that directly maximizes a stochastic variant of the leave-one-out KNN score on the training set.
The Role of Affect in Decision Making
1,332 Citations2002George Loewenstein, Jennifer S. Lerner
Electrodermal Activity
810 Citations1992Wolfram Boucsein
IEEE Transactions on Biomedical EngineeringA Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity
680 Citations2010Ming‐Zher Poh, Nicholas C. Swenson +1 more
Evidence is presented that the distal forearm is a viable alternative to the traditional palmar sites for EDA measurements, and the choice of electrode material by comparing conductive fabric with Ag/AgCl electrodes is evaluated.
Human-computer interaction seriesVisualization of Time-Oriented Data
667 Citations2011Wolfgang Aigner, Silvia Miksch +2 more
Review of General PsychologyLife is Pleasant—and Memory Helps to Keep it that Way!
622 Citations2003W. Richard Walker, John J. Skowronski +1 more
Consciousness and CognitionA Novel Demonstration of Enhanced Memory Associated with Emotional Arousal
614 Citations1995Larry Cahill, James L. McGaugh
The relationship between emotional arousal and long-term memory is addressed in two experiments in which subjects viewed either a relatively emotionally neutral short story or a closely matched but more emotionally arousing story and were tested for retention of the story 2 weeks later.
IEEE Transactions on Affective ComputingContinuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space
454 Citations2011Mihalis A. Nicolaou, H. Gunes +1 more
This paper proposes an output-associative fusion framework that incorporates correlations and covariances between the emotion dimensions and shows that on average, BLSTM-NNs outperform SVR due to their ability to learn past and future context, and the proposed system is well able to reproduce the valence and arousal ground truth obtained from human coders.
Personality and Social Psychology BulletinEmotional Reactivity to Everyday Problems, Affective Inertia, and Neuroticism
434 Citations1998Jerry Suls, Peter Green +1 more
Multimodal affect recognition in learning environments
337 Citations2005Ashish Kapoor, Rosalind W. Picard
A unified approach, based on a mixture of Gaussian Processes, for achieving sensor fusion under the problematic conditions of missing channels and noisy labels, achieves accuracy of over 86%, significantly outperforming classification using the individual modalities, and several other combination schemes.
Affect
222 Citations2005Kirsten Boehner, Rogério DePaula +2 more
This work introduces and explores an alternative model of emotion as interaction: dynamic, culturally mediated, and socially constructed and experienced - instead of sensing and transmitting emotion, systems should support human users in understanding, interpreting, and experiencing emotion in its full complexity and ambiguity.
StartleCam: a cybernetic wearable camera
210 Citations2002Jennifer Healey, Rosalind W. Picard
The implementation described here aims to capture events that are likely to get the user's attention and to be remembered, and creates a "flashbulb" memory archive for the wearable which aims to mimic the wearer.
Visualizing email content
208 Citations2006Fernanda Viégas, Scott A. Golder +1 more
The interface and content-parsing algorithms in Themail are described and the results from a user study where two main interaction modes with the visualization emerged: exploration of "big picture" trends and themes in email (haystack mode) and more detail-oriented exploration (needle mode).
Personal and Ubiquitous ComputingExperiencing the Affective Diary
178 Citations2008Anna Ståhl, Kristina Höök +3 more
The overall aim has been to explore the potential of a system that interleaves the physical and cultural features of the authors' embodied experiences and to further examine what media-specific qualities such a design might incorporate.
Signal ProcessingOn artificial bandwidth extension of telephone speech
158 Citations2003Peter Jax, Peter Vary
A statistical approach based on a hidden Markov model (HMM) is used, which takes into account several features of the band-limited speech, and enhanced speech exhibits a significantly improved quality without objectionable artifacts.
Examining task engagement in sensor-based statistical models of human interruptibility
110 Citations2005James Fogarty, Amy J. Ko +4 more
This work examines task engagement by studying programmers working on a realistic programming task and builds a statistical model of interruptibility that can support a reduction in costly interruptions while still allowing systems to convey notifications in a timely manner.
DSpace@MIT (Massachusetts Institute of Technology)A computational model for the automatic recognition of affect in speech
75 Citations2004Raul Castro Fernandez, Rosalind W. Picard
It is argued that modeling the affective prosodic variation of speech can be approached by integrating acoustic parameters from various prosodic time scales, summarizing information from more localized to more global prosodic phenomena, and proposed a framework for the recognition of affective qualifiers from prosodic-acoustic parameters extracted from spoken language.
Invited Talk: An Exploratory Social-Emotional Prosthetic for Autism Spectrum Disorders
34 Citations2006Rana el Kaliouby, Alea Teeters +1 more
The application of the social-emotional prosthetic is proposed to assist the growing number of individuals diagnosed with autism spectrum disorder in perceiving communication in a natural rather than a structured environment, bootstrapping their ability to learn and develop in social settings.
DSpace@MIT (Massachusetts Institute of Technology)A personal, mobile system for understanding stress and interruptions
27 Citations2004Karen Kay-Lynn Liu
This study has demonstrated that designing platforms that are relational and responsive to a person's affect can facilitate a less frustrating and more enjoyable experience over time, even in tasks that are highly disruptive.
Data portraits
25 Citations2010Judith Donath, Alex Dragulescu +3 more
Understanding memory triggers for task tracking
22 Citations2007A. J. Bernheim Brush, Brian Meyers +2 more
Findings from field observations of eight participants writing their status reports show interesting trends, including the reliance on memory triggers, which were either retrieved from explicit self-reminders, from implicit breadcrumbs left while performing their tasks or directly from memory.
Multimodal Diaries
10 Citations2007Fernando De la Torre, Carlos Agell
A system that summarizes the user's daily activity using all-day multimodal data recordings using a semi-supervised temporal clustering (SSTC) algorithm that accurately and efficiently groups large amounts of multi-modal data into different activities.
Girls Involved in Real Life Sharing: Utilizing Technology to Support the Emotional Development of Teenaged Girls.
5 Citations2007Shaundra Daily, Rosalind W. Picard
A new digital technology to support emotional self-awareness and empathy in teenage girls, called G.I.R.L.S (Girls Involved in Real Life Sharing), was described, which enabled the subjects to express themselves freely in a comfortable and meaningful way, and fostered an increase in emotional expressivity.