Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network
Neural Computing and ApplicationsPublished 27 May 2011
Davood Gharavian, Mansour Sheikhan, Alireza Nazerieh, Sahar Garoucy
Citations94
SJR quartileQ1
SJR score1.10
SNIP1.61
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Experimental results show the improvement in emotion recognition rate of angry, happiness, and neutral states by using a subset of 25 selected features and the GA-optimized FAMNN-based emotion recognizer.
Abstract
Emotion recognition from speech has noticeable applications in the speech-processing systems. In this paper, the effect of using a rich set of features including formant frequency related, pitch frequency related, energy, and the two first mel-frequency cepstral coefficients (MFCCs) on improving the performance of speech emotion recognition systems is investigated. To do this, the different sets of features are employed, and by using the fast correlation-based filter (FCBF) feature selection method, some efficient feature subsets are determined. Finally, to recognize the emotion from speech, fuzzy ARTMAP neural network (FAMNN) architecture is used. Also, the genetic algorithm (GA) is employed to determine optimum values of the choice parameter (α), the vigilance parameters (ρ a, ρ b, and ρ ab), and the learning rate (β) of FAMNN. Experimental results show the improvement in emotion recognition rate of angry, happiness, and neutral states by using a subset of 25 selected features and the GA-optimized FAMNN-based emotion recognizer.
Keywords
PsychologyComputer Science
Choice Reviews OnlineData mining: concepts and techniques
28,877 Citations2012Jiawei Han, Micheline Kamber +1 more
Data mining is the search for new, valuable, and nontrivial information in large volumes of data, a cooperative effort of humans and computers that is possible to put data-mining activities into one of two categories: Predictive data mining, which produces the model of the system described by the given data set, or Descriptive data mining which produces new, nontrivials information based on the available data set.
IEEE Transactions on Neural NetworksFuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps
1,977 Citations1992Gail A. Carpenter, Stephen Grossberg +3 more
The fuzzy ARTMAP system is compared with Salzberg's NGE systems and with Simpson's FMMC system, and its performance in relation to benchmark backpropagation and generic algorithm systems.
Pattern RecognitionSurvey on speech emotion recognition: Features, classification schemes, and databases
1,970 Citations2010Moataz El Ayadi, Mohamed S. Kamel +1 more
A survey of speech emotion classification addressing three important aspects of the design of a speech emotion recognition system, the choice of suitable features for speech representation, and the proper preparation of an emotional speech database for evaluating system performance are addressed.
IEEE Transactions on Speech and Audio ProcessingToward detecting emotions in spoken dialogs
964 Citations2005Chul Min Lee, Shrikanth Narayanan
This paper explores the detection of domain-specific emotions using language and discourse information in conjunction with acoustic correlates of emotion in speech signals on a case study of detecting negative and non-negative emotions using spoken language data obtained from a call center application.
The INTERSPEECH 2009 emotion challenge
911 Citations2009Björn W. Schuller, Stefan Steidl +1 more
The challenge, the corpus, the features, and benchmark results of two popular approaches towards emotion recognition from speech, and the FAU Aibo Emotion Corpus are introduced.
Speech CommunicationSpeech emotion recognition using hidden Markov models
907 Citations2003Tin Lay Nwe, Say Wei Foo +1 more
This paper proposes a text independent method of emotion classification of speech that makes use of short time log frequency power coefficients (LFPC) to represent the speech signals and a discrete hidden Markov model (HMM) as the classifier.
Speech CommunicationEmotional speech recognition: Resources, features, and methods
891 Citations2006Dimitrios Ververidis, Constantine Kotropoulos
This paper overviews emotional speech recognition having in mind three goals to provide an up-to-date record of the available emotional speech data collections, and examines separately classification techniques that exploit timing information from which that ignore it.
Fast Binary Feature Selection with Conditional Mutual Information
833 Citations2004François Fleuret
It is shown that this feature selection method outperforms other classical algorithms, and that a naive Bayesian classifier built with features selected that way achieves error rates similar to those of state-of-the-art methods such as boosting or SVMs.
Speech CommunicationRecognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge
729 Citations2011Björn W. Schuller, Anton Batliner +2 more
The basic phenomenon reflecting the last fifteen years is addressed, commenting on databases, modelling and annotation, the unit of analysis and prototypicality and automatic processing including discussions on features, classification, robustness, evaluation, and implementation and system integration.
Hidden Markov model-based speech emotion recognition
581 Citations2003Björn W. Schuller, Gerhard Rigoll +1 more
The paper addresses the design of working recognition engines and results achieved with respect to the alluded alternatives and describes a speech corpus consisting of acted and spontaneous emotion samples in German and English language.
Interacting with ComputersThis computer responds to user frustration:
558 Citations2002Jonathan Klein, Y. Moon +1 more
Results support the prediction that the computer can undo some of the negative feelings it causes by helping a user manage his or her emotional state.
Recognizing emotion in speech
498 Citations2002Frank Dellaert, Thomas Polzin +1 more
A new method of extracting prosodic features from speech, based on a smoothing spline approximation of the pitch contour, is presented, which obtains classification performance that is close to human performance on the task.
International Journal of Human-Computer StudiesThe production and recognition of emotions in speech: features and algorithms
438 Citations2003Oudeyer Pierre-Yves
A technique which allows to continuously control both the age of a synthetic voice and the quantity of emotions that are expressed and the first large-scale data mining experiment about the automatic recognition of basic emotions in informal everyday short utterances is presented.
Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture
425 Citations2004Björn W. Schuller, Gerhard Rigoll +1 more
A novel approach to the combination of acoustic features and language information for a most robust automatic recognition of a speaker's emotion by applying belief network based spotting for emotional key-phrases is introduced.
Prosody-based automatic detection of annoyance and frustration in human-computer dialog
388 Citations2002Jeremy Ang, Rajdip Dhillon +3 more
Speech CommunicationAutomatic speech emotion recognition using modulation spectral features
381 Citations2010Siqing Wu, Tiago H. Falk +1 more
Modulation spectral features are proposed for the automatic recognition of human affective information from speech and render a substantial improvement in recognition performance when used to augment prosodic features, which have been extensively used for emotion recognition.
Speech CommunicationEnsemble methods for spoken emotion recognition in call-centres
319 Citations2006Donn Morrison, Ruili Wang +1 more
Speech CommunicationHow to find trouble in communication
281 Citations2003Anton Batliner, Kerstin Fischer +3 more
The module Monitoring of User State [especially of] Emotion (MOUSE) is proposed in which a prosodic classifier is combined with other knowledge sources, such as conversationally peculiar linguistic behavior, for example, the use of repetitions.
Emotion recognition in spontaneous speech using GMMs
247 Citations2006Daniel Neiberg, Kjell Elenius +1 more
The results indicate that using Gaussian mixture models on the frame level is a feasible technique for emotion classification, and combining the three classifiers significantly improves performance.
Speech CommunicationClass-level spectral features for emotion recognition
218 Citations2010Dmitri Bitouk, Ragini Verma +1 more
This work introduces a more fine-grained yet robust set of spectral features: statistics of Mel-Frequency Cepstral Coefficients computed over three phoneme type classes of interest-stressed vowels, unstressed vowel and consonants in the utterance.
Information Processing & ManagementAcoustic feature selection for automatic emotion recognition from speech
209 Citations2008Jia Rong, Gang Li +1 more
A novel algorithm is presented in this paper, which can be applied on a small sized data set with a high number of features and outperform the commonly used Principle Component Analysis (PCA)/Multi-Dimensional Scaling (MDS) methods, and the more recently developed ISOMap dimensionality reduction method.
Recognition of emotions in interactive voice response systems
180 Citations2003Sherif Yacoub, Steve Simske +2 more
This paper reports emotion recognition results from speech signals, with particular focus on extracting emotion features from the short utterances typical of Interactive Voice Response (IVR) applications, and indicates that hot anger and neutral utterances can be distinguished with over 90% accuracy.
Real-life emotions detection with lexical and paralinguistic cues on human-human call center dialogs
162 Citations2006Laurence Devillers, Laurence Vidrascu
The emotion detection work reported here is part of a larger study aiming to model user behavior in real interactions, and makes use of another corpus of real agent-caller spoken dialogs from a medical emergency call center in which emotion manifestations are much more complex, and extreme emotions are common.
Signal ProcessingEmotion recognition from speech signals using new harmony features
158 Citations2009Bin Yang, Marko Lugger
A new set of harmony features for automatic emotion recognition from speech signals based on the psychoacoustic harmony perception known from music theory are proposed, which show an improved recognition performance.
Computer Speech & LanguageSpoken emotion recognition using hierarchical classifiers
138 Citations2010Enrique M. Albornoz, Diego H. Milone +1 more
The spectral characteristics of emotional signals are used in order to group emotions based on acoustic rather than psychological considerations, and the proposed multiple feature hierarchical method for seven emotions improves the performance over the standard classifiers and the fixed features.
Speech CommunicationAn evaluation of the robustness of existing supervised machine learning approaches to the classification of emotions in speech
131 Citations2007Mohammad Shami, Werner Verhelst
The robustness of approaches to the automatic classification of emotions in speech is addressed and it is suggested that existing approaches are efficient enough to handle larger amounts of training data without any reduction in classification accuracy.
Audio-visual based emotion recognition-a new approach
126 Citations2004Mingli Song, Jiajun Bu +2 more
A novel approach is presented in this paper, including both visual and audio from video clips, to recognize the human emotion, and shows that this approach outperforms only using visual or audio separately.
Speech CommunicationRecognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors
120 Citations2005Diane Litman, Kate Forbes-Riley
An empirical study investigating the feasibility of recognizing student state in two corpora of spoken tutoring dialogues, one with a human tutor, and one with an computer tutor, shows significant improvements in prediction accuracy over relevant baselines.
Audio-visual feature selection and reduction for emotion classification
109 Citations2008Sanaul Haq, Philip J. B. Jackson +1 more
Recognition of expressed emotion from speech and facial gestures was investigated in experiments on an audio-visual emotional database and visual features performed better than audio features, for both PCA and LDA.
Speech CommunicationEmotions, speech and the ASR framework
100 Citations2003Louis ten Bosch
The conclusion is that automatic emotional tagging of the speech signal is difficult to perform with high accuracy, but prosodic information is nevertheless potentially useful to improve the dialogue handling in ASR tasks on a limited domain.
Using system and user performance features to improve emotion detection in spoken tutoring dialogs
92 Citations2006Hua Ai, Diane Litman +4 more
This study incorporates automatically obtained system/user performance features into machine learning experiments to detect student emotion in computer tutoring dialogs and shows a relative improvement on classification accuracy and Kappa over using standard lexical, prosodic, sequential, and identification features.
Bimodal Fusion of Emotional Data in an Automotive Environment
85 Citations2006S. Hoch, Frank Althoff +2 more
A flexible bimodal approach to person dependent emotion recognition in an automotive environment by adapting an acoustic and a visual monomodal recognizer and combining the individual results on an abstract decision level is presented.
Emotion recognition in speech using neural networks
71 Citations2003Joy Nicholson, Kazutoshi Takahashi +1 more
Expert Systems with ApplicationsBoosting selection of speech related features to improve performance of multi-class SVMs in emotion detection
64 Citations2008Halis Altun, Gökhan Polat
Evaluation of the final feature sets validates that the frameworks are able to select more informative subset of the features in terms of class-separability, and finds that among four feature selection algorithms, a recently proposed one, LSBOUND, significantly outperforms the others.
Emotion recognition using a hierarchical binary decision tree approach
63 Citations2009Chi-Chun Lee, Emily Mower +3 more
Emotion recognition using acoustic features and textual content
62 Citations2005Ze-Jing Chuang, Chung‐Hsien Wu
The experimental result shows that the emotion recognition accuracy of the integrated system is better than each of the two individual approaches.
Zenodo (CERN European Organization for Nuclear Research)Fast Sequential Floating Forward Selection Applied To Emotional Speech Features Estimated On Des And Susas Data Collections
62 Citations2006Constantine Kotropoulos, Dimitrios Ververidis
This paper classifies speech into several emotional states based on the statistical properties of prosody features estimated on utterances extracted from Danish Emotional Speech and a subset of Speech Under Simulated and Actual Stress data collections, demonstrating that gender and accent information reduce the classification error.
Robust pitch tracking for prosodic modeling in telephone speech
60 Citations2002Chao Wang, Stephanie Seneff
This paper introduces a pitch detection algorithm that is particularly robust for telephone speech and prosodic modeling that significantly outperforms XWAVES when used for tone classification on a telephone quality Mandarin digit corpus.
Speech CommunicationApplication of speaker- and language identification state-of-the-art techniques for emotion recognition
53 Citations2011Marcel Kockmann, Lukáš Burget +1 more
This paper describes the efforts of transferring feature extraction and statistical modeling techniques from the fields of speaker and language identification to the related field of emotion recognition and shows how to apply Gaussian Mixture Modeling techniques on top of it.
Emotion recognition and acoustic analysis from speech signal
51 Citations2004Chang-Hyun Park, Kwee-Bo Sim
Simulation results which classify emotions by learning 4 pitch patterns and results from some analyses of the relation between emotion and acoustic elements, which are called acoustic elements for convenience.
Computers in Human BehaviorSegment-based emotion recognition from continuous Mandarin Chinese speech
48 Citations2010Jun-Heng Yeh, Tsang-Long Pao +3 more
A segment-based emotion recognition approach to continuous Mandarin Chinese speech with an emotion radar chart based on WD-KNN that shows how emotions can be recognized by speech signals, and in turn how emotional states can be visualized.
Recognition of emotion in a realistic dialogue scenario
47 Citations2000Richard Huber, Anton Batliner +4 more
Data is used from a so-called Wizard of Oz scenario to get more realistic data instead of simulated anger, and the classi cation rate for the two classes "emotion" and "neutral" is signi cantly worse for these more realism data.
Neural Computing and ApplicationsUsing DTW neural–based MFCC warping to improve emotional speech recognition
45 Citations2011Mansour Sheikhan, Davood Gharavian +1 more
The frequency range that is most affected by emotion is determined, and the frequency warping is applied in the calculation process of MFCCs, and results show that the recognition rate in anger and happiness emotional states is improved.
Feature analysis for emotion recognition from Mandarin speech considering the special characteristics of Chinese language
40 Citations2006Yi-Hao Kao, Lin-shan Lee
A detailed analysis of the feature parameters for emotion recognition considering the characteristics of the Chinese language, primarily the monosyllable structure and the tone behavior finds that the pitch and power related features are the most important, and the fourth tone in Mandarin serves as the strongest indicator to emotions.
Emotion classification in children's speech using fusion of acoustic and linguistic features
39 Citations2009Tim Polzehl, Shiva Sundaram +3 more
A system to detect angry vs. non-angry utterances of children who are engaged in dialog with an Aibo robot dog, submitted to the Interspeech2009 Emotion Challenge evaluation.
International Conference on Computational LinguisticsEmotion Recognition and Evaluation of Mandarin Speech Using Weighted D-KNN Classification
39 Citations2005Tsang-Long Pao, Yu-Te Chen +2 more
A weighted discrete K-nearest neighbor (weighted D-KNN) classification algorithm for detecting and evaluating emotion from Mandarin speech is proposed and an emotion radar chart is designed which can present the intensity of each emotion in the emotion evaluation system.
Audio-visual based emotion recognition using tripled hidden Markov model
28 Citations2004Mingli Song, Chun Chen +1 more
A novel approach is presented in this paper to recognize the human emotion which uses both visual and audio from video clips and a tripled hidden Markov model is introduced to perform the recognition.
Speech CommunicationEnhancement of emotion detection in spoken dialogue systems by combining several information sources
23 Citations2011Ramón López-Cózar, Jan Silovský +1 more
The results show that the technique enhances the classification rates of the standard fusion by 2.27% and 3.38% absolute in experiments carried out considering two and three emotion categories, respectively.
Speech emotion recognition with TGI+.2 classifier
22 Citations2009Julia Sidorova
A classification approach coming from optical character recognition research to the task of speech emotion recognition and outperforms the state of the art classifier by 4.68% and a baseline by 26.58%, which proves validity of the approach.
Acoustic emotion recognition using dynamic Bayesian networks and multi-space distributions
18 Citations2009Roberto Barra-Chicote, Fernando Fernández-Martínez +6 more
The proposal is based on the use of a Dynamic Bayesian Network (DBN) to deal with the temporal modelling of the emotional speech information and achieves similar results compared with the baseline, with a considerable less number of features.
Speech CommunicationClassification of emotion in spoken Finnish using vowel-length segments: Increasing reliability with a fusion technique
16 Citations2010Eero Väyrynen, Juhani Toivanen +1 more
Lecture notes in computer scienceNew Frameworks to Boost Feature Selection Algorithms in Emotion Detection for Improved Human-Computer Interaction
16 Citations2007Halis Altun, Gökhan Polat
Two new frameworks for multi-class emotion detection problem are proposed in this paper, so as to boost the feature selection algorithms in a way that the selected features will be more informative in terms of class-separability.
Emotion recognition of speech based on RNN
16 Citations2003Chang-Hyun Park, Dong-Wook Lee +1 more
This work defines features of four emotions in pitch analysis and implements a simulator from the above modules, which can be applied to other speech data (excepting for learning data).
Computer Speech & LanguageFiction support for realistic portrayals of fear-type emotional manifestations
9 Citations2010Chloé Clavel, Ioana Vasilescu +1 more
It is proposed here to use fictional media to compensate for the difficulty of collecting strong emotions, and a fear-type emotion recognition system has been developed, that is based on acoustic models learnt from the fiction corpus.
IEICE Electronics ExpressStressed speech recognition using a warped frequency scale
4 Citations2008Davood Gharavian, Seyed Mohammad Ahadi
Using the orderly changes found in the second formant, due to stress, a warping function is introduced that can be applied to the mel frequency scale during the calculation of MFCC parameters and leads to improvements in the stressed speech recognition results.