Using appraisal groups for sentiment analysis
Published 31 October 2005
Casey Whitelaw, Navendu Garg, Shlomo Argamon
Citations562
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new method for sentiment classification based on extracting and analyzing appraisal groups such as ``very good'' or ``not terribly funny'' is presented, based on several task-independent semantic taxonomies based on Appraisal Theory.
Abstract
Little work to date in sentiment analysis (classifying texts by `positive' or `negative' orientation) has attempted to use fine-grained semantic distinctions in features used for classification. We present a new method for sentiment classification based on extracting and analyzing appraisal groups such as ``very good'' or ``not terribly funny''. An appraisal group is represented as a set of attribute values in several task-independent semantic taxonomies, based on Appraisal Theory. Semi-automated methods were used to build a lexicon of appraising adjectives and their modifiers. We classify movie reviews using features based upon these taxonomies combined with standard ``bag-of-words'' features, and report state-of-the-art accuracy of 90.2%. In addition, we find that some types of appraisal appear to be more significant for sentiment classification than others.
Keywords
Computer Science
Cambridge University Press eBooksAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
13,883 Citations2000Nello Cristianini, John Shawe‐Taylor
Language<b>Introduction to functional grammar</b> . By M. A. K. Halliday London & Baltimore: Edward Arnold, 1985. Pp. xxxv, 387.
9,924 Citations1989Christian M.I.M. Matthiessen
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
International Conference on Neural Information ProcessingAdvances in kernel methods: support vector learning
5,815 Citations1999Bernhard Schölkopf, Christopher J. C. Burges +1 more
Support vector machines for dynamic reconstruction of a chaotic system, Klaus-Robert Muller et al pairwise classification and support vector machines, Ulrich Kressel.
The MIT Press eBooksFast Training of Support Vector Machines Using Sequential Minimal Optimization
5,462 Citations1998John Platt
ePrints Soton (University of Southampton)An Introduction to Support Vector Machines
4,120 Citations2000Nello Cristianini, John Shawe‐Taylor
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
The Language of Evaluation: Appraisal in English
2,779 Citations2005James R. Martin, Peter Robert Rupert White
Mining the peanut gallery
1,908 Citations2003Kushal Dave, Steve Lawrence +1 more
This work develops a method for automatically distinguishing between positive and negative reviews and draws on information retrieval techniques for feature extraction and scoring, and the results for various metrics and heuristics vary depending on the testing situation.
Predicting the semantic orientation of adjectives
1,439 Citations1997Vasileios Hatzivassiloglou, Kathleen McKeown
A log-linear regression model uses constraints from conjunctions to predict whether conjoined adjectives are of same or different orientations, achieving 82% accuracy in this task when each conjunction is considered independently.
A simple rule-based part of speech tagger
1,418 Citations1992Eric Brill
This work presents a simple rule-based part of speech tagger which automatically acquires its rules and tags with accuracy comparable to stochastic taggers, demonstrating that the stochastics method is not the only viable method for part ofspeech tagging.
Sentiment analysis
1,158 Citations2003Tetsuya Nasukawa, Jeonghee Yi
This paper illustrates a sentiment analysis approach to extract sentiments associated with polarities of positive or negative for specific subjects from a document, instead of classifying the whole document intopositive or negative.
Sentiment Analysis using Support Vector Machines with Diverse Information Sources
693 Citations2004Tony Mullen, Nigel Collier
Experiments on movie review data from the Internet Movie Database demonstrate that hybrid SVMs which combine unigram-style feature-based SVMs with those based on real-valued favorability measures obtain superior performance, producing the best results yet published using this data.
Effects of adjective orientation and gradability on sentence subjectivity
671 Citations2000Vasileios Hatzivassiloglou, Janyce Wiebe
A novel trainable method that statistically combines two indicators of gradability is presented and evaluated, complementing existing automatic techniques for assigning orientation labels.
Just how mad are you? finding strong and weak opinion clauses
435 Citations2004Theresa Wilson, Janyce Wiebe +1 more
This paper presents the first experimental results classifying the strength of opinions and other types of subjectivity and classifies the subjectivity of deeply nested clauses using new syntactic features developed for opinion recognition.
Computational LinguisticsThe Rhetorical Parsing of Unrestricted Texts: A Surface-based Approach
221 Citations2000Daniel Marcu
This paper explores the extent to which well-formed rhetorical structures can be automatically derived by means of surface-form-based algorithms and shows that automatically derived rhetorical structure trees can be successfully exploited in the context of text summarization.
Analyzing Appraisal Automatically
180 Citations2004Maite Taboada, Jack Grieve
A standard method for calculating semantic orientation is applied, and a linguistic classification of Appraisal is applied that could be helpful in distinguishing different types of subjective texts (e.g., movie reviews from consumer product reviews).
Ensemble methods for automatic thesaurus extraction
71 Citations2002James Curran
This work explores ensemble efficacy for the more complex task of automatic thesaurus extraction on up to 300 million words, and examines the constraints on, and complexity of, different contextual representations which contribute to the sparseness-and noise-induced bias behaviour of NLP systems on very large corpora.
Recognizing subjective sentences: a computational investigation of narrative text
53 Citations1990Janyce Wiebe
It is shown that references are understood differently in conversation, subjective sentences, and non-subjective sentences; namely, they are understood with respect to different sets of beliefs.
Identifying interpersonal distance using systemic features
14 Citations2004Maria Herke-Couchman, Casey Whitelaw +1 more
The information retrieval seriesIdentifying Interpersonal Distance using Systemic Features
8 Citations2006Casey Whitelaw, Jon Patrick +1 more
This chapter uses Systemic Functional Linguistic (SFL) theory as a basis for extracting semantic features of documents and focuses on the pronominal and determination system and the role it plays in constructing interpersonal distance.