An empirical study of sentence features for subjectivity and polarity classification
Information SciencesPublished 16 May 2014
José M. Chenlo, David E. Losada
Citations85
SJR quartileQ1
SJR score1.80
SNIP1.98
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper extends and combines the body of empirical evidence regarding sentence subjectivity classification and sentence polarity classification, and provides a comprehensive analysis of the relative importance of each set of features using data from multiple benchmarks.
Abstract
While a number of isolated studies have analysed how different sentence features are beneficial in Sentiment Analysis, a complete picture of their effectiveness is still lacking. In this paper we extend and combine the body of empirical evidence regarding sentence subjectivity classification and sentence polarity classification, and provide a comprehensive analysis of the relative importance of each set of features using data from multiple benchmarks. To the best of our knowledge, this is the first study that evaluates a highly diversified set of sentence features for the two main sentiment classification tasks.
Keywords
Computer Science
Springer series in statisticsThe Elements of Statistical Learning
24,344 Citations2001Trevor Hastie, J. Friedman +1 more
Mining and summarizing customer reviews
7,714 Citations2004Minqing Hu, Bing Liu
This research aims to mine and to summarize all the customer reviews of a product, and proposes several novel techniques to perform these tasks.
Building a Large Annotated Corpus of English: The Penn Treebank
7,528 Citations1993Mitchell P. Marcus
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
LIBLINEAR: A Library for Large Linear Classification
6,625 Citations2008Rong-En Fan, Kai‐Wei Chang +3 more
Foundations and Trends® in Information RetrievalOpinion Mining and Sentiment Analysis
6,204 Citations2008Bo Pang, Lillian Lee
This survey covers techniques and approaches that promise to directly enable opinion-oriented information-seeking systems and focuses on methods that seek to address the new challenges raised by sentiment-aware applications, as compared to those that are already present in more traditional fact-based analysis.
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
Recognizing contextual polarity in phrase-level sentiment analysis
3,379 Citations2005Theresa Wilson, Janyce Wiebe +1 more
A new approach to phrase-level sentiment analysis is presented that first determines whether an expression is neutral or polar and then disambiguates the polarity of the polar expressions.
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
Encyclopedia of Machine Learning and Data MiningSentiment Analysis and Opinion Mining
3,319 Citations2017Lei Zhang, Bing Liu
Computational LinguisticsLexicon-Based Methods for Sentiment Analysis
3,255 Citations2011Maite Taboada, Julian Brooke +3 more
The Semantic Orientation CALculator (SO-CAL) uses dictionaries of words annotated with their semantic orientation (polarity and strength), and incorporates intensification and negation, and is applied to the polarity classification task.
Synthesis lectures on human language technologiesSentiment Analysis and Opinion Mining
3,241 Citations2012Bing Liu
This book is a comprehensive introductory and survey text that covers all important topics and the latest developments in the field with over 400 references and is suitable for students, researchers and practitioners who are interested in social media analysis in general and sentiment analysis in particular.
A re-examination of text categorization methods
2,660 Citations1999Yiming Yang, Xin Liu
The results show that SVM, kNN and LLSF signi cantly outperform NNet and NB when the number of positive training instances per category are small, and that all the methods perform comparably when the categories are over 300 instances.
Communications of the ACMTechniques and applications for sentiment analysis
1,494 Citations2013Ronen Feldman
The main applications and challenges of one of the hottest research areas in computer science are revealed.
Determining the sentiment of opinions
1,485 Citations2004Soo-Min Kim, Eduard Hovy
A system that, given a topic, automatically finds the people who hold opinions about that topic and the sentiment of each opinion and another module for determining word sentiment and another for combining sentiments within a sentence is presented.
Learning to Classify Text Using Support Vector Machines
1,366 Citations2002Thorsten Joachims
This book gives a concise introduction to SVMs for pattern recognition, and it includes a detailed description of how to formulate text-classification tasks for machine learning.
Sentiment Analysis of Twitter Data
1,362 Citations2011Apoorv Agarwal, Boyi Xie +3 more
IEEE Intelligent SystemsNew Avenues in Opinion Mining and Sentiment Analysis
1,222 Citations2013Erik Cambria, Björn W. Schuller +2 more
The history, current use, and future of opinion mining and sentiment analysis are discussed, along with relevant techniques and tools.
Towards answering opinion questions
1,051 Citations2003Hong Yu, Vasileios Hatzivassiloglou
A Bayesian classifier for discriminating between documents with a preponderance of opinions such as editorials from regular news stories is presented, and three unsupervised, statistical techniques for the significantly harder task of detecting opinions at the sentence level are described.
Learning extraction patterns for subjective expressions
1,001 Citations2003Ellen Riloff, Janyce Wiebe
A bootstrapping process that learns linguistically rich extraction patterns for subjective (opinionated) expressions while maintaining high precision is presented.
Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
934 Citations2002Thorsten Joachims
Effects of adjective orientation and gradability on sentence subjectivity
671 Citations2000Vasileios Hatzivassiloglou, Janyce Wiebe
A novel trainable method that statistically combines two indicators of gradability is presented and evaluated, complementing existing automatic techniques for assigning orientation labels.
Information SciencesEnsemble of feature sets and classification algorithms for sentiment classification
586 Citations2010Rui Xia, Chengqing Zong +1 more
This paper makes a comparative study of the effectiveness of ensemble technique for sentiment classification, with the aim of efficiently integrating different feature sets and classification algorithms to synthesize a more accurate classification procedure.
Lecture notes in computer scienceCreating Subjective and Objective Sentence Classifiers from Unannotated Texts
543 Citations2005Janyce Wiebe, Ellen Riloff
The results of developing subjectivity classifiers using only unannotated texts for training rivals that of previous supervised learning approaches and advances the state of the art in objective sentence classification.
Learning subjective nouns using extraction pattern bootstrapping
499 Citations2003Ellen Riloff, Janyce Wiebe +1 more
The goal of the research is to develop a system that can distinguish subjective sentences from objective sentences, and a Naive Bayes classifier is trained using the subjective nouns, discourse features, and subjectivity clues identified in prior research.
Sentence level discourse parsing using syntactic and lexical information
411 Citations2003Radu Soricut, Daniel Marcu
Two probabilistic models that can be used to identify elementary discourse units and build sentence-level discourse parse trees are introduced and shown to be sophisticated enough to yield discourse trees at an accuracy level that matches near-human levels of performance.
A Study of Information Retrieval Weighting Schemes for Sentiment Analysis
351 Citations2010George Paltoglou, Mike Thelwall
It is shown that variants of the classic tf.idf scheme adapted to sentiment analysis provide significant increases in accuracy, especially when using a sublinear function for term frequency weights and document frequency smoothing.
Maryland Shared Open Access Repository (USMAI Consortium)Delta TFIDF: An Improved Feature Space for Sentiment Analysis
266 Citations2009Justin Martineau, Tim Finin
ScopusSenticNet 2: A Semantic and Affective Resource for Opinion Mining and Sentiment Analysis
210 Citations2012Erik Cambria, Catherine Havasi +1 more
By providing the semantics and sentics associated with over 14,000 concepts, SenticNet 2 represents one of the most comprehensive semantic resources for the development of affect-sensitive applications in fields such as social data mining, multimodal affective HCI, and social media marketing.
Cognitive science and technologySentiment Analysis on Twitter Data
175 Citations2022Ankit Kumar, M. Suhas +1 more
IEEE Intelligent SystemsKnowledge-Based Approaches to Concept-Level Sentiment Analysis
132 Citations2013Erik Cambria, Björn W. Schuller +3 more
The guest editors introduce novel approaches to opinion mining and sentiment analysis that go beyond a mere word-level analysis of text and provide concept-level methods that allow a more efficient passage from (unstructured) textual information to machine-processable data, in potentially any domain.
Review sentiment scoring via a parse-and-paraphrase paradigm
128 Citations2009Jun Liu, Stephanie Seneff
An approach to extracting adverb-adjective-noun phrases based on clause structure obtained by parsing sentences into a hierarchical representation is proposed and a robust general solution for modeling the contribution of adverbials and negation to the score for degree of sentiment is proposed.
Polarity analysis of texts using discourse structure
123 Citations2011Bas Heerschop, Frank Goossen +4 more
Pathos, a framework which performs document sentiment analysis (partly) based on a document's discourse structure, is proposed, which hypothesizes that by splitting a text into important and less important text spans, and by subsequently making use of this information by weighting the sentiment conveyed by distinct text spans in accordance with their importance, it can improve the performance of a sentiment classifier.
Overview of Multilingual Opinion Analysis Task at NTCIR-7.
122 Citations2008Yohei Seki, David K. Evans +4 more
The task definition, the details of the test collection, the evaluation results of the groups that participated in this task, and their approach are presented.
Lecture notes in computer scienceDiscovering Fine-Grained Sentiment with Latent Variable Structured Prediction Models
122 Citations2011Oscar Täckström, Ryan McDonald
This paper shows how sentencelevel sentiment labels can be effectively learned from document-level supervision using hidden conditional random fields (HCRFs) and reduces sentence classification errors by 22% relative to using a lexicon and 13%relative to machine-learning baselines.
IEEE Intelligent SystemsBuilding a Concept-Level Sentiment Dictionary Based on Commonsense Knowledge
109 Citations2013Angela Charng-Rurng Tsai, Chien Wu +2 more
A two-step method integrates iterative regression and random walk with in-link normalization to build a concept-level sentiment dictionary based on the assumption that semantically related concepts share a common sentiment.
SELC
109 Citations2009Likun Qiu, Weishi Zhang +2 more
The standard deviation of F1-scores is reduced, which shows that the SELC Model could be more suitable for domain-independent sentiment classification.
Lecture notes in computer scienceAn Introduction to Concept-Level Sentiment Analysis
97 Citations2013Erik Cambria
IEEE Intelligent SystemsRetrieving Product Features and Opinions from Customer Reviews
69 Citations2013Lisette García-Moya, Henry Anaya-Sánchez +1 more
A new methodology based on language models retrieves product features and opinions from a collection of free-text customer reviews about a product or service through a language-modeling framework that can be applied to reviews in any domain and language.
Lecture notes in computer scienceInvestigating Learning Approaches for Blog Post Opinion Retrieval
29 Citations2009Shima Gerani, Mark Carman +1 more
This paper studies the effectiveness of classification and rank learning techniques for solving the blog post opinion retrieval problem, and compares different learning and not learning based methods for combining relevance and opinion information in order to generate a ranked list of opinionated posts, thereby investigating the effect of learning on the ranking phase.
Pattern RecognitionParsimonious Mahalanobis kernel for the classification of high dimensional data
26 Citations2012Mathieu Fauvel, J. Chanussot +2 more
Experimental results show that the proposed kernel based on the Mahalanobis distance is suitable for classifying high dimensional data, providing better classification accuracies than the conventional Gaussian kernel.
Lecture notes in computer scienceSentiment-Based Ranking of Blog Posts Using Rhetorical Structure Theory
17 Citations2013José M. Chenlo, Alexander Hogenboom +1 more
The results show that RST provides valuable information about the discourse structure of the texts that can be used to make a more accurate ranking of documents in terms of their estimated sentiment in multi-topic blogs.
Effective and efficient polarity estimation in blogs based on sentence-level evidence
12 Citations2011José M. Chenlo, David E. Losada
It is shown that one can successfully determine the polarity of documents guided by a sentence-level analysis that takes into account topicality and the location in the blog post of the subjective sentences.
Information SciencesEndorsements and rebuttals in blog distillation
7 Citations2013Giacomo Berardi, Andrea Esuli +2 more
A new approach to blog distillation, defined as the task in which, given a user query, the system ranks the blogs in descending order of relevance to the query topic, checks whether a given hyperlink is a citation with a positive or a negative nature, i.e., if it expresses approval or disapproval of the hyperlinked page by the hyperlinking page.
Lecture notes in computer scienceA Machine Learning Approach for Subjectivity Classification Based on Positional and Discourse Features
6 Citations2013José M. Chenlo, David E. Losada
The role of structural features to guide sentence-level subjectivity classification is studied, and classical n-grams features are combined with novel features defined from positional information and from the discourse structure of the sentences.
Lecture notes in computer scienceMultidisciplinary Information Retrieval
2 Citations2014Paul Buitelaar, David Lamas
A mashed system composed of several services for refinement of searching diabetes related patents is built on top of these methods that will aid individuals; medical personal or pharmaceutical companies refine the complex task of searching diabetes related patents.