Evaluation of an algorithm for aspect-based opinion mining using a lexicon-based approach
Published 1 August 2013
Florian Wogenstein, J. Drescher, Dirk Reinel, Sven Rill, Jörg Scheidt
Citations28
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A phrase-based opinion lexicon for the German language is used to investigate, how good strong positive and strong negative expressions of opinions, concerning products and services in the insurance domain, can be detected.
Abstract
In this paper, we present a study of aspect-based opinion mining using a lexicon-based approach. We use a phrase-based opinion lexicon for the German language to investigate, how good strong positive and strong negative expressions of opinions, concerning products and services in the insurance domain, can be detected. We perform experiments on hand-tagged statements expressing opinions retrieved from the Ciao platform. The initial corpus contained about 14,000 sentences from 1,600 reviews. For both, positive and negative statements, more than 100 sentences were tagged. We show, that the algorithm can reach an accuracy of 62.2% for positive, but only 14.8% for negative utterances of opinions. We examine the cases, in which the opinion could not correctly be detected or in which the linking between the opinion statement and the aspect fails. Especially, the large gap in accuracy between positive and negative utterances is analysed.
Keywords
Computer Science
Mining and summarizing customer reviews
7,714 Citations2004Minqing Hu, Bing Liu
This research aims to mine and to summarize all the customer reviews of a product, and proposes several novel techniques to perform these tasks.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
Recognizing contextual polarity in phrase-level sentiment analysis
3,379 Citations2005Theresa Wilson, Janyce Wiebe +1 more
A new approach to phrase-level sentiment analysis is presented that first determines whether an expression is neutral or polar and then disambiguates the polarity of the polar expressions.
Accurate unlexicalized parsing
3,055 Citations2003Dan Klein, Christopher D. Manning
It is demonstrated that an unlexicalized PCFG can parse much more accurately than previously shown, by making use of simple, linguistically motivated state splits, which break down false independence assumptions latent in a vanilla treebank grammar.
Feature-rich part-of-speech tagging with a cyclic dependency network
2,851 Citations2003Kristina Toutanova, Dan Klein +2 more
A new part-of-speech tagger is presented that demonstrates the following ideas: explicit use of both preceding and following tag contexts via a dependency network representation, broad use of lexical features, and effective use of priors in conditional loglinear models.
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining.
2,652 Citations2010Stefano Baccianella, Andrea Esuli +1 more
This work discusses SENTIWORDNET 3.0, a lexical resource explicitly devised for supporting sentiment classification and opinion mining applications, and reports on the improvements concerning aspect (b) that it embodies with respect to version 1.0.
SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining
2,489 Citations2006Andrea Esuli, Fabrizio Sebastiani
SENTIWORDNET is a lexical resource in which each WORDNET synset is associated to three numerical scores Obj, Pos and Neg, describing how objective, positive, and negative the terms contained in the synset are.
Opinion observer
1,604 Citations2005Bing Liu, Minqing Hu +1 more
A novel framework for analyzing and comparing consumer opinions of competing products is proposed, and a new technique based on language pattern mining is proposed to extract product features from Pros and Cons in a particular type of reviews.
Sentiment Analysis and Subjectivity
1,594 Citations2010Liu Bing
An intraocular lens for implantation in an eye comprising an optic configured so that the optic can be deformed to permit the intraocular Lens to be passed through an incision into the eye is provided.
Opinion spam and analysis
1,520 Citations2008Nitin Jindal, Bing Liu
It is shown that opinion spam is quite different from Web spam and email spam, and thus requires different detection techniques, and therefore requires some novel techniques to detect them.
Communications of the ACMTechniques and applications for sentiment analysis
1,494 Citations2013Ronen Feldman
The main applications and challenges of one of the hottest research areas in computer science are revealed.
A holistic lexicon-based approach to opinion mining
1,388 Citations2008Xiaowen Ding, Bing Liu +1 more
This paper proposes a holistic lexicon-based approach to solving the problem of determining the semantic orientations (positive, negative or neutral) of opinions expressed on product features in reviews by exploiting external evidences and linguistic conventions of natural language expressions.
A Survey of Opinion Mining and Sentiment Analysis
1,331 Citations2012Bing Liu, Lei Zhang
Sentiment analysis or opinion mining is the computational study of people’s opinions, appraisals, attitudes, and emotions toward entities, individuals, issues, events, topics and their attributes.
MIS QuarterlyWhat makes a helpful online review? a study of customer reviews on amazon.com
1,290 Citations2010Susan M. Mudambi, David Schuff
IEEE Intelligent SystemsNew Avenues in Opinion Mining and Sentiment Analysis
1,222 Citations2013Erik Cambria, Björn W. Schuller +2 more
The history, current use, and future of opinion mining and sentiment analysis are discussed, along with relevant techniques and tools.
Handbook of Natural Language Processing
1,080 Citations2010Nitin Indurkhya, Fred J. Damerau
Fully updated with the latest developments in the field, this comprehensive, modern handbook emphasizes how to implement practical language processing tools in computational systems.
Target-dependent Twitter Sentiment Classification
846 Citations2011Long Jiang, Mo Yu +3 more
This paper proposes to improve target-dependent Twitter sentiment classification by incorporating target- dependent features; and taking related tweets into consideration; and according to the experimental results, this approach greatly improves the performance of target- dependence sentiment classification.
Information RetrievalA machine learning approach to sentiment analysis in multilingual Web texts
473 Citations2008Erik Boiy, Marie‐Francine Moens
This paper presents machine learning experiments with regard to sentiment analysis in blog, review and forum texts found on the World Wide Web and written in English, Dutch and French and investigates the role of active learning techniques for reducing the number of examples to be manually annotated.
Review spam detection
447 Citations2007Nitin Jindal, Bing Liu
This paper makes an attempt to study review spam and spam detection.
Extracting semantic orientations of words using spin model
407 Citations2005Hiroya Takamura, Takashi Inui +1 more
The mean field approximation is used to compute the approximate probability function of the system instead of the intractable actual probability function, and a criterion for parameter selection on the basis of magnetization is proposed.
Journal of Information ScienceAspect-based sentiment analysis of movie reviews on discussion boards
402 Citations2010Tun Thura Thet, Jin‐Cheon Na +1 more
The proposed method performs fine-grained analysis to determine both the sentiment orientation and sentiment strength of the reviewer towards various aspects of a movie.
Learning with compositional semantics as structural inference for subsentential sentiment analysis
333 Citations2008Yejin Choi, Claire Cardie
A novel learning-based approach that incorporates structural inference motivated by compositional semantics into the learning procedure is presented, and it is found that expression-level classification accuracy uniformly decreases as additional, potentially disambiguating, context is considered.
Conference of the European Chapter of the Association for Computational LinguisticsDetermining Term Subjectivity and Term Orientation for Opinion Mining
306 Citations2006Andrea Esuli, Fabrizio Sebastiani
The task of deciding whether a given term has a positive connotations, or a negative connotation, or has no subjective connotation at all is confronted, and it is shown that determining subjectivity and orientation is a much harder problem than determining orientation alone.
ScopusSenticNet 2: A Semantic and Affective Resource for Opinion Mining and Sentiment Analysis
210 Citations2012Erik Cambria, Catherine Havasi +1 more
By providing the semantics and sentics associated with over 14,000 concepts, SenticNet 2 represents one of the most comprehensive semantic resources for the development of affect-sensitive applications in fields such as social data mining, multimodal affective HCI, and social media marketing.
SentiWS - A Publicly Available German-language Resource for Sentiment Analysis
210 Citations2010Robert Remus, Uwe Quasthoff +1 more
The evaluation set is verified being reliable and its shown that SentiWS provides a beneficial lexical resource for German-language sentiment analysis related tasks to build on.
Cross-Linguistic Sentiment Analysis: From English to Spanish
189 Citations2009Julian Brooke, Milan Tofiloski +1 more
The results indicate that, although languageindependent methods provide a decent baseline performance, there is also a significant cost to automation, and thus the best path to long-term improvement is through the inclusion of language-specific knowledge and resources.
Review sentiment scoring via a parse-and-paraphrase paradigm
128 Citations2009Jun Liu, Stephanie Seneff
An approach to extracting adverb-adjective-noun phrases based on clause structure obtained by parsing sentences into a hierarchical representation is proposed and a robust general solution for modeling the contribution of adverbials and negation to the score for degree of sentiment is proposed.
Sentiment Learning on Product Reviews via Sentiment Ontology Tree
126 Citations2010Wei Wei, Jon Atle Gulla
This paper proposes a novel HL-SOT approach to labeling a product's attributes and their associated sentiments in product reviews by a Hierarchical Learning process with a defined Sentiment Ontology Tree (SOT).
Parsing three German treebanks
93 Citations2008Anna N. Rafferty, Christopher D. Manning
This paper examines the performance of three techniques on three treebanks (Negra, Tiger, and TuBa-D/Z): Markovization, lexicalization, and state splitting, and additionally explores parsing with the inclusion of grammatical function information.
GermanPolarityClues: A Lexical Resource for German Sentiment Analysis
70 Citations2010Ulli Waltinger
Evaluating four different English and three different German sentiment resources in a comparative manner by combining a polarity-based feature selection with SVM-based machine learning classifier shows that the size of dictionaries clearly correlate to polarity, but this property does not correlate to classification accuracy.
Oxford University Research Archive (ORA) (University of Oxford)Sentiment Composition
67 Citations2007Karo Moilanen, Stephen Pulman
Zurich Open Repository and Archive (University of Zurich)Evaluation and extension of a polarity lexicon for German
56 Citations2010Simon Clematide, Manfred Klenner
A semi-automatically approach where a list of reliable candidate words is generated to ease the manual annotation process of a polarity lexicon for German, comprising word polarities and polarity strength values of about 8,000 words.
Multi-entity Sentiment Scoring
45 Citations2009Karo Moilanen, Stephen Pulman
A compositional framework for modelling entity-level sentiment (sub)contexts is presented, and it is demonstrated how holistic multi-entity polarity scoring emerges as a by-product of compositional sentiment parsing.
A freely available morphological analyzer, disambiguator and context sensitive lemmatizer for German
40 Citations1998Wolfgang Lezius, Reinhard Rapp +1 more
Morphy is an integrated tool for German morphology, part-of-speech tagging and context-sensitive lemmatization that can determine the correct root even for ambiguous word forms.
Zurich Open Repository and Archive (University of Zurich)Robust compositional polarity classification
30 Citations2009Manfred Klenner, Stefanos Petrakis +1 more
A pattern-based system for polarity classification from texts that analyses the input texts with the aid of a polarity lexicon that specifies the prior polarity of words with the results of comparing its performance over this gold standard against a baseline system.
A generic approach to generate opinion lists of phrases for opinion mining applications
30 Citations2012Sven Rill, Jörg Scheidt +4 more
This paper presents an approach to generate lists of opinion bearing phrases with their opinion values in a continuous range between -- 1 and 1.
UEA Digital Repository (University of East Anglia)A phrase-based opinion list for the German language
9 Citations2012Sven Rill, Steve Adolph +7 more
A new phrase-based generated list of opinion bearing words and phrases for the German language which contains adjectives and nouns as well as adjectiveand noun-based phrases and their opinion values on a continuous range between 1 and +1.
Lecture notes in computer scienceVisual Sentiment Summarization of Movie Reviews
4 Citations2011Jin‐Cheon Na, Tun Thura Thet +2 more
A prototype digital library of social media content was developed to present a summarized view of public opinion in a visual interface that performs fine-grained analysis to determine both the sentiment orientation and sentiment strength of the reviewer towards various aspects of a movie.