Theme detection an exploration of opinion subjectivity
Published 1 September 2009
Amitava Das, Sivaji Bandyopadhyay
Citations17
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A Theme Detection technique has been evolved for more generic domain independent subjectivity detection that classifies sentences with binary feature: opinionated or non-opinionated and finally accumulates the opinion clues to reach the discourse level subjectivity.
Abstract
Work in opinion mining and classification often assumes the incoming documents to be opinionated. Opinion mining system makes false hits while attempting to compute polarity values for non-subjective or factual sentences or documents. It becomes imperative to decide whether a given document contains subjective information or not as well as to identify which portions of the document are subjective or factual. In this work a theme detection technique has been evolved for more generic domain independent subjectivity detection that classifies sentences with binary feature: opinionated or non-opinionated. Theme detection technique examines sentence level opinion and finally accumulates the opinion clues to reach the discourse level subjectivity. The subjectivity detection system has been evaluated on the multi perspective question answering (MPQA) corpus as well as on Bengali corpus. The system evaluation has shown the precision and recall values of 76.08 and 83.33 for English and 72.16 and 76.00 for Bengali respectively.
Keywords
Computer Science
ScholarlyCommons (University of Pennsylvania)Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
12,978 Citations2001John Lafferty, Andrew McCallum +1 more
This work presents iterative parameter estimation algorithms for conditional random fields and compares the performance of the resulting models to HMMs and MEMMs on synthetic and natural-language data.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining
2,489 Citations2006Andrea Esuli, Fabrizio Sebastiani
SENTIWORDNET is a lexical resource in which each WORDNET synset is associated to three numerical scores Obj, Pos and Neg, describing how objective, positive, and negative the terms contained in the synset are.
Computers and the HumanitiesAnnotating Expressions of Opinions and Emotions in Language
1,770 Citations2005Janyce Wiebe, Theresa Wilson +1 more
The manual annotation process and the results of an inter-annotator agreement study on a 10,000-sentence corpus of articles drawn from the world press are presented.
ACM Computing SurveysTechniques for automatically correcting words in text
1,256 Citations1992Karen Kukich
Research aimed at correcting words in text has focused on three progressively more difficult problems: nonword error detection; (2) isolated-word error correction; and (3) context-dependent work correction, which surveys documented findings on spelling error patterns.
Sentiment analysis
1,158 Citations2003Tetsuya Nasukawa, Jeonghee Yi
This paper illustrates a sentiment analysis approach to extract sentiments associated with polarities of positive or negative for specific subjects from a document, instead of classifying the whole document intopositive or negative.
Towards answering opinion questions
1,051 Citations2003Hong Yu, Vasileios Hatzivassiloglou
A Bayesian classifier for discriminating between documents with a preponderance of opinions such as editorials from regular news stories is presented, and three unsupervised, statistical techniques for the significantly harder task of detecting opinions at the sentence level are described.
Learning extraction patterns for subjective expressions
1,001 Citations2003Ellen Riloff, Janyce Wiebe
A bootstrapping process that learns linguistically rich extraction patterns for subjective (opinionated) expressions while maintaining high precision is presented.
Fast Exact Inference with a Factored Model for Natural Language Parsing
746 Citations2002Dan Klein, Christopher D. Manning
A novel generative model for natural language tree structures in which semantic and syntactic structures are scored with separate models that admits an extremely effective A* parsing algorithm, which enables efficient, exact inference.
Computational LinguisticsLearning Subjective Language
743 Citations2004Janyce Wiebe, Theresa Wilson +3 more
This article shows that the density of subjectivity clues in the surrounding context strongly affects how likely it is that a word is subjective, and it provides the results of an annotation study assessing the subjectivity of sentences with high-density features.
Sentiment Analysis using Support Vector Machines with Diverse Information Sources
693 Citations2004Tony Mullen, Nigel Collier
Experiments on movie review data from the Internet Movie Database demonstrate that hybrid SVMs which combine unigram-style feature-based SVMs with those based on real-valued favorability measures obtain superior performance, producing the best results yet published using this data.
Effects of adjective orientation and gradability on sentence subjectivity
671 Citations2000Vasileios Hatzivassiloglou, Janyce Wiebe
A novel trainable method that statistically combines two indicators of gradability is presented and evaluated, complementing existing automatic techniques for assigning orientation labels.
Lecture notes in computer scienceCreating Subjective and Objective Sentence Classifiers from Unannotated Texts
543 Citations2005Janyce Wiebe, Ellen Riloff
The results of developing subjectivity classifiers using only unannotated texts for training rivals that of previous supervised learning approaches and advances the state of the art in objective sentence classification.
Opinion Extraction, Summarization and Tracking in News and Blog Corpora.
477 Citations2006Lun‐Wei Ku, Yuting Liang +1 more
Both news and web blog articles are investigated and algorithms for opinion extraction at word, sentence and document level are proposed, and the issue of relevant sentence selection is discussed, and then topical and opinionated information are summarized.
Sentiment classification on customer feedback data
437 Citations2004Michael Gamon
It is demonstrated that it is possible to perform automatic sentiment classification in the very noisy domain of customer feedback data by using large feature vectors in combination with feature reduction and the addition of deep linguistic analysis features to a set of surface level word n-gram features contributes consistently to classification accuracy.
Identifying sources of opinions with conditional random fields and extraction patterns
366 Citations2005Yejin Choi, Claire Cardie +2 more
This work adopts a hybrid approach that combines Conditional Random Fields (Lafferty et al., 2001) and a variation of AutoSlog (Riloff, 1996a), and shows that the combination of these two methods performs better than either one alone.
Using Verbs and Adjectives to Automatically Classify Blog Sentiment.
208 Citations2006Paula Chesley, Bruce Vincent +2 more
International Joint Conference on Natural Language ProcessingAutomatic Detection of Opinion Bearing Words and Sentences
155 Citations2005Soo-Min Kim, Eduard Hovy
This work describes a sentence-level opinion detection system and introduces an effective method for obtaining opinion-bearing and nonopinion-bearing words that can be used effectively to identify opinion- bearing sentences.
Exploiting subjectivity classification to improve information extraction
152 Citations2005Ellen Riloff, Janyce Wiebe +1 more
An IE system that uses a subjective sentence classifier to filter its extractions is described and it is found that indiscriminately filtering extractions from subjective sentences was overly aggressive, but more selective filtering strategies improved IE precision with minimal recall loss.
PageRanking WordNet Synsets: An Application to Opinion Mining
148 Citations2007Andrea Esuli, Fabrizio Sebastiani
This paper presents an application of PageRank, a random-walk model originally devised for ranking Web search results, to ranking WordNet synsets in terms of how strongly they possess a given semantic property.
Identifying subjective adjectives through web-based mutual information
76 Citations2004Marco Baroni, Stefano Vegnaduzzo
This paper describes a method for ranking a large list of adjectives according to a subjectivity score without resorting to any knowledge-intensive external resources (such as lexical databases, parsers or manual annotation).
Computers and the HumanitiesA web-based Bengali news corpus for named entity recognition
70 Citations2008Asif Ekbal, Sivaji Bandyopadhyay
A tagged Bengali news corpus has been developed from the web archive of a widely read Bengali newspaper and named Entity Recognition systems based on pattern based shallow parsing with or without using linguistic knowledge have been developed using a part of this corpus.
Transactions of the Japanese Society for Artificial IntelligenceOpinion Mining from Web Documents: Extraction and Structurization
46 Citations2007Nozomi Kobayashi, Kentaro Inui +1 more
How customer reviews in web documents can be best structured is discussed and a method for extracting opinions that represent evaluation of concumer products in a structured form is developed.
A fact/opinion classifier for news articles
18 Citations2007Adam Stepinski, Vibhu O. Mittal
This paper shows that the combination of a classifier trained on a small (140K) training set of editorials/reports and an interactive user interface that ameliorates classification errors by re-ordering the presentation can be effective in highlighting different underlying viewpoints in a story-cluster.