Multi-lingual support for lexicon-based sentiment analysis guided by semantics
Decision Support SystemsPublished 22 March 2014Open access
Alexander Hogenboom, Bas Heerschop, Flavius Frăsincar, Uzay Kaymak, Franciska de Jong
Citations88
SJR quartileQ1
SJR score2.37
SNIP2.59
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Mapping sentiment across languages by exploiting relations between semantic lexicons yields a significant performance improvement over the baseline, indicating that sentiment is not only linked to word meanings, but tends to have a language-specific dimension as well.
Abstract
__Abstract__ \n \nMany sentiment analysis methods rely on sentiment lexicons, containing words and their associated sentiment, and are tailored to one specific language. Yet, the ever-growing amount of data in different languages on the Web renders multi-lingual support increasingly important. In this paper, we assess various methods for supporting an additional target language in lexicon-based sentiment analysis. As a baseline, we automatically translate text into a reference language for which a sentiment lexicon is available, and subsequently analyz
Keywords
Computer Science
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Mining and summarizing customer reviews
7,714 Citations2004Minqing Hu, Bing Liu
This research aims to mine and to summarize all the customer reviews of a product, and proposes several novel techniques to perform these tasks.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
Foundations and Trends® in Information RetrievalOpinion Mining and Sentiment Analysis
6,204 Citations2008Bo Pang, Lillian Lee
This survey covers techniques and approaches that promise to directly enable opinion-oriented information-seeking systems and focuses on methods that seek to address the new challenges raised by sentiment-aware applications, as compared to those that are already present in more traditional fact-based analysis.
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
Computational LinguisticsLexicon-Based Methods for Sentiment Analysis
3,255 Citations2011Maite Taboada, Julian Brooke +3 more
The Semantic Orientation CALculator (SO-CAL) uses dictionaries of words annotated with their semantic orientation (polarity and strength), and incorporates intensification and negation, and is applied to the polarity classification task.
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining.
2,652 Citations2010Stefano Baccianella, Andrea Esuli +1 more
This work discusses SENTIWORDNET 3.0, a lexical resource explicitly devised for supporting sentiment classification and opinion mining applications, and reports on the improvements concerning aspect (b) that it embodies with respect to version 1.0.
SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining
2,489 Citations2006Andrea Esuli, Fabrizio Sebastiani
SENTIWORDNET is a lexical resource in which each WORDNET synset is associated to three numerical scores Obj, Pos and Neg, describing how objective, positive, and negative the terms contained in the synset are.
Journal of the American Society for Information Science and TechnologyTwitter power: Tweets as electronic word of mouth
1,644 Citations2009Bernard J. Jansen, Mimi Zhang +2 more
A holistic lexicon-based approach to opinion mining
1,388 Citations2008Xiaowen Ding, Bing Liu +1 more
This paper proposes a holistic lexicon-based approach to solving the problem of determining the semantic orientations (positive, negative or neutral) of opinions expressed on product features in reviews by exploiting external evidences and linguistic conventions of natural language expressions.
ACM Transactions on Information SystemsSentiment analysis in multiple languages
894 Citations2008Ahmed Abbasi, Hsinchun Chen +1 more
Stylistic features significantly enhanced performance across all testbeds while EWGA also outperformed other feature selection methods, indicating the utility of these features and techniques for document-level classification of sentiments.
IEEE Transactions on Knowledge and Data EngineeringA Survey of Web Information Extraction Systems
794 Citations2006Chia‐Hui Chang, Mohammed Kayed +2 more
This paper surveys the major Web data extraction approaches and compares them in three dimensions: the task domain, the automation degree, and the techniques used and believes these criteria provide qualitatively measures to evaluate various IE approaches.
The Journal of Economic PerspectivesConsumer Confidence and Consumer Spending
716 Citations2004Sydney C. Ludvigson
Using WordNet to Measure Semantic Orientations of Adjectives
647 Citations2004Jaap Kamps, M. Marx +2 more
Using appraisal groups for sentiment analysis
562 Citations2005Casey Whitelaw, Navendu Garg +1 more
A new method for sentiment classification based on extracting and analyzing appraisal groups such as ``very good'' or ``not terribly funny'' is presented, based on several task-independent semantic taxonomies based on Appraisal Theory.
Decision Support SystemsThe impact of social and conventional media on firm equity value: A sentiment analysis approach
487 Citations2012Yang Yu, Wenjing Duan +1 more
The findings suggest that overall social media has a stronger relationship with firm stock performance than conventional media while social and conventional media have a strong interaction effect on stock performance.
Information RetrievalA machine learning approach to sentiment analysis in multilingual Web texts
473 Citations2008Erik Boiy, Marie‐Francine Moens
This paper presents machine learning experiments with regard to sentiment analysis in blog, review and forum texts found on the World Wide Web and written in English, Dutch and French and investigates the role of active learning techniques for reducing the number of examples to be manually annotated.
Learning Multilingual Subjective Language via Cross-Lingual Projections
399 Citations2007Rada Mihalcea, Carmen Banea +1 more
This paper discusses learning multilingual subjective language via cross-lingual projections with a focus on English as a second language.
A Study of Information Retrieval Weighting Schemes for Sentiment Analysis
351 Citations2010George Paltoglou, Mike Thelwall
It is shown that variants of the classic tf.idf scheme adapted to sentiment analysis provide significant increases in accuracy, especially when using a sublinear function for term frequency weights and document frequency smoothing.
IEEE Transactions on Visualization and Computer GraphicsTextFlow: Towards Better Understanding of Evolving Topics in Text
348 Citations2011Weiwei Cui, Shixia Liu +6 more
This paper introduces TextFlow, a seamless integration of visualization and topic mining techniques, for analyzing various evolution patterns that emerge from multiple topics, and extends an existing analysis technique to extract three-level features.
Co-clustering based classification for out-of-domain documents
331 Citations2007Wenyuan Dai, Gui-Rong Xue +2 more
This paper proposes a co-clustering based classification (CoCC) algorithm, used as a bridge to propagate the class structure and knowledge from the in-domain to the out-of-domain, and shows that the algorithm greatly improves the classification performance over the traditional learning algorithms.
Transferring naive bayes classifiers for text classification
313 Citations2007Wenyuan Dai, Gui-Rong Xue +2 more
This paper proposes a novel transfer-learning algorithm for text classification based on an EM-based Naive Bayes classifiers and shows that the algorithm outperforms the traditional supervised and semi-supervised learning algorithms when the distributions of the training and test sets are increasingly different.
Decision Support SystemsEvaluating sentiment in financial news articles
311 Citations2012Robert P. Schumaker, Yulei Zhang +2 more
Investigation of the Arizona Financial Text system, a financial news article prediction system, and a sentiment analysis tool found that subjective news articles were easier to predict in price direction and using a simple trading engine, subjective articles garnered a 3.30% return.
Multilingual subjectivity analysis using machine translation
287 Citations2008Carmen Banea, Rada Mihalcea +2 more
Through comparative evaluations on two different languages, it is shown that automatic translation is a viable alternative for the construction of resources and tools for subjectivity analysis in a new target language.
Trinity's Access to Research Output (TARA) (Trinity College Dublin)Sentiment Polarity Identification in Financial News: A Cohesion-based Approach
275 Citations2007Ann Devitt, Khurshid Ahmad
This paper aims to explore a computable metric of positive or negative polarity in financial news text which is consistent with human judgments and can be used in a quantitative analysis of news sentiment impact on financial markets.
ACM Transactions on Information SystemsRepeatable evaluation of search services in dynamic environments
271 Citations2007Eric C. Jensen, Steven M. Beitzel +2 more
The bootstrap estimate of the reproducibility probability of hypothesis tests is leveraged in determining the query sample sizes required to ensure this, finding they are much larger than those required for static collections.
Decision Support SystemsSubjectivity and sentiment analysis: An overview of the current state of the area and envisaged developments
264 Citations2012Andrés Montoyo, Patricio Martínez-Barco +1 more
This introduction presents an overview of the current state of research in the Natural Language Processing tasks of subjectivity and sentiment analysis, as well as their application domains and closely-related research field of emotion detection.
IEEE Transactions on Knowledge and Data EngineeringMining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain
241 Citations2011Xiaohui Yu, Yang Liu +2 more
A case study in the movie domain is conducted, and it is shown that both the sentiments expressed in the reviews and the quality of the reviews have a significant impact on the future sales performance of products in question.
Using bilingual knowledge and ensemble techniques for unsupervised Chinese sentiment analysis
235 Citations2008Xiaojun Wan
This study proposes a novel approach to leverage reliable English resources to improve Chinese sentiment analysis by first translates Chinese reviews into English reviews by machine translation services, and then identifies the sentiment polarity of English Reviews by directly leveraging English resources.
Proceedings of the International AAAI Conference on Web and Social MediaInternational Sentiment Analysis for News and Blogs
209 Citations2021Mikhail Bautin, Lohit Vijayarenu +1 more
This work explores an approach utilizing state-of-the-art machine translation technology and performs sentiment analysis on the English translation of a foreign language text and indicates that entity sentiment scores obtained by the method are statistically significantly correlated across nine languages of news sources and five languages of a parallel corpus.
Decision Support SystemsMaking objective decisions from subjective data: Detecting irony in customer reviews
171 Citations2012Antonio Reyes, Paolo Rosso
A set of customer reviews, which are considered ironic both in social and mass media, are analyzed to gather a set of discriminating elements to represent irony, in particular, the kind of irony expressed in such reviews.
Research portal (Tilburg University)An efficient memory-based morphosyntactic tagger and parser for Dutch
158 Citations2007Antal van den Bosch, Bertjan Busser +2 more
A global analysis of the TADPOLE system shows that it is able to process text in linear time close to an estimated 2,500 words per second, while maintaining sufficient accuracy.
Sentiment summarization
155 Citations2009Kevin Lerman, Sasha Blair-Goldensohn +1 more
A large-scale, end-to-end human evaluation of various sentiment summarization models shows that users have a strong preference for summarizers that model sentiment over non-sentiment baselines, but have no broad overall preference between any of the sentiment-based models.
Decision Support SystemsDetecting implicit expressions of emotion in text: A comparative analysis
137 Citations2012Alexandra Balahur, Jesús M. Hermida +1 more
This article presents a comparative analysis between the performance of well-established methods for emotion detection and a method that is based on commonsense knowledge stored in the EmotiNet knowledge base, and shows that the approach based on Emoti net is the most appropriate.
Decision Support SystemsIdentifying disgruntled employee systems fraud risk through text mining: A simple solution for a multi-billion dollar problem
135 Citations2008Carolyn F. Holton
Protocols to identify disgruntled communications are developed and a highly accurate naive Bayes model predicts whether messages contain disgruntled communications, providing extremely relevant information not otherwise likely to be revealed in a fraud audit.
Multilingual Subjectivity: Are More Languages Better?
134 Citations2010Carmen Banea, Rada Mihalcea +1 more
This paper explores the integration of features originating from multiple languages into a machine learning approach to subjectivity analysis, and aims to show that this enriched feature set provides for more effective modeling for the source as well as the target languages.
Polarity analysis of texts using discourse structure
123 Citations2011Bas Heerschop, Frank Goossen +4 more
Pathos, a framework which performs document sentiment analysis (partly) based on a document's discourse structure, is proposed, which hypothesizes that by splitting a text into important and less important text spans, and by subsequently making use of this information by weighting the sentiment conveyed by distinct text spans in accordance with their importance, it can improve the performance of a sentiment classifier.
Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam)EuroWordNet: a multilingual database for information retrieval
119 Citations1997Piek Vossen
The basic characteristics of the EuroWordNet-project, a database with wordnets for English, Spanish, Dutch and Italian, similar to the Princeton WordNet1.5, are described as far as relevant to this purpose.
Decision Support SystemsAutomatic information extraction from semi-structured Web pages by pattern discovery
101 Citations2002Chia‐Hui Chang, Chun‐Nan Hsu +1 more
This paper introduces IEPAD (an acronym for Information Extraction based on PAttern Discovery), a system that discovers extraction patterns from Web pages without user-labeled examples and applies several pattern discovery techniques, including PAT-trees, multiple string alignments and pattern matching algorithms.
Journal of Economics & Management Strategy<scp>Competing for the Public Through the News Media</scp>
94 Citations2005David P. Baron
Determining negation scope and strength in sentiment analysis
81 Citations2011Alexander Hogenboom, Paul van Iterson +3 more
This work compares several approaches to accounting for negation in sentiment analysis, differing in their methods of determining the scope of influence of a negation keyword.
Decision Support Systems for Business Intelligence
80 Citations2011Vicki L. Sauter
This chapter discusses Decision Support Systems, a large-scale system that combines Intelligence and Decision Support Systems with Object Oriented Technologies and Decision Support Systems Design, and its application in the Enterprise.
Decision Support SystemsOn developing robust models for favourability analysis: Model choice, feature sets and imbalanced data
77 Citations2012Peter C. R. Lane, Daoud Clarke +1 more
The effect of using five different types of features, the robustness of the models when tested on data taken from a later time period, and the effect of balancing the input data by undersampling are explored.
Multimedia Tools and ApplicationsSemantics-based information extraction for detecting economic events
64 Citations2012Alexander Hogenboom, Frederik Hogenboom +3 more
The Semantics-Based Pipeline for Economic Event Detection (SPEED), focusing on extracting financial events from news articles and annotating these with meta-data at a speed that enables real-time use, is proposed.
Generating a non-English subjectivity lexicon
55 Citations2009Valentin Jijkoun, Katja Hofmann
A PageRank-like algorithm is used to bootstrap from the translation of the English lexicon and rank the words in the thesaurus by polarity using the network of lexical relations in Wordnet.
Applied Financial EconomicsFundamental uncertainty and stock market volatility
50 Citations2008Ivo J.M. Arnold, Evert B. Vrugt
Cross language text categorization by acquiring multilingual domain models from comparable corpora
48 Citations2005Alfio Gliozzo, Carlo Strapparava
This paper proposes a novel approach to solve the cross language text categorization problem based on acquiring Multilingual Domain Models from comparable corpora in a totally unsupervised way and without using any external knowledge source.
IEEE Transactions on Knowledge and Data EngineeringIncremental Information Extraction Using Relational Databases
39 Citations2010Luis Tari, Phan Huy Tu +5 more
Using database queries for information extraction enables generic extraction and minimizes reprocessing of data by performing incremental extraction to identify which part of the data is affected by the change of components or goals.
Lecture notes in business information processingSentiment Lexicon Creation from Lexical Resources
34 Citations2011Bas Heerschop, Alexander Hogenboom +1 more
A corpus-based evaluation of several automated methods for creating lexicons, exploiting vast lexical resources, and considers propagating the sentiment of a seed set of words through semantic relations or through PageRank-based similarities, which turns out to outperform the others.
Research portal (Tilburg University)The Cornetto Database: Architecture and User-Scenarios
33 Citations2007Piek Vossen, Katja Hofmann +3 more
This paper outlines the architecture of a semantic database for Dutch, developed in the Cornetto project, and its possible usage in language technology and information access applications, and gives an overview of possible application areas in order to inspire future research based on theCornetto database.
Advances in intelligent and soft computingAnalyzing Sentiment in a Large Set of Web Data While Accounting for Negation
27 Citations2011Bas Heerschop, Paul van Iterson +3 more
A basic sentiment analysis framework - consisting of a wordbank creation part and a document scoring part - taking into account negation is utilized, showing that by accounting for negation, precision on human ratings increases with 1.17%.
Decision Support SystemsBeyond keyword and cue-phrase matching: A sentence-based abstraction technique for information extraction
23 Citations2005Samuel W. K. Chan
A novel quantitative model for the creation of a summary by extracting a set of sentences that represent the most salient content of a text by based on a shallow linguistic extraction technique.
Advances in intelligent systems and computingA Statistical Approach to Star Rating Classification of Sentiment
22 Citations2012Alexander Hogenboom, F. C. Boon +1 more
This work proposes and compares the performance of several statistical methods of automatically classifying star ratings of reviews represented by means of a binary vector representation, with features signaling the presence of sentiment-carrying words.
IEEE Transactions on Knowledge and Data EngineeringTopic Mining over Asynchronous Text Sequences
19 Citations2010Xiang Wang, Xiaoming Jin +3 more
A novel algorithm based on the generative topic model is put forward to explore the correlation with the existence of asynchronism among multiple sequences, i.e., documents from different sequences about the same topic may have different time stamps.
Lecture notes in computer scienceSentiment-Based Ranking of Blog Posts Using Rhetorical Structure Theory
17 Citations2013José M. Chenlo, Alexander Hogenboom +1 more
The results show that RST provides valuable information about the discourse structure of the texts that can be used to make a more accurate ranking of documents in terms of their estimated sentiment in multi-topic blogs.
Lecture notes in computer scienceMining Economic Sentiment Using Argumentation Structures
16 Citations2010Alexander Hogenboom, Frederik Hogenboom +3 more
A framework is proposed that allows the incorporation of information on argumentation structure in the models for economic sentiment discovery in text based on their statistical properties and possibly combined with numeric data.
Effective and efficient polarity estimation in blogs based on sentence-level evidence
12 Citations2011José M. Chenlo, David E. Losada
It is shown that one can successfully determine the polarity of documents guided by a sentence-level analysis that takes into account topicality and the location in the blog post of the subjective sentences.
2009. Generating a nonenglish subjectivity lexicon: Relations that matter
3 Citations2009Valentin Jijkoun, Katja Hofmann