Semantic Spaces for Sentiment Analysis
Lecture notes in computer sciencePublished 1 January 2013
Ivan Habernal, Tomáš Brychcín
Citations17
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This article reports the first successful incorporation of semantic spaces based on local word co-occurrence in the sentiment analysis task, and presents a new semi-supervised method for document-level sentiment analysis.
Abstract
This article presents a new semi-supervised method for document-level sentiment analysis. We employ a supervised state-of-the-art classification approach and enrich the feature set by adding word cluster features. These features exploit clusters of words represented in semantic spaces computed on unlabeled data. We test our method on three large sentiment datasets (Czech movie and product reviews, and English movie reviews) and outperform the current state of the art. To the best of our knowledge, this article reports the first successful incorporation of semantic spaces based on local word co-occurrence in the sentiment analysis task.
Keywords
Computer Science
Cognitive PsychologyFamily resemblances: Studies in the internal structure of categories
5,842 Citations1975Eleanor Rosch, Carolyn Β. Mervis
Discourse ProcessesAn introduction to latent semantic analysis
4,817 Citations1998Thomas K. Landauer, Peter W. Foltz +1 more
The adequacy of LSA's reflection of human knowledge has been established in a variety of ways, for example, its scores overlap those of humans on standard vocabulary and subject matter tests; it mimics human word sorting and category judgments; it simulates word‐word and passage‐word lexical priming data.
Learning Word Vectors for Sentiment Analysis
3,299 Citations2011Andrew L. Maas, Raymond E. Daly +4 more
This work presents a model that uses a mix of unsupervised and supervised techniques to learn word vectors capturing semantic term--document information as well as rich sentiment content, and finds it out-performs several previously introduced methods for sentiment classification.
Computational LinguisticsA maximum entropy approach to natural language processing
3,120 Citations1996Adam Berger, Vincent J. Della Pietra +1 more
A maximum-likelihood approach for automatically constructing maximum entropy models is presented and how to implement this approach efficiently is described, using as examples several problems in natural language processing.
Mathematics of ComputationUpdating quasi-Newton matrices with limited storage
2,710 Citations1980Jorge Nocedal
An update formula which generates matrices using information from the last m iterations, where m is any number supplied by the user, and the BFGS method is considered to be the most efficient.
Behavior Research Methods, Instruments, & ComputersProducing high-dimensional semantic spaces from lexical co-occurrence
1,839 Citations1996Kevin Lund, Curt Burgess
A procedure that processes a corpus of text and produces numeric vectors containing information about its meanings for each word, which provide the basis for a representational model of semantic memory, hyperspace analogue to language (HAL).
A Survey of Opinion Mining and Sentiment Analysis
1,331 Citations2012Bing Liu, Lei Zhang
Sentiment analysis or opinion mining is the computational study of people’s opinions, appraisals, attitudes, and emotions toward entities, individuals, issues, events, topics and their attributes.
Joint sentiment/topic model for sentiment analysis
972 Citations2009Chenghua Lin, Yulan He
A novel probabilistic modeling framework based on Latent Dirichlet Allocation (LDA), called joint sentiment/topic model (JST), which detects sentiment and topic simultaneously from text is proposed, which is fully unsupervised.
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
967 Citations2012Sida Wang, Christopher D. Manning
It is shown that the inclusion of word bigram features gives consistent gains on sentiment analysis tasks, and a simple but novel SVM variant using NB log-count ratios as feature values consistently performs well across tasks and datasets.
FigsharePart-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
830 Citations2018Kevin Gimpel, Nathan Schneider +8 more
Psychological ReviewRepresenting word meaning and order information in a composite holographic lexicon.
638 Citations2007Michael N. Jones, D. J. K. Mewhort
A computational model that builds a holographic lexicon representing both word meaning and word order from unsupervised experience with natural language demonstrates that a broad range of psychological data can be accounted for directly from the structure of lexical representations learned in this way, without the need for complexity to be built into either the processing mechanisms or the representations.
University of Minnesota Digital Conservancy (University of Minnesota)Criterion Functions for Document Clustering: Experiments and Analysis
592 Citations2001Ying Zhao, George Karypis
An Introduction to Random Indexing
363 Citations2005Magnus Sahlgren
The Random Indexing word space approach is introduced, which presents an efficient, scalable and incremental alternative to standard word space methods.
Group-by skyline query processing in relational engines
281 Citations2009Ming-Hay Luk, Man Lung Yiu +1 more
The composition of a query plan for a group-by skyline query is examined and the missing cost model for the BBS algorithm is developed and Experimental results show that the techniques are able to devise the best query plans for a variety of group- by skyline queries.
Maryland Shared Open Access Repository (USMAI Consortium)Delta TFIDF: An Improved Feature Space for Sentiment Analysis
266 Citations2009Justin Martineau, Tim Finin
Journal of Biomedical InformaticsReflective Random Indexing and indirect inference: A scalable method for discovery of implicit connections
135 Citations2009Trevor Cohen, Roger W. Schvaneveldt +1 more
reflective Random Indexing (RRI), an iterative variant of the method that is better able to perform indirect inference, is shown to lead to more clearly related indirect connections and to outperform existing RI implementations in the prediction of future direct co-occurrence in the MEDLINE corpus.
Proceedings of the 5th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
131 Citations2014Jakob Elming, Dirk Hovy +1002 more
The S-Space Package: An Open Source Package for Word Space Models
101 Citations2010David Jurgens, Keith Stevens
The S-Space Package implements well-known word space algorithms, such as LSA, and provides a comprehensive set of matrix utilities and data structures for extending new or existing models and includes word space benchmarks for evaluation.
North American Chapter of the Association for Computational LinguisticsSentiment Analysis in Czech Social Media Using Supervised Machine Learning
76 Citations2013Ivan Habernal, Tomáš Ptáċek +1 more
An in-depth research of machine learning methods for sentiment analysis of Czech social media using different pre-processing techniques and employ various features and classifiers, which will extend the current sentiment analysis research to another family of languages and encourage competition which potentially leads to the production of high-end commercial solutions.
Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
55 Citations2016Alexandra Balahur, Erik van der Goot
Computer Speech & LanguageSemantic spaces for improving language modeling
25 Citations2013Tomáš Brychcín, Miloslav Konopík
This article examines patterns that can be found in large corpora by building semantic spaces (HAL, COALS, BEAGLE and others described in this article) by using semantic spaces and clustering to build classes for a class-based language model.
Creating annotated resources for polarity classification in Czech.
16 Citations2012Kateřina Veselovská, Jan Hajič +1 more
A method for annotating Czech evaluative structures and a standard unigram-based Naive Bayes classifier on three different types of annotated texts are described and analyzed.