Opinion Mining and Sentiment Polarity on Twitter and Correlation between Events and Sentiment
Published 1 March 2016
Peiman Mamani Barnaghi, Parsa Ghaffari, John G. Breslin
Citations109
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A positive or negative sentiment on Twitter posts is provided using a well-known machine learning method for text categorization using manually labeled (positive/negative) tweets to build a trained method to accomplish a task.
Abstract
Twitter, as a social media is a very popular way of expressing opinions and interacting with other people in the online world. When taken in aggregation tweets can provide a reflection of public sentiment towards events. In this paper, we provide a positive or negative sentiment on Twitter posts using a well-known machine learning method for text categorization. In addition, we use manually labeled (positive/negative) tweets to build a trained method to accomplish a task. The task is looking for a correlation between twitter sentiment and events that have occurred. The trained model is based on the Bayesian Logistic Regression (BLR) classification method. We used external lexicons to detect subjective or objective tweets, added Unigram and Bigram features and used TF-IDF (Term Frequency-Inverse Document Frequency) to filter out the features. Using the FIFA World Cup 2014 as our case study, we used Twitter Streaming API and some of the official world cup hashtags to mine, filter and process tweets, in order to analyze the reflection of public sentiment towards unexpected events. The same approach, can be used as a basis for predicting future events.
Keywords
Computer Science
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
ACM SIGKDD Explorations NewsletterThe WEKA data mining software
17,849 Citations2009Mark Hall, Eibe Frank +4 more
This paper provides an introduction to the WEKA workbench, reviews the history of the project, and, in light of the recent 3.6 stable release, briefly discusses what has been added since the last stable version (Weka 3.4) released in 2003.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
Foundations and Trends® in Information RetrievalOpinion Mining and Sentiment Analysis
6,204 Citations2008Bo Pang, Lillian Lee
This survey covers techniques and approaches that promise to directly enable opinion-oriented information-seeking systems and focuses on methods that seek to address the new challenges raised by sentiment-aware applications, as compared to those that are already present in more traditional fact-based analysis.
Machine LearningOn the Optimality of the Simple Bayesian Classifier under Zero-One Loss
3,072 Citations1997Pedro Domingos, Michael J. Pazzani
The Bayesian classifier is shown to be optimal for learning conjunctions and disjunctions, even though they violate the independence assumption, and will often outperform more powerful classifiers for common training set sizes and numbers of attributes, even if its bias is a priori much less appropriate to the domain.
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining.
2,652 Citations2010Stefano Baccianella, Andrea Esuli +1 more
This work discusses SENTIWORDNET 3.0, a lexical resource explicitly devised for supporting sentiment classification and opinion mining applications, and reports on the improvements concerning aspect (b) that it embodies with respect to version 1.0.
Machine LearningBoosTexter: A Boosting-based System for Text Categorization
2,194 Citations2000Robert E. Schapire, Yoram Singer
This work describes in detail an implementation, called BoosTexter, of the new boosting algorithms for text categorization tasks, and presents results comparing the performance of Boos Texter and a number of other text-categorization algorithms on a variety of tasks.
Communications of the ACMTechniques and applications for sentiment analysis
1,494 Citations2013Ronen Feldman
The main applications and challenges of one of the hottest research areas in computer science are revealed.
Inductive learning algorithms and representations for text categorization
1,465 Citations1998Susan Dumais, John Platt +2 more
A comparison of the effectiveness of five different automatic learning algorithms for text categorization in terms of learning speed, realtime classification speed, and classification accuracy is compared.
TechnometricsLarge-Scale Bayesian Logistic Regression for Text Categorization
813 Citations2007Alexander Genkin, David Lewis +1 more
This work presents a simple Bayesian logistic regression approach that uses a Laplace prior to avoid overfitting and produces sparse predictive models for text data and applies this approach to a range of document classification problems and shows that it produces compact predictive models at least as effective as those produced by support vector machine classifiers or ridgelogistic regression combined with feature selection.
Lecture notes in computer scienceSentiment Knowledge Discovery in Twitter Streaming Data
580 Citations2010Albert Bifet, Eibe Frank
To deal with streaming unbalanced classes, a sliding window Kappa statistic is proposed for evaluation in time-changing data streams, and a study on Twitter data is performed using learning algorithms for data streams.
A Comparative Study of Stemming Algorithms
361 Citations2011Anjali Jivani
This paper has discussed different methods of stemming and their comparisons in terms of usage, advantages as well as limitations, and the basic difference between stemming and lemmatization.
IEEE Intelligent Systems and their ApplicationsMaximizing text-mining performance
211 Citations1999Sabine Weiß, Chid Apte +5 more
Joining statistics with NLP for text categorization
44 Citations1992Paul S. Jacobs
The approach has been to use statistics in the knowledge acquisition component of a linguistic pattern-based categorization system, using statistical methods, for example, to associate words with industries and identify phrases that information about businesses or products.
Texas ScholarWorks (Texas Digital Library)Sentiment Analysis on Twitter with Stock Price and Significant Keyword Correlation
39 Citations2018Linhao Zhang
This paper examines the effectiveness of various machine learning techniques on providing a positive or negative sentiment on a tweet corpus, and finds that there is very little direct correlation between stock prices and tweet sentiment on specifically an intra-day scale.
Language sensitive text classification
31 Citations2000Roberto Basili, Alessandro Moschitti +1 more
An original classification model sensitive to document syntactic information and characterized by a novel inference method is described and the results show that a significant improvement can be derived using the proposed inference model.
Automatic Unsupervised Polarity Detection on a Twitter Data Stream
29 Citations2014Diego Terrana, Agnese Augello +1 more
A simple sentiment classifier where an actual stream of tweets from Twitter is processed and its content classified as positive, negative or neutral, made without the use of any pre-defined polarity lexicon.