SemEval-2016 Task 4: Sentiment Analysis in Twitter
Published 1 January 2016Open access
Preslav Nakov, Sara Rosenthal, Zornitsa Kozareva, Veselin Stoyanov, Alan Ritter
Citations433
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The fourth year of the SemEval-2016 Task 4 comprises five subtasks, three of which represent a significant departure from previous editions, and the task continues to be very popular, attracting a total of 43 teams.
Abstract
This paper discusses the fourth year of the "Sentiment Analysis in Twitter Task". SemEval-2016 Task 4 comprises five subtasks, three of which represent a significant departure from previous editions. The first two subtasks are reruns from prior years and ask to predict the overall sentiment, and the sentiment towards a topic in a tweet. The three new subtasks focus on two variants of the basic "sentiment classification in Twitter" task. The first variant adopts a five-point scale, which confers an ordinal character to the classification task. The second variant focuses on the correct estimation of the prevalence of each class of interest, a task which has been called quantification in the supervised learning literature. The task continues to be very popular, attracting a total of 43 teams.
Keywords
Computer Science
Proceedings of the International AAAI Conference on Web and Social MediaPredicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
2,681 Citations2010Andranik Tumasjan, Timm O. Sprenger +2 more
It is found that the mere number of messages mentioning a party reflects the election result, and joint mentions of two parties are in line with real world political ties and coalitions.
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining.
2,652 Citations2010Stefano Baccianella, Andrea Esuli +1 more
This work discusses SENTIWORDNET 3.0, a lexical resource explicitly devised for supporting sentiment classification and opinion mining applications, and reports on the improvements concerning aspect (b) that it embodies with respect to version 1.0.
Proceedings of the International AAAI Conference on Web and Social MediaFrom Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
1,955 Citations2010Brendan O’Connor, Ramnath Balasubramanyan +2 more
This work connects measures of public opinion measured from polls with sentiment measured from text, and finds that temporal smoothing is a critically important issue to support a suc- cessful model.
Computers and the HumanitiesAnnotating Expressions of Opinions and Emotions in Language
1,770 Citations2005Janyce Wiebe, Theresa Wilson +1 more
The manual annotation process and the results of an inter-annotator agreement study on a 10,000-sentence corpus of articles drawn from the world press are presented.
Proceedings of the International AAAI Conference on Web and Social MediaTwitter Sentiment Analysis: The Good the Bad and the OMG!
1,243 Citations2021Efthymios Kouloumpis, Theresa Wilson +1 more
Named Entity Recognition in Tweets: An Experimental Study
1,203 Citations2011Alan Ritter, Sam Clark +1 more
The novel T-ner system doubles F1 score compared with the Stanford NER system, and leverages the redundancy inherent in tweets to achieve this performance, using LabeledLDA to exploit Freebase dictionaries as a source of distant supervision.
Robust Sentiment Detection on Twitter from Biased and Noisy Data
875 Citations2010Luciano Barbosa, Junlan Feng
This paper proposes an approach to automatically detect sentiments on Twitter messages (tweets) that explores some characteristics of how tweets are written and meta-information of the words that compose these messages and leverages sources of noisy labels as training data.
Open domain event extraction from twitter
602 Citations2012Alan Ritter, Mausam Mausam +2 more
TwiCal is described-- the first open-domain event-extraction and categorization system for Twitter, and a novel approach for discovering important event categories and classifying extracted events based on latent variable models is presented.
Semi-supervised recognition of sarcastic sentences in Twitter and Amazon
422 Citations2010Dmitry Davidov, Oren Tsur +1 more
This paper experiments with semi-supervised sarcasm identification on two very different data sets: a collection of 5.9 million tweets collected from Twitter, and aCollection of 66000 product reviews from Amazon.
Meeting of the Association for Computational LinguisticsTwitter Based System: Using Twitter for Disambiguating Sentiment Ambiguous Adjectives
95 Citations2010Alexander Pak, Patrick Paroubek
This system uses text messages from Twitter, a popular microblogging platform, for building a dataset of emotional texts and classifies the meaning of adjectives into positive or negative sentiment polarity according to the given context.
Procesamiento del lenguaje naturalTASS - Workshop on Sentiment Analysis at SEPLN
75 Citations2013Julio Villena Román, Sara Lana-Serrano +2 more
TASS, an experimental evaluation workshop within SEPLN, is described to foster the research in the field of sentiment analysis in social media, specifically focused on Spanish language to promote the application of existing state-of-the-art algorithms and techniques.
Research Commons (University of Waikato)Detecting Sentiment Change in Twitter Streaming Data
51 Citations2011Albert Bifet, Geoffrey Holmes +2 more
MOA-TweetReader is a real-time system to read tweets in real time, to detect changes, and to discover the terms whose frequency changed.
Tweester at SemEval-2016 Task 4: Sentiment Analysis in Twitter Using Semantic-Affective Model Adaptation
15 Citations2016Elisavet Palogiannidi, Athanasia Kolovou +7 more
This system comprises of multiple independent models such as neural networks, semantic-affective models and topic modeling combined in a probabilistic way to predict a tweet’s sentiment and a late fusion scheme is adopted for the final decision.
aueb.twitter.sentiment at SemEval-2016 Task 4: A Weighted Ensemble of SVMs for Twitter Sentiment Analysis
11 Citations2016Stavros Giorgis, Apostolos Rousas +3 more
The system with which the authors participated in SemEval-2016 Task 4 (Sentiment Analysis in Twitter) and specifically the Message Polarity Classification subtask is described, which was ranked 5th among 34 teams.