SemEval-2016 Task 5: Aspect Based Sentiment Analysis
Published 1 January 2016Open access
Maria Pontiki, Dimitrios Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, Mohammad AL-Smadi
Citations1,224
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper describes the SemEval 2016 shared task on Aspect Based Sentiment Analysis (ABSA), a continuation of the respective tasks of 2014 and 2015, which attracted 245 submissions from 29 teams and provided 19 training and 20 testing datasets.
Abstract
Maria Pontiki, Dimitris Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, Mohammad AL-Smadi, Mahmoud Al-Ayyoub, Yanyan Zhao, Bing Qin, Orphée De Clercq, Véronique Hoste, Marianna Apidianaki, Xavier Tannier, Natalia Loukachevitch, Evgeniy Kotelnikov, Nuria Bel, Salud María Jiménez-Zafra, Gülşen Eryiğit. Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016). 2016.
Keywords
Computer Science
ACM Transactions on Intelligent Systems and TechnologyLIBSVM
41,340 Citations2011Chih-Chung Chang, Chih‐Jen Lin
Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
6,774 Citations2013Richard Socher, Alex Perelygin +5 more
A Sentiment Treebank that includes fine grained sentiment labels for 215,154 phrases in the parse trees of 11,855 sentences and presents new challenges for sentiment compositionality, and introduces the Recursive Neural Tensor Network.
Journal of Marketing ResearchThe Effect of Word of Mouth on Sales: Online Book Reviews
5,939 Citations2006Judith A. Chevalier, Dina Mayzlin
SemEval-2014 Task 4: Aspect Based Sentiment Analysis
1,881 Citations2014Maria Pontiki, Dimitrios Galanis +4 more
SemEval2014 Task 4 aimed to foster research in the field of aspect-based sentiment analysis, where the goal is to identify the aspects of given target entities and the sentiment expressed for each aspect.
IEEE Intelligent SystemsNew Avenues in Opinion Mining and Sentiment Analysis
1,222 Citations2013Erik Cambria, Björn W. Schuller +2 more
The history, current use, and future of opinion mining and sentiment analysis are discussed, along with relevant techniques and tools.
Conference of the European Chapter of the Association for Computational Linguisticsbrat: a Web-based Tool for NLP-Assisted Text Annotation
941 Citations2012Pontus Stenetorp, Sampo Pyysalo +4 more
The brat rapid annotation tool (BRAT) is introduced, an intuitive web-based tool for text annotation supported by Natural Language Processing (NLP) technology and an evaluation of annotation assisted by semantic class disambiguation on a multicategory entity mention annotation task, showing a 15% decrease in total annotation time.
SemEval-2016 Task 6: Detecting Stance in Tweets
828 Citations2016Saif M. Mohammad, Svetlana Kiritchenko +3 more
A shared task on detecting stance from tweets: given a tweet and a target entity (person, organization, etc.), automatic natural language systems must determine whether the tweeter is in favor of thegiven target, against the given target, or whether neither inference is likely.
SemEval-2014 Task 9: Sentiment Analysis in Twitter
615 Citations2014Sara Rosenthal, Alan Ritter +2 more
The Sentiment Analysis in Twitter task is described, a continuation of the last year’s task that ran successfully as part of SemEval2013 and introduced three new test sets: regular tweets, sarcastic tweets, and LiveJournal sentences.
Sentiment Analysis and Opinion Mining
532 Citations2023Lei Zhang, Bing Liu
Information Technology & TourismWhat Motivates Consumers to Write Online Travel Reviews?
431 Citations2008Kyung Hyan Yoo, Ulrike Gretzel
The results indicate that online travel review writers are mostly motivated by helping a travel service provider, concerns for other consumers, and needs for enjoyment/positive self-enhancement.
Beyond the Stars: Improving Rating Predictions using Review Text Content.
400 Citations2009Gayatree Ganu, Noémie Elhadad +1 more
This paper proposes new ad-hoc and regression-based recommendation measures, that both take into account the textual component of user reviews, and shows that using textual information results in better general or personalized review score predictions than those derived from the numerical star ratings given by the users.
Learning Attitudes and Attributes from Multi-aspect Reviews
239 Citations2012Julian McAuley, Jure Leskovec +1 more
This paper builds models for rating systems in which users leave separate ratings for each aspect of a product, and introduces new corpora consisting of five million reviews, rated with between three and six aspects.
SemEval-2015 Task 11: Sentiment Analysis of Figurative Language in Twitter
207 Citations2015Aniruddha Ghosh, Guofu Li +5 more
This report summarizes the objectives and evaluation of the SemEval 2015 task on the sentiment analysis of figurative language on Twitter (Task 11), the first sentiment analysis task wholly dedicated to analyzing figurativelanguage on Twitter.
Overview of Multilingual Opinion Analysis Task at NTCIR-7.
122 Citations2008Yohei Seki, David K. Evans +4 more
The task definition, the details of the test collection, the evaluation results of the groups that participated in this task, and their approach are presented.
Overview of Opinion Analysis Pilot Task at NTCIR-6
101 Citations2007Yohei Seki, David K. Evans +4 more
An overview of the test collection, task design, and evaluation results across the Chinese, Japanese, and English data, and the evaluation results of the groups participating in opinion extraction subtask at NTCIR are presented.
The META-SHARE Language Resources Sharing Infrastructure: Principles, Challenges, Solutions
59 Citations2012Stelios Piperidis
META-SHARE, an open resource exchange infrastructure, which aims to boost visibility, documentation, identification, openness and sharing, collaboration, preservation and interoperability of language data and basic language processing tools, is presented.
IEEE Intelligent SystemsCreating a Fine-Grained Corpus for Chinese Sentiment Analysis
40 Citations2014Yanyan Zhao, Bing Qin +1 more
The proposed fine-grained annotation scheme not only introduces cross-sentence and global sentiment information but also includes new sentence-level elements (such as "implicit aspect") that can provide a more fine- grained platform for researchers to study algorithms for advanced applications.
The Impact of NLP on Turkish Sentiment Analysis
35 Citations2014Ezgi Yıldırım, Fatih Samet Çetin +2 more
The experiments show that the sentiment analysis performance may be improved by nearly 5 percentage points yielding a success ratio of 78.83% on the used data set.
Communications in computer and information scienceESWC 15 Challenge on Concept-Level Sentiment Analysis
29 Citations2015Diego Reforgiato Recupero, Mauro Dragoni +1 more
The Concept Level Sentiment Analysis challenge aims to provide a push in this direction offering the researchers an event where they can learn new approaches for the employment of Semantic Web features within their systems of sentiment analysis bringing to better performance and higher accuracy.
Aspect-Level Cross-lingual Sentiment Classification with Constrained SMT
26 Citations2015Patrik Lambert
This paper proposes a method, based on constrained SMT, to transfer opinionated units across languages by preserving their boundaries and shows that cross-language sentiment classifiers built with this method achieve comparable results to monolingual ones, and compares different cross-lingual settings.
Publikationen an der Universität Bielefeld (Universität Bielefeld)The USAGE review corpus for fine-grained, multi-lingual opinion analysis
25 Citations2014Roman Klinger
The Bielefeld University Sentiment Analysis Corpus for German and English (USAGE), which is offered freely to the community and which contains the annotation of product reviews from Amazon with both aspects and subjective phrases, shows that aspects and phrases can be extracted robustly without the need of tuning to a particular type of products.
Linguistic Annotation WorkshopTURKSENT: A Sentiment Annotation Tool for Social Media
20 Citations2013GülÅŸen EryiÄŸit, Fatih Samet Çetin +3 more
An annotation tool developed specifically for manual sentiment analysis of social media posts with easy and fast annotation interface, detailed sentiment levels, multi-client support, easy to manage administrative modules and linguistic annotation capabilities.
A Multi-lingual Annotated Dataset for Aspect-Oriented Opinion Mining
12 Citations2015Salud María Jiménez-Zafra, Giacomo Berardi +4 more
Trip-MAML is a multi-lingual dataset for aspect-oriented opinion mining that enables researchers to face the problem on languages other than English and to the experiment the application of cross-lingUAL learning methods to the task.
Theory and applications of categoriesOverview of the TAC2013 Knowledge Base Population Evaluation: English Sentiment Slot Filling.
9 Citations2013Margaret Mitchell
This document provides an overview of the Text Analysis Conference 2013 Knowledge Base Population Sentiment Slot Filling track, and focused on identifying the polarity of sentiment as well as sentiment holders and sentiment targets.
HilDok – Institutional Repository (Universität Hildesheim)IGGSA Shared Tasks on German Sentiment Analysis (GESTALT)
8 Citations2014Josef Ruppenhofer, Roman Klinger +3 more
The German Sentiment Analysis Shared Task (GESTALT) which consists of two main tasks: Source, Subjective Expression and Target Extraction from Political Speeches (STEPS) and Subjective Phrase and Aspect Extracted from Product Reviews (StAR).
Rude waiter but mouthwatering pastries! An exploratory study into Dutch Aspect-Based Sentiment Analysis
6 Citations2016Orphée De Clercq, Véronique Hoste
This paper presents the first full aspect-based sentiment analysis pipeline for Dutch and applies it to customer reviews to show that this is indeed a feasible approach that yields promising results.