Benefactive/Malefactive Event and Writer Attitude Annotation
Published 1 August 2013
Lingjia Deng, Yoonjung Choi, Janyce Wiebe
Citations64
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An annotation scheme for events that negatively or positively affect entities (benefactive/malefactive events) and for the attitude of the writer toward their agents and objects is presented and the results of an inter-annotator agreement study are given.
Abstract
This paper presents an annotation scheme for events that negatively or positively affect entities (benefactive/malefactive events) and for the attitude of the writer toward their agents and objects. Work on opinion and sentiment tends to focus on explicit expressions of opinions. However, many attitudes are conveyed implicitly, and benefactive/malefactive events are important for inferring implicit attitudes. We describe an annotation scheme and give the results of an inter-annotator agreement study. The annotated corpus is available online. 1
Keywords
Computer Science
Computers and the HumanitiesAnnotating Expressions of Opinions and Emotions in Language
1,770 Citations2005Janyce Wiebe, Theresa Wilson +1 more
The manual annotation process and the results of an inter-annotator agreement study on a 10,000-sentence corpus of articles drawn from the world press are presented.
Computational LinguisticsInter-Coder Agreement for Computational Linguistics
1,604 Citations2008Ron Artstein, Massimo Poesio
It is argued that weighted, alpha-like coefficients, traditionally less used than kappa-like measures in computational linguistics, may be more appropriate for many corpus annotation tasks—but that their use makes the interpretation of the value of the coefficient even harder.
International Joint Conference on Artificial IntelligenceIdentifying expressions of opinion in context
253 Citations2007Eric Breck, Yejin Choi +1 more
An approach for identifying opinion expressions that uses conditional random fields and achieves expression-level performance within 5% of the human interannotator agreement is presented.
Weakly Supervised Learning for Hedge Classification in Scientific Literature
199 Citations2007Ben Medlock, Ted Briscoe
It is shown that hedge classification is feasible using weakly supervised ML, and point toward avenues for future research.
Annotating attributions and private states
103 Citations2005Theresa Wilson, Janyce Wiebe
Extensions to a corpus annotation scheme for the manual annotation of attributions, as well as opinions, emotions, sentiments, speculations, evaluations and other private states in language are described.
Annotating Opinions in the World Press
83 Citations2003Theresa Wilson, Janyce Wiebe
This paper presents a detailed scheme for annotating expressions of opinions, beliefs, emotions, sentiment and speculation in the news and other discourse, and explores inter-annotator agreement for individual private state expressions.
Recognition of Affect, Judgment, and Appreciation in Text
80 Citations2010Alena Neviarouskaya, Helmut Prendinger +1 more
The developed @AM system relies on the compositionality principle and a novel approach based on the rules elaborated for semantically distinct verb classes to classification of text using fine-grained attitude labels.
Computational LinguisticsRelational Features in Fine-Grained Opinion Analysis
68 Citations2012Richard Johansson, Alessandro Moschitti
A set of experiments are described that demonstrate that relational features, mainly derived from dependency-syntactic and semantic role structures, can significantly improve the performance of automatic systems for a number of fine-grained opinion analysis tasks: marking up opinion expressions, finding opinion holders, and determining the polarities of opinion expressions.
Computational IntelligenceA COMPUTATIONAL MODEL FOR PLOT UNITS
36 Citations2012Amit Goyal, Ellen Riloff +1 more
This research revisits plot units, which were developed in the 1980s as a conceptual knowledge structure to represent the affect states of and emotional tensions between characters in narrative stories, with a fully automated system, called AESOP, that generates plot unit representations for narrative texts.
Meeting of the Association for Computational LinguisticsRecognizing Arguing Subjectivity and Argument Tags
34 Citations2012Alexander Conrad, Janyce Wiebe +1 more
This paper investigates the utility of a sentiment lexicon, discourse parser, and semantic similarity measures with respect to recognizing arguments, and explores a two-phase approach to recognize arguments, with promising results.