How can you say such things?!?: Recognizing Disagreement in Informal Political Argument
Published 23 June 2011
Rob Abbott, Marilyn Walker, Pranav Anand, Jean E. Fox Tree, Robeson Bowmani, Joseph King
Citations95
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A Mechanical Turk annotated corpus of forum discussions is used as a gold standard for the recognition of disagreement in online ideological forums and the utility of meta-post features, contextual features, dependency features and word-based features for signaling the disagreement relation is analyzed.
Abstract
The recent proliferation of political and social forums has given rise to a wealth of freely accessible naturalistic arguments. People can “talk ” to anyone they want, at any time, in any location, about any topic. Here we use a Mechanical Turk annotated corpus of forum discussions as a gold standard for the recognition of disagreement in online ideological forums. We analyze the utility of meta-post features, contextual features, dependency features and word-based features for signaling the disagreement relation. We show that using contextual and dialogic features we can achieve accuracies up to 68 % as compared to a unigram baseline of 63%. 1
Keywords
Computer Science
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
Journal of Computational ScienceTwitter mood predicts the stock market
4,995 Citations2011Johan Bollen, Huina Mao +1 more
This work investigates whether measurements of collective mood states derived from large-scale Twitter feeds are correlated to the value of the Dow Jones Industrial Average (DJIA) over time and indicates that the accuracy of DJIA predictions can be significantly improved by the inclusion of specific public mood dimensions but not others.
Influence : science and practice
3,633 Citations1985Robert B. Cialdini
Accurate unlexicalized parsing
3,055 Citations2003Dan Klein, Christopher D. Manning
It is demonstrated that an unlexicalized PCFG can parse much more accurately than previously shown, by making use of simple, linguistically motivated state splits, which break down false independence assumptions latent in a vanilla treebank grammar.
Generating Typed Dependency Parses from Phrase Structure Parses
2,304 Citations2006Marie-Catherine de Marneffe, Bill MacCartney +1 more
A system for extracting typed dependency parses of English sentences from phrase structure parses that captures inherent relations occurring in corpus texts that can be critical in real-world applications is described.
Cheap and fast---but is it good?
1,906 Citations2008Rion Snow, Brendan O’Connor +2 more
This work explores the use of Amazon's Mechanical Turk system, a significantly cheaper and faster method for collecting annotations from a broad base of paid non-expert contributors over the Web, and proposes a technique for bias correction that significantly improves annotation quality on two tasks.
Get out the vote
497 Citations2006Matt Thomas, Bo Pang +1 more
It is found that the incorporation of sources of information regarding relationships between discourse segments, such as whether a given utterance indicates agreement with the opinion expressed by another, yields substantial improvements over classifying speeches in isolation.
Semi-supervised recognition of sarcastic sentences in Twitter and Amazon
422 Citations2010Dmitry Davidov, Oren Tsur +1 more
This paper experiments with semi-supervised sarcasm identification on two very different data sets: a collection of 5.9 million tweets collected from Twitter, and aCollection of 66000 product reviews from Amazon.
Empirical Studies on the Disambiguation of Cue Phrases
372 Citations1991Julia Hirschberg, Diane Litman
This paper reports results of empirical studies on discourse and sentential uses of cue phrases, in which both text-based and prosodic features were examined for disambiguating power.
Recognizing Stances in Ideological On-Line Debates
307 Citations2010Swapna Somasundaran, Janyce Wiebe
This work constructs an arguing lexicon automatically from a manually annotated corpus and builds supervised systems employing sentiment and arguing opinions and their targets as features, which perform substantially better than a distribution-based baseline.
Journal of PragmaticsBasic meanings of you know and I mean
303 Citations2002Jean E. Fox Tree, Josef C. Schrock
Recognizing stances in online debates
301 Citations2009Swapna Somasundaran, Janyce Wiebe
This paper presents an unsupervised opinion analysis method for debate-side classification, i.e., recognizing which stance a person is taking in an online debate, and shows that this method is substantially better than challenging baseline methods.
Mining newsgroups using networks arising from social behavior
290 Citations2003Rakesh Agrawal, Sridhar Rajagopalan +2 more
This work investigates the feasibility of applying link-based methods in new applications domains to partition authors into opposite camps within a given topic in the context of newsgroups and analyzes the graph structure of the responses.
Leave a Reply: An Analysis of Weblog Comments
277 Citations2006Gilad Mishne, Natalie Glance
A large-scale study of weblog comments and their relation to the posts is presented, using a sizable corpus of comments to estimate the overall volume of comments in the blogosphere; analyze the relation between the weblog popularity and commenting patterns in it; and measure the contribution of comment content to various aspects of weblogs access.
Metaphor and SymbolRecognizing Verbal Irony in Spontaneous Speech
254 Citations2002Gregory A. Bryant, Jean E. Fox Tree
Detecting controversial events from twitter
234 Citations2010Ana-Maria Popescu, Marco Pennacchiotti
This paper addresses the task of identifying controversial events using Twitter as a starting point: it proposes 3 models for this task and reports encouraging initial results.
Identifying agreement and disagreement in conversational speech
217 Citations2004Michel Galley, Kathleen McKeown +2 more
A statistical approach for modeling agreements and disagreements in conversational interaction first identifies adjacency pairs using maximum entropy ranking based on a set of lexical, durational, and structural features that look both forward and backward in the discourse.
Generalizing dependency features for opinion mining
179 Citations2009Mahesh Joshi, Carolyn Penstein Rosé
Using a transformation of dependency relation triples, features based on syntactic dependency relations can be utilized to improve performance on opinion mining by being converted into composite back-off features that generalize better than the regular lexicalized dependency relation features.
Meeting of the Association for Computational LinguisticsCats Rule and Dogs Drool!: Classifying Stance in Online Debate
176 Citations2011Pranav Anand, Marilyn Walker +4 more
The results suggest that methods that take into account the dialogic context of such posts might be fruitful, and demonstrate that the number of subjective expressions varies across debates, a fact correlated with the performance of systems sensitive to sentiment-bearing terms.
Support or Oppose? Classifying Positions in Online Debates from Reply Activities and Opinion Expressions
145 Citations2010Akiko Murakami, Rudy Raymond
It is shown that utilizing the textual content of the remarks into the link-based method can yield higher accuracy in the identification task.
Journal of Memory and LanguageDiscourse Markers in Spontaneous Speech: Oh What a Difference an Oh Makes
136 Citations1999Jean E. Fox Tree, Josef C. Schrock
Language and Linguistics CompassDiscourse Markers across Speakers and Settings
94 Citations2010Jean E. Fox Tree
Issues for further testing include demonstrating that speakers and listeners ascribe particular functions to particular markers, tracking the development of these functions as children age, tracking how these functions are adopted by second language learners, and documenting how discourse marker use changes across technological settings.
Communication MonographsA model of compliance‐gaining message selection
82 Citations1987John E. Hunter, Franklin J. Boster
This paper examines the dimensionality of compliance‐gaining message use ratings and suggests that the multidimensional solutions presented in these studies are spurious, and a unidimensional model is shown to fit the data.
International Conference on Computational LinguisticsThe Power of Negative Thinking: Exploiting Label Disagreement in the Min-cut Classification Framework
71 Citations2008Mohit Bansal, Claire Cardie +1 more
This work reports on work in progress that examines several novel heuristics that allow for the addition of label-disagreement information in a way that improves classification accuracy while preserving the efficiency guarantees of the minimum-cut framework.
Investigating cue selection and placement in tutorial discourse
62 Citations1995Megan Moser, Johanna D. Moore
A coding scheme for the exhaustive analysis of discourse allows a systematic evaluation and refinement of hypotheses concerning cues, and a comparison of the distribution of SINCE and BECAUSE in the corpus, and the impact of embeddedness on cue selection are reported.
Learning features that predict cue usage
48 Citations1997Barbara Di Eugenio, Johanna D. Moore +1 more
The goal is to identify the features that predict the occurrence and placement of discourse cues in tutorial explanations in order to aid in the automatic generation of explanations, and to show that machine learning can be used to induce decision trees useful for text generation.
Making Conversational Structure Explicit: Identification of Initiation-response Pairs within Online Discussions
25 Citations2010Yi‐Chia Wang, Carolyn Penstein Rosé
This paper develops a novel variant of Latent Semantic Analysis (LSA) to overcome a limitation of standard LSA models, namely that uncommon words, which are critical for signaling initiation-response links, tend to be deemphasized.
Language-model-based pro/con classification of political text
16 Citations2010Rawia Awadallah, Maya Ramanath +1 more
Given a controversial political topic, the aim is to classify documents debating the topic into pro or con by using topic related terms and pairs of topic related and pro/con related terms as the basis for constructing a pro query and a con query.
Discourse ProcessesThe Effect of Substituting Discourse Markers on Their Role in Dialogue
13 Citations2010Martin Groen, Jan Noyes +1 more
Using Multiple Sources of Agreement Information for Sentiment Classification of Political Transcripts
7 Citations2008Clint Burfoot
This paper explores approaches to sentiment classification of U.S Congressional floor debate transcripts that use a model for incorporating multiple sources of information about agreements between speakers that demonstrates accuracy improvements over previously published results.