Identifying Emotions, Intentions, and Attitudes in Text Using a Game with a Purpose
Published 5 June 2010
Lisa Pearl, Mark Steyvers
Citations35
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work describes a methodology for creating databases of messages annotated with social information based on interactive games between humans trying to generate and interpret messages for a number of different social information types and presents some classification results achieved.
Abstract
Subtle social information is available in text such as a speaker’s emotional state, intentions, and attitude, but current information extraction systems are unable to extract this information at the level that humans can. We describe a methodology for creating databases of messages annotated with social information based on interactive games between humans trying to generate and interpret messages for a number of different social information types. We then present some classification results achieved by using a small-scale database created with this methodology. 1
Keywords
Computer Science
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
Labeling images with a computer game
2,222 Citations2004Luis von Ahn, Laura Dabbish
A new interactive system: a game that is fun and can be used to create valuable output that addresses the image-labeling problem and encourages people to do the work by taking advantage of their desire to be entertained.
Mining the peanut gallery
1,908 Citations2003Kushal Dave, Steve Lawrence +1 more
This work develops a method for automatically distinguishing between positive and negative reviews and draws on information retrieval techniques for feature extraction and scoring, and the results for various metrics and heuristics vary depending on the testing situation.
Cheap and fast---but is it good?
1,906 Citations2008Rion Snow, Brendan O’Connor +2 more
This work explores the use of Amazon's Mechanical Turk system, a significantly cheaper and faster method for collecting annotations from a broad base of paid non-expert contributors over the Web, and proposes a technique for bias correction that significantly improves annotation quality on two tasks.
ComputerGames with a Purpose
959 Citations2006L. von Ahn
"Games with a purpose" have a vast range of applications in areas as diverse as security, computer vision, Internet accessibility, adult content filtering, and Internet search, and any game designed to address these and other problems must ensure that game play results in a correct solution and, at the same time, is enjoyable.
IEEE Transactions on Pattern Analysis and Machine IntelligenceSparse multinomial logistic regression: fast algorithms and generalization bounds
884 Citations2005Balaji Krishnapuram, Lawrence Carin +2 more
This paper introduces a true multiclass formulation based on multinomial logistic regression and derives fast exact algorithms for learning sparse multiclass classifiers that scale favorably in both the number of training samples and the feature dimensionality, making them applicable even to large data sets in high-dimensional feature spaces.
Emotions from text
785 Citations2005Cecilia Ovesdotter Alm, Dan Roth +1 more
This paper explores the text-based emotion prediction problem empirically, using supervised machine learning with the SNoW learning architecture to classify the emotional affinity of sentences in the narrative domain of children's fairy tales, for subsequent usage in appropriate expressive rendering of text-to-speech synthesis.
Computational IntelligenceSENTIMENT CLASSIFICATION of MOVIE REVIEWS USING CONTEXTUAL VALENCE SHIFTERS
750 Citations2006Alistair Kennedy, Diana Inkpen
It is shown that extending the term‐counting method with contextual valence shifters improves the accuracy of the classification, and combining the two methods achieves better results than either method alone.
Computational LinguisticsLearning Subjective Language
743 Citations2004Janyce Wiebe, Theresa Wilson +3 more
This article shows that the density of subjectivity clues in the surrounding context strongly affects how likely it is that a word is subjective, and it provides the results of an annotation study assessing the subjectivity of sentences with high-density features.
Group Decision and NegotiationAutomating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated Communications
441 Citations2004Lina Zhou, Judee K. Burgoon +2 more
A test of the selected LBC in a simulated TA-CMC experiment showed that a systematic analysis of linguistic information could be useful in the detection of deception and some newly discovered linguistic constructs and their component LBC were helpful in differentiating deception from truth.
Verbosity
299 Citations2006Luis von Ahn, Mihir Kedia +1 more
Verbosity is a novel interactive system in the form of an enjoyable game that not only brings people together for leisure, but also collects useful data for computer science.
IEEE Transactions on Fuzzy SystemsAffect analysis of text using fuzzy semantic typing
291 Citations2001Pero Subašić, Alison K. Huettner
Say not to say : new perspectives on miscommunication
189 Citations2002Luigi Anolli, Maria Rita Ciceri +1 more
Contextual phrase-level polarity analysis using lexical affect scoring and syntactic N-grams
177 Citations2009Apoorv Agarwal, Fadi Biadsy +1 more
A classifier is presented to predict contextual polarity of subjective phrases in a sentence using lexical scoring derived from the Dictionary of Affect in Language and extended through WordNet and n-gram analysis to capture the effect of context.
More than words
172 Citations2009Stephan Greene, Philip Resnik
A strong predictive connection between linguistically well motivated features and implicit sentiment is established, and it is shown how computational approximations of these features can be used to improve on existing state-of-the-art sentiment classification results.
Human based genetic algorithm
140 Citations2002Alexander Kosorukoff
A new class of genetic algorithms (GA) is presented, based on the idea of outsourcing, which has the ability to address complex problems for which it is hard, not only to evaluate individuals, but to find a good representation for them.
Affect Intensity Analysis of Dark Web Forums
123 Citations2007Ahmed Abbasi, Hsinchun Chen
An affect lexicon is constructed using a probabilistic disambiguation technique to measure the usage of violence and hate affects and reveals that the Middle Eastern test bed forums have considerably greater violence intensity than the U.S. groups.
The Wisdom of Crowds in the Recollection of Order Information
66 Citations2009Mark Steyvers, Brent Miller +2 more
This research reports the performance of individuals in a series of general knowledge tasks, where the goal is to reconstruct from memory the order of historic events, or the orderof items along some physical dimension, using two Bayesian models for aggregating order information.
Cues to Deception in Online Chinese Groups
47 Citations2008Lina Zhou, Yu-wei Sung
It is found that deceivers tended to communicate less and showed low complexity and high diversity in their messages, which provide significant implications to deception research and the broad online communication community.
3. Deceptive miscommunication theory (DeMiT): a new model for the analysis of deceptive communication
27 Citations2002Luigi Anolli, Michela Balconi +1 more
Improving a textual deception detection model
18 Citations2006Shruti Gupta, David B. Skillicorn
This work investigates what can be learned about the deception model by applying it to a large corpus of Enron emails and shows that each of the four kinds of words in the Pennebaker model acts as a separate latent factor for deception, rather than having their effects mixed together.