Linking Tweets to News: A Framework to Enrich Short Text Data in Social Media
Published 1 January 2013
Weiwei Guo, Hao Li, Heng Ji, Mona Diab
Citations103
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work proposes a graph based latent variable model that models the inter short text correlations (text-to-text information) and shows that using tweet specific feature and news specific feature as well as temporal constraints, it is able to extract text- to-text correlations, and thus completes the semantic picture of a short text.
Abstract
Many current Natural Language Processing [NLP] techniques work well assuming a large context of text as input data. However they become ineffective when applied to short texts such as Twitter feeds. To overcome the issue, we want to find a related newswire document to a given tweet to provide contextual support for NLP tasks. This requires robust modeling and understanding of the semantics of short texts. The contribution of the paper is two-fold: 1. we introduce the Linking-Tweets-to-News task as well as a dataset of linked tweet-news pairs, which can benefit many NLP applications; 2. in contrast to previous research which focuses on lexical features within the short texts (text-to-word information), we propose a graph based latent variable model that models the inter short text correlations (text-to-text information). This is motivated by the observation that a tweet usually only covers one aspect of an event. We show that using tweet specific feature (hashtag) and news specific feature (named entities) as well as temporal constraints, we are able to extract text-to-text correlations, and thus completes the semantic picture of a short text. Our experiments show significant improvement of our new model over baselines with three evaluation metrics in the new task. 1
Keywords
Computer Science
Journal of Machine Learning ResearchLatent dirichlet allocation
27,049 Citations2003David M. Blei, Andrew Y. Ng +1 more
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Discourse ProcessesAn introduction to latent semantic analysis
4,817 Citations1998Thomas K. Landauer, Peter W. Foltz +1 more
The adequacy of LSA's reflection of human knowledge has been established in a variety of ways, for example, its scores overlap those of humans on standard vocabulary and subject matter tests; it mimics human word sorting and category judgments; it simulates word‐word and passage‐word lexical priming data.
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
Learning Word Vectors for Sentiment Analysis
3,299 Citations2011Andrew L. Maas, Raymond E. Daly +4 more
This work presents a model that uses a mix of unsupervised and supervised techniques to learn word vectors capturing semantic term--document information as well as rich sentiment content, and finds it out-performs several previously introduced methods for sentiment classification.
Feature-rich part-of-speech tagging with a cyclic dependency network
2,851 Citations2003Kristina Toutanova, Dan Klein +2 more
A new part-of-speech tagger is presented that demonstrates the following ideas: explicit use of both preceding and following tag contexts via a dependency network representation, broad use of lexical features, and effective use of priors in conditional loglinear models.
Proceedings of the International AAAI Conference on Web and Social MediaPredicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
2,681 Citations2010Andranik Tumasjan, Timm O. Sprenger +2 more
It is found that the mere number of messages mentioning a party reflects the election result, and joint mentions of two parties are in line with real world political ties and coalitions.
Seeing stars
2,127 Citations2005Bo Pang, Lillian Lee
A meta-algorithm is applied, based on a metric labeling formulation of the rating-inference problem, that alters a given n-ary classifier's output in an explicit attempt to ensure that similar items receive similar labels.
Labeled LDA
1,208 Citations2009Daniel Ramage, David Hall +2 more
Labeled LDA is introduced, a topic model that constrains Latent Dirichlet Allocation by defining a one-to-one correspondence between LDA's latent topics and user tags that allows Labeled LDA to directly learn word-tag correspondences.
Corpus-based and knowledge-based measures of text semantic similarity
1,189 Citations2006Rada Mihalcea, Courtney D. Corley +1 more
This paper shows that the semantic similarity method out-performs methods based on simple lexical matching, resulting in up to 13% error rate reduction with respect to the traditional vector-based similarity metric.
Topics over time
1,132 Citations2006Xuerui Wang, Andrew McCallum
An LDA-style topic model is presented that captures not only the low-dimensional structure of data, but also how the structure changes over time, showing improved topics, better timestamp prediction, and interpretable trends.
Zenodo (CERN European Organization for Nuclear Research)Political Polarization on Twitter
1,013 Citations2011Michael Conover, A. Ratkiewicz +4 more
Target-dependent Twitter Sentiment Classification
846 Citations2011Long Jiang, Mo Yu +3 more
This paper proposes to improve target-dependent Twitter sentiment classification by incorporating target- dependent features; and taking related tweets into consideration; and according to the experimental results, this approach greatly improves the performance of target- dependence sentiment classification.
IEEE Transactions on Knowledge and Data EngineeringSentence similarity based on semantic nets and corpus statistics
821 Citations2006Yuhua Li, David McLean +3 more
Experiments demonstrate that the proposed method provides a similarity measure that shows a significant correlation to human intuition and can be used in a variety of applications that involve text knowledge representation and discovery.
Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection
810 Citations2011Richard Socher, Eric Huang +3 more
This work introduces a method for paraphrase detection based on recursive autoencoders (RAE) and unsupervised RAEs based on a novel unfolding objective and learns feature vectors for phrases in syntactic trees to measure word- and phrase-wise similarity between two sentences.
Combining Content-Based and Collaborative Filters in an Online Newspaper
782 Citations1999Mark Claypool, Anuja Gokhale +4 more
A new ltering approach is presented that combines the coverage and speed of content-lters with the depth of collaborative ltering, and is applied to an online newspaper, an as yet untapped opportunity for lters useful to the widespread news reading populace.
Proceedings of the International AAAI Conference on Web and Social MediaCharacterizing Microblogs with Topic Models
724 Citations2010Daniel Ramage, Susan Dumais +1 more
A scalable implementation of a partially supervised learning model (Labeled LDA) that maps the content of the Twitter feed into dimensions that correspond roughly to substance, style, status, and social characteristics of posts is presented.
International Conference on Machine LearningWeighted low-rank approximations
702 Citations2003Nathan Srebro, Tommi Jaakkola
This work provides a simple and efficient algorithm for solving weighted low-rank approximation problems, which, unlike their unweighted version, do not admit a closed-form solution in general.
SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity
679 Citations2012Eneko Agirre, Daniel Cer +2 more
The results of the STS pilot task in Semeval open an exciting way ahead, although there are still open issues, specially the evaluation metric.
TwitterStand
669 Citations2009Jagan Sankaranarayanan, Hanan Samet +3 more
This work investigates the use of Twitter to build a news processing system, called TwitterStand, from Twitter tweets, to capture tweets that correspond to late breaking news, analogous to a distributed news wire service.
Predicting the Political Alignment of Twitter Users
591 Citations2011Michael Conover, Bruno Gonçalves +3 more
Several methods for predicting the political alignment of Twitter users based on the content and structure of their political communication in the run-up to the 2010 U.S. midterm elections are described and a practical application of this machinery to web-based political advertising is outlined.
ACM Transactions on Knowledge Discovery from DataSemantic text similarity using corpus-based word similarity and string similarity
485 Citations2008Aminul Islam, Diana Inkpen
A method for measuring the semantic similarity of texts using a corpus-based measure of semantic word similarity and a normalized and modified version of the Longest Common Subsequence string matching algorithm is presented.
Refining Event Extraction through Cross-Document Inference
400 Citations2008Heng Ji, Ralph Grishman
This work designs a simple scheme to conduct cross-document inference for improving the ACE event extraction task, and applies the hypothesis of “One Sense Per Discourse” to information extraction.
Recognizing Named Entities in Tweets
372 Citations2011Xiaohua Liu, Shaodian Zhang +2 more
This work proposes to combine a K-Nearest Neighbors classifier with a linear Conditional Random Fields model under a semi-supervised learning framework to tackle the challenges of Named Entities Recognition for tweets.
Training and testing of recommender systems on data missing not at random
355 Citations2010Harald Steck
It is shown that the absence of ratings carries useful information for improving the top-k hit rate concerning all items, a natural accuracy measure for recommendations, and two performance measures can be estimated, under mild assumptions, without bias from data even when ratings are missing not at random (MNAR).
Twitter Polarity Classification with Label Propagation over Lexical Links and the Follower Graph
308 Citations2011Michael Speriosu, Nikita Sudan +2 more
Results on polarity classification for several datasets show that the label propagation approach rivals a model supervised with in-domain annotated tweets, and it outperforms the noisily supervised classifier it exploits as well as a lexicon-based polarity ratio classifier.
Lecture notes in computer scienceSemantic Enrichment of Twitter Posts for User Profile Construction on the Social Web
264 Citations2011Fabian Abel, Qi Gao +2 more
A large-scale evaluation validates the benefits of the approach and shows that the methods relate tweets to news articles with high precision and coverage, enrich the semantics of tweets clearly and have strong impact on the construction of semantic user profiles for the Social Web.
An Empirical Study on Learning to Rank of Tweets
257 Citations2010Yajuan Duan, Long Jiang +3 more
This paper proposes a new ranking strategy which uses not only the content relevance of a tweet, but also the account authority and tweet-specific features such as whether a URL link is included in the tweet.
Transferring topical knowledge from auxiliary long texts for short text clustering
223 Citations2011Ou Jin, Nathan N. Liu +3 more
This article presents a novel approach to cluster short text messages via transfer learning from auxiliary long text data through a novel topic model - Dual Latent Dirichlet Allocation (DLDA) model, which jointly learns two sets of topics on short and long texts and couples the topic parameters to cope with the potential inconsistency between data sets.
We know what @you #tag
218 Citations2012Lei Yang, Tao Sun +2 more
This work proposes comprehensive measures to quantify the major factors of how a user selects content tags as well as joins communities, and proves the effectiveness of the dual role, where both the content measures and the community measures significantly correlate to hashtag adoption on Twitter.
Cooooooooooooooollllllllllllll!!!!!!!!!!!!!! Using Word Lengthening to Detect Sentiment in Microblogs
213 Citations2011Samuel Brody, Nicholas Diakopoulos
An automatic method which leverages word lengthening to adapt a sentiment lexicon specifically for Twitter and similar social messaging networks, and evaluates its method by comparison to human judgments, and analyzes its strengths and weaknesses.
DSpace@MIT (Massachusetts Institute of Technology)Event Discovery in Social Media Feeds
182 Citations2011Edward Benson, Aria Haghighi +1 more
A graphical model is developed that addresses record extraction from social streams such as Twitter by learning a latent set of records and a record-message alignment simultaneously, resulting in a set of canonical records that are consistent with aligned messages.
Ranking a stream of news
170 Citations2005Gianna M. Del Corso, Antonio Gullì +1 more
A ranking framework which models the process of generation of a stream of news articles, the news articles clustering by topics, and the evolution of news story over the time is proposed and can be obtained without a predefined sliding window of observation over the stream.
Journal of Artificial Intelligence ResearchText Relatedness Based on a Word Thesaurus
147 Citations2010George Tsatsaronis, Iraklis Varlamis +1 more
Experimental evaluation shows that the proposed method outperforms every lexicon-based method of semantic relatedness in the selected tasks and the used data sets, and competes well against corpus-based and hybrid approaches.
Modeling Sentences in the Latent Space
119 Citations2012Weiwei Guo, Mona Diab
By carefully handling words that are not in the sentences (missing words), a reliable latent variable model on sentences is trained and a new evaluation framework for sentence similarity is proposed: Concept Definition Retrieval.
Expert Systems with ApplicationsMONERS: A news recommender for the mobile web
114 Citations2005Hong Joo Lee, Sung Joo Park
Performance of MONERS was tested in an actual mobile web environment; news organized by category had more page hits, while recommended news had a higher overall article read ratio.
Edinburgh Research Explorer (University of Edinburgh)Tweet Recommendation with Graph Co-Ranking
91 Citations2012Rui Yan, Mirella Lapata +1 more
A graph-theoretic model for tweet recommendation that presents users with items they may have an interest in and can be parametrized to take into account user preferences, the popularity of tweets and their authors, and diversity.
International Conference on Computational LinguisticsTweet Ranking Based on Heterogeneous Networks
35 Citations2012Hongzhao Huang, Arkaitz Zubiaga +9 more
This paper introduces Tri-HITS, a model to iteratively propagate ranking scores across heterogeneous networks and shows that integrating both formal genre and inferred social networks with tweet networks produces a higher-quality ranking than the tweet networks alone.
Waseda University Repository (Waseda University)Combining Social Cognitive Theories with Linguistic Features for Multi-genre Sentiment Analysis
25 Citations2012Hao Li, Yu Chen +3 more
This paper combines local linguistic features and global social evidence in a propagation scheme to improve sentiment analysis results and obtains significant improvement for various genres in the domain of presidential election.
Weiwei: A Simple Unsupervised Latent Semantics based Approach for Sentence Similarity
22 Citations2012Weiwei Guo, Mona Diab
A simple unsupervised latent semantics based approach, Weighted Textual Matrix Factorization that only exploits bag-of-words features, can outperform most systems for this task.
Improving Lexical Semantics for Sentential Semantics: Modeling Selectional Preference and Similar Words in a Latent Variable Model
8 Citations2013Weiwei Guo, Mona Diab
This work incorporates both corpus-based and knowledge-based lexical semantics into a latent variable model, which shows state-of-the-art performance among unsupervised systems on two SS datasets.