Topic-link LDA
Published 14 June 2009
Yan Liu, Alexandru Niculescu-Mizil, Wojciech Gryc
Citations286
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A Bayesian hierarchical approach is developed that performs topic modeling and author community discovery in one unified framework and is demonstrated on two blog data sets in different domains and one research paper citation data from CiteSeer.
Abstract
Given a large-scale linked document collection, such as a collection of blog posts or a research literature archive, there are two fundamental problems that have generated a lot of interest in the research community. One is to identify a set of high-level topics covered by the documents in the collection; the other is to uncover and analyze the social network of the authors of the documents. So far these problems have been viewed as separate problems and considered independently from each other. In this paper we argue that these two problems are in fact inter-dependent and should be addressed together. We develop a Bayesian hierarchical approach that performs topic modeling and author community discovery in one unified framework. The effectiveness of our model is demonstrated on two blog data sets in different domains and one research paper citation data from CiteSeer.
Keywords
Computer Science
Journal of Machine Learning ResearchLatent dirichlet allocation
27,049 Citations2003David M. Blei, Andrew Y. Ng +1 more
Proceedings of the National Academy of SciencesFinding scientific topics
6,017 Citations2004Thomas L. Griffiths, Mark Steyvers
A generative model for documents is described, introduced by Blei, Ng, and Jordan, and a Markov chain Monte Carlo algorithm is presented for inference in this model, which is used to analyze abstracts from PNAS by using Bayesian model selection to establish the number of topics.
Machine LearningAn Introduction to Variational Methods for Graphical Models
3,775 Citations1999Michael I. Jordan, Zoubin Ghahramani +2 more
This paper presents a tutorial introduction to the use of variational methods for inference and learning in graphical models (Bayesian networks and Markov random fields), and describes a general framework for generating variational transformations based on convex duality.
Dynamic topic models
2,322 Citations2006David M. Blei, John Lafferty
A family of probabilistic time series models is developed to analyze the time evolution of topics in large document collections, and dynamic topic models provide a qualitative window into the contents of a large document collection.
Uncertainty in Artificial IntelligenceThe author-topic model for authors and documents
1,313 Citations2004Michal Rosen‐Zvi, Thomas Griffiths +2 more
Information RetrievalAutomating the Construction of Internet Portals with Machine Learning
1,265 Citations2000Andrew Kachites McCallum, Kamal Nigam +2 more
New research in reinforcement learning, information extraction and text classification that enables efficient spidering, the identification of informative text segments, and the population of topic hierarchies are described.
Inferring Web communities from link topology
772 Citations1998David Gibson, Jon Kleinberg +1 more
This investigation shows that although the process by which users of the Web create pages and links is very difficult to understand at a “local” level, it results in a much greater degree of orderly high-level structure than has typically been assumed.
ACM Computing SurveysGraph mining
621 Citations2006Deepayan Chakrabarti, Christos Faloutsos
This survey gives an overview of the incredible variety of work that has been done on graph problems and one of the main contributions is the integration of points of view from physics, mathematics, sociology, and computer science.
Relational Topic Models for Document Networks
485 Citations2009Jonathan Chang, David M. Blei
The relational topic model (RTM) is developed, a model of documents and the links between them that derives efficient inference and learning algorithms based on variational methods and evaluates the predictive performance of the RTM for large networks of scientific abstracts and web documents.
Proceedings of the National Academy of SciencesMixed-membership models of scientific publications
445 Citations2004Elena A. Erosheva, Stephen E. Fienberg +1 more
This work explores an internal soft-classification structure of articles based only on semantic decompositions of abstracts and bibliographies of PNAS articles, and compares it with the formal discipline classifications.
The Missing Link - A Probabilistic Model of Document Content and Hypertext Connectivity
439 Citations2000David Cohn, Thomas Hofmann
A joint probabilistic model for modeling the contents and inter-connectivity of document collections such as sets of web pages or research paper archives is described, based on a Probabilistic factor decomposition.
Topic modeling with network regularization
396 Citations2008Qiaozhu Mei, Deng Cai +2 more
A novel solution to the problem of topic modeling with network structure (TMN) is proposed, which regularizes a statistical topic model with a harmonic regularizer based on a graph structure in the data.
ScholarWorks@UMassAmherst (University of Massachusetts Amherst)Topic and role discovery in social networks
291 Citations2005Andrew McCallum, Andrés Corrada-Emmanuel +1 more
Unsupervised prediction of citation influences
240 Citations2007Laura Dietz, Steffen Bickel +1 more
A probabilistic topic model is devised that explains the generation of documents and incorporates the aspects of topical innovation and topical inheritance via citations, and its ability to predict the strength of influence of citations against manually rated citations is evaluated.
The MIT Press eBooksStochastic Relational Models for Discriminative Link Prediction
201 Citations2007Kai Yu, Wei Chu +3 more
A Gaussian process (GP) framework, stochastic relational models (SRM), for learning social, physical, and other relational phenomena where interactions between entities are observed is introduced and extensions of SRM to general relational learning tasks are discussed.
Proceedings of the International AAAI Conference on Web and Social MediaLink-PLSA-LDA: A New Unsupervised Model for Topics and Influence of Blogs
125 Citations2021Ramesh Nallapati, William W. Cohen
A new model that can be used to provide a user with highly influential blog postings on the topic of the user's interest is proposed, called Link-PLSA-LDA, that combines PLSA and LDA into a single framework, and explicitly models the topical relationship between the linking and the linked document.
DSpace@MIT (Massachusetts Institute of Technology)Variational methods for inference and estimation in graphical models
93 Citations1997Tommi Jaakkola, Michael I. Jordan
This thesis proposes a principled framework for approximating graphical models based on variational methods and develops variational techniques from the perspective that unifies and expands their applicability to graphical models.
Dirichlet enhanced relational learning
21 Citations2005Zhao Xu, Volker Tresp +3 more
The experiments show that the additional flexibility in a nonparametric hierarchical Bayes approach results in a more accurate model of the dependencies between procedures and diagnosis and gives significantly improved estimates of the probabilities of future procedures.