Data Mining in Social Media
Published 1 January 2011
Geoffrey Barbier, Huan Liu
Citations217
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This chapter introduces the basics of data mining, reviews social media, discusses how to mine social media data, and highlights some illustrative examples with an emphasis on social networking sites and blogs.
Abstract
The rise of online social media is providing a wealth of social network data. Data mining techniques provide researchers and practitioners the tools needed to analyze large, complex, and frequently changing social media data. This chapter introduces the basics of data mining, reviews social media, discusses how to mine social media data, and highlights some illustrative examples with an emphasis on social networking sites and blogs.
Keywords
Computer SciencePhysics and Astronomy
Choice Reviews OnlineData mining: concepts and techniques
28,877 Citations2012Jiawei Han, Micheline Kamber +1 more
Data mining is the search for new, valuable, and nontrivial information in large volumes of data, a cooperative effort of humans and computers that is possible to put data-mining activities into one of two categories: Predictive data mining, which produces the model of the system described by the given data set, or Descriptive data mining which produces new, nontrivials information based on the available data set.
Journal of Machine Learning ResearchLatent dirichlet allocation
27,049 Citations2003David M. Blei, Andrew Y. Ng +1 more
Social network analysis methods and applications
18,142 Citations2007Stanley Wasserman, Katherine Faust
Business HorizonsUsers of the world, unite! The challenges and opportunities of Social Media
17,519 Citations2009Andreas Kaplan, Michael Haenlein
A classification of Social Media is provided which groups applications currently subsumed under the generalized term into more specific categories by characteristic: collaborative projects, blogs, content communities, social networking sites, virtual game worlds, and virtual social worlds.
Cambridge University Press eBooksSocial Network Analysis
17,041 Citations1994Stanley Wasserman, Katherine Faust
This paper presents mathematical representation of social networks in the social and behavioral sciences through the lens of dyadic and triadic interaction models, which provide insights into the structure and dynamics of relationships between actors and groups.
Introduction to Data Mining
7,026 Citations2008
Journal of Marketing ResearchThe Field behind the Screen: Using Netnography for Marketing Research in Online Communities
3,857 Citations2002Robert V. Kozinets
Mining the network value of customers
2,868 Citations2001Pedro Domingos, Matt Richardson
It is proposed to model also the customer's network value: the expected profit from sales to other customers she may influence to buy, the customers those may influence, and so on recursively, taking advantage of the availability of large relevant databases.
The link prediction problem for social networks
1,608 Citations2003David Liben‐Nowell, Jon Kleinberg
Experiments on large co-authorship networks suggest that information about future interactions can be extracted from network topology alone, and that fairly subtle measures for detecting node proximity can outperform more direct measures.
Cambridge University Press eBooksSupport Vector Machines
1,479 Citations2020Mohammed J. Zaki, Wagner Meira
Choice Reviews OnlineWeb data mining: exploring hyperlinks, contents, and usage data
1,193 Citations2012
Essentials of Statistics for the Behavioral Sciences
1,150 Citations1991Frederick J. Gravetter, Larry B. Wallnau
Information diffusion through blogspace
1,045 Citations2004Daniel Gruhl, R. Guha +2 more
A macroscopic characterization of topic propagation through the authors' corpus is presented, formalizing the notion of long-running "chatter" topics consisting recursively of "spike" topics generated by outside world events, or more rarely, by resonances within the community.
ACM SIGKDD Explorations NewsletterInformation diffusion through blogspace
951 Citations2004Daniel Gruhl, David Liben‐Nowell +2 more
A macroscopic characterization of topic propagation through the authors' corpus, formalizing the notion of long-running "chatter" topics consisting recursively of "spike" topics generated by outside world events, or more rarely, by resonances within the community.
Apress eBooksIntroduction to Data Mining
946 Citations2007
Data mining is a computing process that uses intelligent mathematical algorithms to extract the relevant data and computes the probability of future actions and is also known as Knowledge Discovery in Data (KDD).
Social influence analysis in large-scale networks
909 Citations2009Jie Tang, Jimeng Sun +2 more
Topical Affinity Propagation (TAP) is designed with efficient distributed learning algorithms that is implemented and tested under the Map-Reduce framework and can take results of any topic modeling and the existing network structure to perform topic-level influence propagation.
Wherefore art thou r3579x?
846 Citations2007Lars Bäckström, Cynthia Dwork +1 more
A family of attacks is described such that even from a single anonymized copy of a social network, it is possible for an adversary to learn whether edges exist or not between specific targeted pairs of nodes.
Influence and correlation in social networks
684 Citations2008Aris Anagnostopoulos, Ravi Kumar +1 more
Two simple tests are proposed that can identify influence as a source of social correlation when the time series of user actions is available and are applied to real tagging data on Flickr, exhibiting that while there is significant social correlation in tagging behavior on this system, this correlation cannot be attributed to social influence.
Feedback effects between similarity and social influence in online communities
603 Citations2008David Crandall, Dan Cosley +3 more
Clear feedback effects between the two factors are found, with rising similarity between two individuals serving, in aggregate, as an indicator of future interaction -- but with similarity then continuing to increase steadily, although at a slower rate, for long periods after initial interactions.
The Kluwer international series on advances in database systemsManaging and Mining Graph Data
586 Citations2010Charų C. Aggarwal, Haixun Wang
This is the first comprehensive survey book in the emerging topic of graph data processing and contains extensive surveys on important graph topics such as graph languages, indexing, clustering, data generation, pattern mining, classification, keyword search, pattern matching, and privacy.
IEEE Intelligent SystemsSocial Computing: From Social Informatics to Social Intelligence
574 Citations2007Fei‐Yue Wang, Kathleen M. Carley +2 more
The move from social informatics to social intelligence is achieved by modeling and analyzing social behavior, by capturing human social dynamics, and by creating artificial social agents and generating and managing actionable social knowledge.
Discovering Knowledge in Data
573 Citations2014Daniel T. Larose, Chantal D. Larose
ScienceRevisiting the Foundations of Network Analysis
549 Citations2009Carter T. Butts
This paper presents a meta-modelling framework that automates the very labor-intensive and therefore time-heavy and expensive process of manually cataloging and cataloging the connections between neurons in a network.
Prying Data out of a Social Network
339 Citations2009Joseph Bonneau, Jonathan Anderson +1 more
This work examines the difficulty of collecting profile and graph information from the popular social networking website Facebook and describes several novel ways in which data can be extracted by third parties, and demonstrates the efficiency of these methods on crawled data.
The Kluwer international series on advances in database systemsManaging and Mining Uncertain Data
289 Citations2009Charų C. Aggarwal
Managing and Mining Uncertain Data, a survey with chapters by a variety of well known researchers in the datamining field, presents the most recent models, algorithms, and applications in the uncertain data mining field in a structured and concise way.
Scalable learning of collective behavior based on sparse social dimensions
242 Citations2009Lei Tang, Huan Liu
This work proposes an edge-centric clustering scheme to extract sparse social dimensions that can efficiently handle networks of millions of actors while demonstrating comparable prediction performance as other non-scalable methods.
Elsevier eBooksFuzzy Modeling and Genetic Algorithms for Data Mining and Exploration
214 Citations2005
This chapter discusses the development of Fuzzy Systems, a framework for model building and management of Genetic Algorithms, and its applications in SQL and Intelligent Queries.
PubMedCommunity relations 2.0.
198 Citations2009Gerald C. Kane, Robert G. Fichman +2 more
The changes wrought by social media in particular are described and managers are shown how to take advantage of them--lessons that Kaiser Permanente, Domino's, and others learned the hard way.
The link prediction problem for social networks
183 Citations2003David Liben‐Nowell, Jon Kleinberg
Uncoverning Groups via Heterogeneous Interaction Analysis
166 Citations2009Lei Tang, Xufei Wang +1 more
This work proposes a two-phase strategy to identify the hidden structures shared across dimensions in multi-dimensional networks, which extracts structural features from each dimension of the network via modularity analysis, and integrates them all to find out a robust community structure among actors.
Using Prediction Markets and Twitter to Predict a Swine Flu Pandemic
140 Citations2009Joshua Ritterman, Miles Osborne +1 more
It is shown that simple features extracted from Tweets can reduce the error associated with modelling these beliefs and the approach is shown to outperform some baseline methods based purely on time-series information from the Market.
Maryland Shared Open Access Repository (USMAI Consortium)Modeling the Spread of Influence on the Blogosphere
139 Citations2006Akshay Java, Pranam Kolari +2 more
This paper validate the effectiveness of some of the influence models on the blogosphere, and shows how PageRank based heuristics could be used to select an influential set of bloggers such that the authors could maximize the spread of information on theBlogosphere.
Web Science 2.0: Identifying Trends through Semantic Social Network Analysis
129 Citations2009Peter A. Gloor, Jonas Krauß +3 more
A novel set of social network analysis based algorithms for mining the Web, blogs, and online forums to identify trends and find the people launching these new trends to predict long-term trends on the popularity of relevant concepts such as brands, movies, and politicians are introduced.
ACM Transactions on Knowledge Discovery from DataTopic taxonomy adaptation for group profiling
96 Citations2008Lei Tang, Huan Liu +3 more
This article addresses the problem of how to adapt a topic taxonomy to the accumulated data that reflects the change of a group's interest to achieve dynamic group profiling, and presents a viable algorithm that can efficiently accomplish taxonomy adaptation.
A brief survey of computational approaches in Social Computing
93 Citations2009Irwin King, Jiexing Li +1 more
A brief survey of the various machine learning and computational techniques used in Social Computing by first examining the social platforms, e.g., social network sites, social media, social games, social bookmarking, and social knowledge sites, where computational methodology is required to collect, extract, process, mine, and visualize the data.
Lecture notes in computer scienceGroup Recommendation System for Facebook
80 Citations2008Enkh-Amgalan Baatarjav, Santi Phithakkitnukoon +1 more
This work believes that Facebook SN groups can be identified based on their members' profiles and introduces group recommendation system (GRS) using combination of hierarchical clustering technique and decision tree.
Discovering Temporal Communities from Social Network Documents
74 Citations2007Ding Zhou, Isaac G. Councill +2 more
This paper proposes to discover the temporal communities by threading the statically derived communities in different time periods using a new constrained partitioning algorithm, which partitions graphs based on topology as well as prior information regarding vertex membership.
Synthesis lectures on data mining and knowledge discoveryModeling and Data Mining in Blogosphere
72 Citations2009Nitin Agarwal, Huan Liu
Spam blogs or "splogs" are an increasing concern in Blogosphere and are discussed in detail with the approaches leveraging supervised machine learning algorithms and interaction patterns.
A Survey on Privacy Preserving Data Mining
71 Citations2009Jian Wang, Yongcheng Luo +2 more
This paper intends to reiterate several privacy preserving data mining technologies clearly and then proceeds to analyze the merits and shortcomings of these technologies.
K-State Research Exchange (Kansas State University)An anthropological introduction to YouTube
70 Citations2008Michael Wesch
Social Computing, Behavioral Modeling, and PredictionMobile Phone Data for Inferring Social Network Structure
66 Citations2008Nathan Eagle, Alex Pentland +1 more
A new method for precise measurements of large-scale human behavior based on contextualized proximity and communication data alone is presented, and characteristic behavioral signatures of relationships are identified that allowed it to accurately predict 95% of the reciprocated friendships in the study.
IEEE Internet ComputingHomophily in the Digital World: A LiveJournal Case Study
55 Citations2010Hady W. Lauw, John Shafer +2 more
Using data from LiveJournal, the authors show that the answer to both questions is yes, a priori there's no reason to believe that two users with common interests are more likely to be friends.
An Analytical Way to Find Influencers on Social Networks and Validate their Effects in Disseminating Social Games
49 Citations2009Erica Suyeon Kim, Steve SangKi Han
This research proposes and evaluates a methodology for discovering influencers within OSNs and obtains a few powerful influencers who can effectively affect other people than mediocrities.
A Collaborative and Content Based Event Recommendation System Integrated with Data Collection Scrapers and Services at a Social Networking Site
45 Citations2009Mehmet Kayaalp, Tansel Özyer +1 more
This study is an effort to recommend events to users within a social networking site that has been designed as a facebook application and a combination of content based and collaborative filtering has been used.
Information flows and social capital in weblogs
25 Citations2008Raquel Recuero
It is shown how, for the studied case, information flow is influenced by bloggers' motivations and perceptions.
IEEE Internet ComputingKnowledge Discovery in the Blogosphere: Approaches and Challenges
25 Citations2010Geetika T. Lakshmanan, Martin Oberhofer
Three prominent techniques that are frequently applied to discovery in blogs - clustering, matrix decomposition, and ranking are examined in terms of effectiveness in combating present challenges and their ability to accomplish challenging tasks required for effective blog mining.
Discovering information diffusion paths from blogosphere for online advertising
24 Citations2007Avaré Stewart, Ling Chen +2 more
A new data mining algorithm is developed to discover information diffusion paths from the blogosphere to track how information frequently flows from blog to blog and is accurate in predicting the future information flow in the blog community.
SSRN Electronic JournalWeb Science 2.0: Identifying Trends Through Semantic Social Network Analysis
22 Citations2008Peter A. Gloor, Jonas Krauß +3 more
The information diffusion model in the blog world
19 Citations2009Yong-Suk Kwon, Sang‐Wook Kim +3 more
A new model is proposed that considers both the explicit and non-explicit relationships between blogs in order to explain the information diffusion phenomena in a blog network and improves the accuracy of the basic model by taking into account the degrees of diffusion powers of posts.
IEEE Internet ComputingMetrics For Monitoring A Social-Political Blogosphere: A Malaysian Case Study
17 Citations2010Brian Ulicny, Mieczyslaw M. Kokar +1 more
The authors' automated framework evaluating blog posts in a social-political blogosphere and, by aggregation, entire blogs according to their relevance, specificity, timeliness, and credibility are superior to current methods in information retrieval for blogs.
IEEE Transactions on MultimediaiOLAP: A Framework for Analyzing the Internet, Social Networks, and Other Networked Data
15 Citations2009Yün Chi, Shenghuo Zhu +3 more
This paper proposes a framework, iOLAP, that offers functionalities for analyzing networked data from Internet, social networks, scientific paper citations, etc and presents an efficient implementation of the algorithm that takes advantage of the sparseness of data and has time complexity linear in the number of data records in a dataset.
Netography: Rich insights from online research
15 Citations2005Roy Langer, Suzanne C. Beckmann
Citation Analysis: An Approach for Facilitating the Understanding and the Analysis of Regulatory Compliance Documents
14 Citations2009Abdelwahab Hamou‐Lhadj, Mohammad Hamdaqa
This paper proposes a technique called citation analysis that aims at helping users to understand and analyze regulatory documents in an efficient manner based on the exploration of citation graphs extracted from regulatory documents.
Lecture notes in computer scienceConvergence of Influential Bloggers for Topic Discovery in the Blogosphere
12 Citations2010Shamanth Kumar, Reza Zafarani +3 more
A novel approach to automatically detect “hot” or important topics of discussion in the blogosphere based on analyzing the activity of influential bloggers to determine specific points in time when there is a convergence amongst the influential bloggers in terms of their topic of discussion.
Connecting Sparsely Distributed Similar Bloggers
11 Citations2009Nitin Agarwal, Huan Liu +3 more
The problem of aggregating similar bloggers presents challenges that demand novel algorithms of connecting the non-adjacent due to the fragmented distributions of bloggers, and an approach is presented that uses innovative ways to employ contextual information and collective wisdom to aggregate similar bloggers.
Crush It!: Why NOW Is the Time to Cash In on Your Passion
7 Citations2009Gary Vaynerchuk
Folksonomy for the Blogosphere: Blog Identification and Classification
6 Citations2009Bai Rujiang, Xiaoyue Wang +1 more
Experimental results indicate the FSVMC, a new classification method named Folksonomy and support vector machine classifier, is more flexible and effective than traditional methods.
Mining social media communities and content
6 Citations2008Tim Finin, Akshay Java
This thesis presents a systematic study of the social media landscape through the combined analysis of its special properties, structure and content, and finds that microblogging provides users with a more immediate form of communication to talk about their daily activities and to seek or share information.
Temporal Issue Trend Identifications in Blogs
5 Citations2009Il‐Chul Moon, Youngmin Kim +2 more
A new metric of selecting topic words is suggested and it is expected that this metric and the source grouping methods will be developed to a new topic analysis framework of a large blog corpus.
Synthesis lectures on data mining and knowledge discoveryModeling Blogosphere
5 Citations2009Nitin Agarwal, Huan Liu
An empirical study of knowledge collaboration networks in virtual community: Based on wiki
3 Citations2009Jun Wang, Xin Jin +1 more
The analysis indicates that wiki-based knowledge collaboration network is a type of BA scale-free network which obeys power-law distribution and this network is characterized with higher stable clustering coefficient and smaller average distance, thus present obvious small-world effect.
Complex Network Property Analysis of Knowledge Cooperation Networks
2 Citations2009Liu Zhiyang, Lu Liu
The concepts of average path length, clustering coefficient and degree distribution were firstly introduced into knowledge cooperation networks, and the property of complex network mapping fromknowledge cooperation networks was studied.