Mining Technology Landscape from Stack Overflow
Published 8 September 2016
Chunyang Chen, Zhenchang Xing
Citations55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The empirical study shows that the mined TAN captures a wide range of technologies, the complex relationships among the technologies, and the trend of the technologies in the developers' discussions on Stack Overflow.
Abstract
The sheer number of available technologies and the complex relationships among them make it challenging to choose the right technologies for software projects. Developers often turn to online resources (e.g., expert articles and community answers) to get a good understanding of the technology landscape. Such online resources are primarily opinion-based and are often out of date. Furthermore, information is often scattered in many online resources, which has to be aggregated to have a big picture of the technology landscape. In this paper, we exploit the fact that Stack Overflow users tag their questions with the main technologies that the questions revolve around, and develop association rule mining and community detection techniques to mine technology landscape from Stack Overflow question tags. The mined technology landscape is represented in a graphical Technology Associative Network (TAN). Our empirical study shows that the mined TAN captures a wide range of technologies, the complex relationships among the technologies, and the trend of the technologies in the developers' discussions on Stack Overflow. We develop a website (https://graphofknowledge.appspot.com/) for the community to access and evaluate the mined technology landscape. The website visit statistics by Google Analytics shows the developers' general interests in our technology landscape service. We also report a small-scale user study to evaluate the potential usefulness of our tool.
Keywords
Computer SciencePhysics and Astronomy
Journal of Statistical Mechanics Theory and ExperimentFast unfolding of communities in large networks
21,223 Citations2008Vincent D. Blondel, Jean‐Loup Guillaume +2 more
This work proposes a heuristic method that is shown to outperform all other known community detection methods in terms of computation time and the quality of the communities detected is very good, as measured by the so-called modularity.
Proceedings of the International AAAI Conference on Web and Social MediaGephi: An Open Source Software for Exploring and Manipulating Networks
11,305 Citations2009Mathieu Bastian, Sébastien Heymann +1 more
This work presents several key features of Gephi in the context of interactive exploration and interpretation of networks, and highlights key aspects of dynamic network visualization.
PLoS ONEForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software
2,836 Citations2014Mathieu Jacomy, Tommaso Venturini +2 more
ForceAtlas2 is a force-directed layout close to other algorithms used for network spatialization, designed for the Gephi user experience, and proposed for the first time as a benchmark for the compromise between performance and quality.
ACM Transactions on Programming Languages and SystemsThe program dependence graph and its use in optimization
2,745 Citations1987Jeanne Ferrante, Karl J. Ottenstein +1 more
An intermediate program representation, called the program dependence graph (PDG), that makes explicit both the data and control dependences for each operation in a program, allowing transformations to be triggered by one another and applied only to affected dependences.
IEEE Transactions on Knowledge and Data EngineeringThe Google Similarity Distance
1,764 Citations2007Rudi Cilibrasi, Paul Vitányi
A new theory of similarity between words and phrases based on information distance and Kolmogorov complexity is presented, which is applied to construct a method to automatically extract similarity, the Google similarity distance, of Words and phrases from the WWW using Google page counts.
Empirical Software EngineeringWhat are developers talking about? An analysis of topics and trends in Stack Overflow
613 Citations2012Anton Barua, Stephen W. Thomas +1 more
This article uses latent Dirichlet allocation (LDA), a statistical topic modeling technique, to automatically discover the main topics present in developer discussions of Stack Overflow and analyzes these discovered topics, as well as their relationships and trends over time, to gain insights into the development community.
Deriving concept hierarchies from text
613 Citations1999Mark Sanderson, Bruce Croft
This paper presents a means of automatically deriving a hierarchical organization of concepts from a set of documents without use of training data or standard clustering techniques, using a type of co-occurrence known as subsumption.
The complex dynamics of collaborative tagging
611 Citations2007Harry Halpin, Valentin Robu +1 more
A generative model of collaborative tagging is produced in order to understand the basic dynamics behind tagging, including how a power law distribution of tags could arise and how tag co-occurrence networks for a sample domain of tags can be used to analyze the meaning of particular tags given their relationship to other tags.
Pearson Higher Education eBooksUnified Modeling Language Reference Manual, The (2nd Edition)
574 Citations2004James Rumbaugh, Ivar Jacobson +1 more
In this significantly updated and expanded edition of the definitive reference to the standard, James Rumbaugh, Ivar Jacobson, and Grady Booch clearly and completely describe UML concepts, including major revisions to sequence diagrams, activity models, state machines, components, internal structure of classes and components, and profiles.
IEEE Transactions on Visualization and Computer GraphicsParticipatory Visualization with Wordle
408 Citations2009Fernanda Viégas, Martin Wattenberg +1 more
The design and usage of Wordle are discussed, and the results suggest that Wordles have become a kind of medium of expression, and that a ldquoparticipatory culturerdquo has arisen around them.
International Journal on Semantic Web and Information SystemsOntology of Folksonomy
354 Citations2007Thomas Gruber
This article is an attempt to clarify the distinct roles for ontologies and folksonomies, and preview some new work that applies the two ideas together—an ontology of folk-sonomy.
Empirical Software EngineeringWhat are mobile developers asking about? A large scale study using stack overflow
311 Citations2015Christoffer Rosen, Emad Shihab
This paper uses data from the popular online Q&A site, Stack Overflow, and analyze 13,232,821 posts to examine what mobile developers ask about, and establishes a novel approach for analyzing questions asked onQ&A forums.
Inducing Ontology from Flickr Tags
307 Citations2006Patrick Schmitz
A revised, probabilistic model using seed ontologies to induce faceted ontology, and how the model can integrate into the logistics of tagging communities is proposed.
What makes a good code example?: A study of programming Q&A in StackOverflow
290 Citations2012Seyed Mehdi Nasehi, Jonathan Sillito +2 more
A qualitative analysis of the questions and answers posted to a programming Q&A web site called StackOverflow identified haracteristics of effective examples and found that the explanations acompanying examples are as important as the examples themselves.
Library ReviewCollaborative tagging as a knowledge organisation and resource discovery tool
269 Citations2006George Macgregor, Emma McCulloch
There are numerous difficulties with collaborative tagging systems that originate from the absence of properties that characterise controlled vocabularies, but such systems can not be dismissed.
ACM Transactions on the WebEmergence of consensus and shared vocabularies in collaborative tagging systems
135 Citations2009Valentin Robu, Harry Halpin +1 more
It is shown that final tag frequencies for most resources converge to power law distributions and an empirical method is proposed to examine the dynamics of the convergence process, based on the Kullback-Leibler divergence measure.
Using Google distance to weight approximate ontology matches
129 Citations2007Risto Gligorov, Warner ten Kate +2 more
The method makes use of the huge amount of knowledge that is implicit in the current Web, and exploits this knowledge as a heuristic for establishing approximate mappings between ill-defined concepts.
Shared waypoints and social tagging to support collaboration in software development
109 Citations2006Margaret‐Anne Storey, Li-Te Cheng +2 more
The conceptual design of TagSEA is presented, a collaborative tool to support asynchronous software development to develop a lightweight source code annotation tool that enhances navigation, coordination, and capture of knowledge relevant to a software development team.
How tagging helps bridge the gap between social and technical aspects in software development
93 Citations2009Christoph Treude, Margaret‐Anne Storey
The research shows that the tagging mechanism was eagerly adopted by the team, and that it has become a significant part of many informal processes, indicating that lightweight informal tool support, prevalent in the social computing domain, may play an important role in improving team-based software development practices.
Automated construction of a software-specific word similarity database
86 Citations2014Yuan Tian, David Lo +1 more
An automated approach is proposed that builds a software-specific WordNet like resource, named WordSimSEDB, by leveraging the textual contents of posts in StackOverflow by computing the similarities of the weighted co-occurrences of these words with three types of words in the textual corpus.
Inferring semantically related words from software context
75 Citations2014Jinqiu Yang, Lin Tan
Mining Analogical Libraries in Q&A Discussions -- Incorporating Relational and Categorical Knowledge into Word Embedding
66 Citations2016Chunyang Chen, Sa Gao +1 more
The novelty of the approach is to solve analogical-libraries questions by combining state-of-the-art word embedding technique and domain-specific relational and categorical knowledge mined from Stack Overflow.
Inferring semantically related software terms and their taxonomy by leveraging collaborative tagging
57 Citations2012Shaowei Wang, David Lo +1 more
A similarity metric to infer semantically related terms, each of which is a tag, is proposed and a taxonomy that could further describe the relationships among these terms is built, which is reasonably good.
Pragmatic evaluation of folksonomies
44 Citations2011Denis Helić, Markus Strohmaier +3 more
This paper presents and applies a pragmatic framework for evaluating folksonomies, and model exploratory navigation of a tagging system as decentralized search on a network of tags, to use hierarchical structures learned by folksonomy algorithm as background knowledge for decentralized search.
Empirical Software EngineeringExtracting and analyzing time-series HCI data from screen-captured task videos
34 Citations2016Lingfeng Bao, Jing Li +4 more
A formative study to understand the challenges in manually transcribing screen-captured videos into time-series HCI data, and a computer-vision based video scraping technique to automatically extract time- series HCIData from screen- Captured videos.
Proceedings of the International AAAI Conference on Web and Social MediaClustering Tags in Enterprise and Web Folksonomies
33 Citations2021Edwin Simpson
Two clustering algorithms are presented that improve organizational structure by organizing tags automatically by applying them to two very different datasets, visualize the results and propose future improvements.
Towards Correlating Search on Google and Asking on Stack Overflow
28 Citations2016Chunyang Chen, Zhenchang Xing
The empirical study investigates the correlations of the 185 popular technical terms developers search on Google and ask on Stack Overflow using search statistics obtained from Google Trends over a 574-weeks span and question statistics derived from Stack overflow Data Dump over a 300-the authors weeks span and shows that technical terms searched and asked have strong correlation over time.