Empirical validation of object-oriented metrics on open source software for fault prediction
IEEE Transactions on Software EngineeringPublished 1 October 2005
Tibor Gyimóthy, Rudolf Ferenć, István Siket
Citations901
SJR quartileQ1
SJR score1.45
SNIP2.43
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper calculated the object-oriented metrics given by Chidamber and Kemerer to illustrate how fault-proneness detection of the source code of the open source Web and e-mail suite called Mozilla can be carried out and checked the values obtained against the number of bugs found in its bug database to validate the usefulness of these metrics for fault- proneness prediction.
Abstract
Open source software systems are becoming increasingly important these days. Many companies are investing in open source projects and lots of them are also using such software in their own work. But, because open source software is often developed with a different management style than the industrial ones, the quality and reliability of the code needs to be studied. Hence, the characteristics of the source code of these projects need to be measured to obtain more information about it. This paper describes how we calculated the object-oriented metrics given by Chidamber and Kemerer to illustrate how fault-proneness detection of the source code of the open source Web and e-mail suite called Mozilla can be carried out. We checked the values obtained against the number of bugs found in its bug database - called Bugzilla - using regression and machine learning methods to validate the usefulness of these metrics for fault-proneness prediction. We also compared the metrics of several versions of Mozilla to see how the predicted fault-proneness of the software system changed during its development cycle.
Keywords
Computer Science
C4.5: Programs for Machine Learning
23,665 Citations1992J. R. Quinlan
A complete guide to the C4.5 system as implemented in C for the UNIX environment, which starts from simple core learning methods and shows how they can be elaborated and extended to deal with typical problems such as missing data and over hitting.
Choice Reviews OnlineNeural networks for pattern recognition
18,687 Citations1994
This is the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition, and is designed as a text, with over 100 exercises, to benefit anyone involved in the fields of neural computation and pattern recognition.
Neural Networks for Pattern Recognition
12,198 Citations1995Chris Bishop
Programs for Machine Learning
5,794 Citations1994Steven L. Salzberg, Alberto M. Segre
In his new book, C4.5: Programs for Machine Learning, Quinlan has put together a definitive, much needed description of his complete system, including the latest developments, which will be a welcome addition to the library of many researchers and students.
IEEE Transactions on Software EngineeringA metrics suite for object oriented design
5,664 Citations1994Shyam R. Chidamber, Chris F. Kemerer
This research addresses the needs for software measures in object-orientation design through the development and implementation of a new suite of metrics for OO design, and suggests ways in which managers may use these metrics for process improvement.
IEEE Transactions on Software EngineeringA validation of object-oriented design metrics as quality indicators
1,701 Citations1996Victor R. Basili, Lionel Briand +1 more
Several of Chidamber and Kemerer's 00 metrics appear to be adequate to predict class fault-proneness during the early phases of the life-cycle, and are, on the data set, better predictors than "traditional" code metrics, which can only be collected at a later phase of the software development processes.
Journal of Systems and SoftwareExploring the relationships between design measures and software quality in object-oriented systems
702 Citations2000Lionel Briand, Jürgen Wüst +2 more
It is shown that by using a subset of measures, accurate models can be built to predict which classes most of the faults are likely to lie in, and the best model shows a percentage of correct classifications higher than 80% and finds more than 90% of faulty classes.
IEEE Transactions on Software EngineeringEmpirical analysis of CK metrics for object-oriented design complexity: implications for software defects
671 Citations2003Ramanath Subramanyam, Mayuram S. Krishnan
Empirical evidence is provided supporting the role of OO design complexity metrics, specifically a subset of the Chidamber and Kemerer (1991, 1994) suite (CK metrics), in determining software defects, and indicates that these metrics are significantly associated with defects.
IEEE Transactions on Software EngineeringAssessing the applicability of fault-proneness models across object-oriented software projects
348 Citations2002Lionel Briand, Walcélio L. Melo +1 more
A general but tailorable cost-benefit model is devised and the use of a novel exploratory analysis technique - MARS (multivariate adaptive regression splines) to build such fault-proneness models, which indicate that a model built on one system can be accurately used to rank classes within another system according to their fault proneness.
IBM Systems JournalThe software bookshelf
206 Citations1997P. J. Finnigan, Richard C. Holt +8 more
This paper introduces the concept of a software bookshelf as a means to capture, organize, and manage information about a legacy software system and illustrates how a softwareBookshelf is populated with the information of a given software project and how the bookshe shelf can be used in a program-understanding scenario.
Columbus - reverse engineering tool and schema for C++
186 Citations2003Rudolf Ferenć, Árpád Beszédes +2 more
A reverse engineering framework called Columbus that is able to analyze large C++ projects, and a schema for C++ that prescribes the form of the extracted data is presented.
Advances in computersEmpirical Studies of Quality Models in Object-Oriented Systems
173 Citations2002Lionel Briand, Jürgen Wüst
This chapter’s objective is to summarize, in a structured and detailed fashion, the empirical results reported so far with modeling external system quality based on structural design properties in object-oriented systems.
Predicting fault-proneness using OO metrics. An industrial case study
165 Citations2003Ping Yu, Tarja Systä +1 more
A set of object-oriented metrics in terms of their usefulness in predicting fault-proneness, an important software quality indicator, are empirically validated using two data analysis techniques: regression analysis and discriminant analysis.
Secrets from the Monster: Extracting Mozilla’s Software Architecture
94 Citations2000Michael W. Godfrey, Eric H. S. Lee
This paper describes how it successfully integrated the Acacia C and C++ fact extractors into the PBS system, and how it was then able to create software architecture models for two large software systems: the Mozilla web browser and the VIM text editor.
An Overview of the Software Engineering Process and Tools in the Mozilla Project
92 Citations2002Christian Robottom Reis, Rodolfo Cruz
The software engineering aspect of a large Open Source project is described and the software engineering tools used in the Mozilla Project are covered, since the Mozilla process and tools are intimately related.
IEEE Transactions on Software EngineeringA C++ data model supporting reachability analysis and dead code detection
81 Citations1998Yih-Fam Chen, Emden R. Gansner +1 more
The design rationales behind a data model for a C++ software repository that supports reachability analysis and dead code detection at the declaration level are examined and how future software repositories can be evaluated for completeness at a selected abstraction level is illustrated.
Extracting facts from open source software
72 Citations2004Rudolf Ferenć, István Siket +1 more
A framework called Columbus is described with which the object oriented metrics validated by Basili et al. are calculated for illustrating how fault-proneness detection from the open source Web and e-mail suite called Mozilla can be done.
A study on fault-proneness detection of object-oriented systems
54 Citations2003Fabrizio Fioravanti, Paolo Nesi
A compromise between these aspects and the classification correctness of faulty and non-faulty classes was the main challenge of the research and two models for fault-proneness class detection have been obtained and validated.
Data exchange with the columbus schema for c++
42 Citations2003Rudolf Ferenć, Árpád Beszédes
A modular schema for C++, called the Columbus schema, is proposed, which has been implemented in the Columbus/CAN front end framework tool and is already utilized in several usages, one of which is its representation in the GXL form.
International Conference on Software MaintenanceColumbus - Reverse Engineering Tool and Schema for C++
35 Citations2002Beszé
A reverse engineering framework called Columbus that is able to analyze large C++ projects, and a schema for C++ that prescribes the form of the extracteddata is presented.