Tools for the Analysis of the Accuracy of Software Reliability Predictions
Published 1 January 1986
Bev Littlewood, A. A. Abdel Ghaly, P. Y. Chan
Citations22
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown that this approach can point the way towards more accurate prediction via models which learn from past behaviour.
Abstract
Different software reliability models can produce very different answers when called upon to predict future reliability in a reliability growth context. Users need to know which, if any, of the competing predictions are trustworthy. Some techniques are presented which form the basis of a partial solution to this problem. In addition, it is shown that this approach can point the way towards more accurate prediction via models which learn from past behaviour.
Keywords
Computer ScienceEngineering
Journal of the Royal Statistical Society Series D (The Statistician)The Statistical Analysis of Series of Events.
1,893 Citations1966A. Huitson, D. R. Cox +1 more
IEEE Transactions on ReliabilityTime-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures
1,840 Citations1979Amrit L. Goel, Kazu Okumoto
The failure process is analyzed to develop a suitable meanvalue function for the NHPP to create a stochastic model for the software failure phenomenon based on a nonhomogeneous Poisson process.
Elsevier eBooksSOFTWARE RELIABILITY RESEARCH
1,051 Citations1972Z. Jelinski, P. B. Moranda
The chapter describes the means of predicting mission success on the basis of errors which occur during testing and describes the problems in categorizing software anomalies.
Cambridge University Press eBooksStatistical Prediction Analysis
838 Citations1975J. Aitchison, I. R. Dunsmore
This paper presents a meta-modelling procedure that automates the very labor-intensive and therefore time-heavy and expensive and expensive process of manually cataloging and forecasting the distribution of distributions in a discrete-time manner.
IEEE Transactions on AerospaceLearning Curve Approach to Reliability Monitoring
633 Citations1964J. T. Duane
IEEE Transactions on Software EngineeringA theory of software reliability and its application
558 Citations1975Donald Musa
The reliability model that has been developed can be used in making system tradeoffs involving software or software and hardware components and provides a soundly based unit of measure for the comparative evaluation of various programming techniques that are expected to enhance reliability.
Journal of the American Statistical AssociationThe Well-Calibrated Bayesian
548 Citations1982A. P. Dawid
Journal of the Royal Statistical Society Series C (Applied Statistics)A Bayesian Reliability Growth Model for Computer Software
457 Citations1973Bev Littlewood, J. L. Verrall
A Bayesian reliability growth model is presented which includes special features designed to reproduce special properties of the growth in reliability of an item of computer software (program).
IBM Journal of Research and DevelopmentOptimizing Preventive Service of Software Products
374 Citations1984E. N. Adams
It is found that most of the benefit to be realized by preventive service comes from removing a relatively small number of high-rate defects that are found early in the service life of the code.
Prediction and Entropy
360 Citations1985Hirotugu Akaike
The emergence of the magic number 2 in recent statistical literature is explained by adopting the predictive point of view of statistics with entropy as the basic criterion of the goodness of a fitted model.
Elsevier eBooksStatistical Computer Performance Evaluation
334 Citations1972
An annotated bibliography of all reports published under these contracts, with supplementary remarks, is presented.
IEEE Transactions on ReliabilityStochastic Reliability-Growth: A Model for Fault-Removal in Computer-Programs and Hardware-Designs
234 Citations1981Bev Littlewood
The suggested model results in earlier fault-fixes having a greater effect than later ones, the faults which make the greatest contribution to the overall failure rate tend to show themselves earlier, and the DFR property between fault fixes being fixed earlier.
IEEE Transactions on Software EngineeringExponential order statistic models of software reliability growth
197 Citations1986Douglas R. Miller
Failure times of a software reliability growth process are modeled as order statistics of independent, nonidentically distributed exponential random variables.
IEEE Transactions on Software EngineeringDependability Evaluation of Software Systems in Operation
149 Citations1984Jean-Claude Laprie
An approximate model is derived which enables one to account for the failures due to the design faults in a simple way when evaluating a system's dependability.
Journal of the American Statistical AssociationThe Well-Calibrated Bayesian
144 Citations1982A. P. Dawid
Journal of the American Statistical AssociationAn Empirical Stopping Rule for Debugging and Testing Computer Software
114 Citations1977Ernest H. Forman, Nozer D. Singpurwalla
The problem of computer software reliability is introduced and a probabilistic model for describing the failure of software is discussed and a procedure for estimating the parameters of the model and a stopping rule for debugging the software is proposed.
IEEE Transactions on ReliabilityHow to Measure Software Reliability and How Not To
92 Citations1979Bev Littlewood
The paper criticises the underlying assumptions which have been made in much early modeling of computer software reliability and recommends a Bayesian approach, which will improve modeling.
Journal of the American Statistical AssociationEstimating the Number of Faults in a System
74 Citations1985Harry Joe, Nancy Reid
IEEE Transactions on ReliabilityLikelihood Function of a Debugging Model for Computer Software Reliability
73 Citations1981Bev Littlewood, J. L. Verrall
A simple, necessary and sufficient condition for the maximum likelihood estimates to be finite is presented and it is suggested that this condition be tested prior to using the model.
Confidence Interval Procedures for Reliability Growth Analysis
36 Citations1977Larry H. Crow
Journal of the American Statistical AssociationEstimating the Number of Faults in a System
32 Citations1985Harry Joe, Nancy Reid
NASA STI Repository (National Aeronautics and Space Administration)A Bayesian modification to the Jelinski-Moranda software reliability growth model
27 CitationsLittlewood, B., Sofer, A.
On the Quality of Software Reliability Prediction
25 Citations1983Peter A. Keiller, Bev Littlewood +2 more
It is suggested that users are interested solely in the quality of predictions which can be obtained from software reliability models and some predictions are extremely poor: notably those arising from ML analysis of the Jelinski-Moranda model.
Defense Technical Information Center (DTIC)A Comparative Study of Models for Reliability Growth
4 Citations1977Henry Braun, Paine, J. Macon
The deterministic Duane Model as well as several stochastic models for reliability growth are studied and the possibility of employing doubly stochastically Poisson Processes is discussed.