Science and substance: a challenge to software engineers
IEEE SoftwarePublished 1 July 1994
Norman Fenton, Shari Lawrence Pfleeger, Robert L. Glass
Citations269
SJR quartileQ2
SJR score0.56
SNIP1.10
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work suggests several ways to address the problem of software development and maintenance with new practices whose effectiveness is rarely, if ever, backed up by hard evidence.
Abstract
For 25 years, software researchers have proposed improving software development and maintenance with new practices whose effectiveness is rarely, if ever, backed up by hard evidence. We suggest several ways to address the problem, and we challenge the community to invest in being more scientific.>
Keywords
Computer Science
IEEE Transactions on Software EngineeringExperimentation in software engineering
554 Citations1986Victor R. Basili, Richard W. Selby +1 more
A framework is presented for analyzing most of the experimental work performed in software engineering over the past several years, corresponding to phases of the experimentation process: definition, planning, operation, and interpretation.
IBM Journal of Research and DevelopmentOptimizing Preventive Service of Software Products
374 Citations1984E. N. Adams
It is found that most of the benefit to be realized by preventive service comes from removing a relatively small number of high-rate defects that are found early in the service life of the code.
Information and Software TechnologyPractical software metrics for project management and process improvement
355 Citations1993Martin Shepperd
Communications of the ACMCognitive strategies and looping constructs
335 Citations1983Elliot Soloway, Jeffrey Bonar +1 more
This work was supported by the Army Research Institute for the Behavioral and Social Sciences and the National Science Foundation under NSF Grant SED-81-12403.
Communications of the ACMExperimental investigations of the utility of detailed flowcharts in programming
228 Citations1977Ben Shneiderman, Richard E. Mayer +2 more
No statistically significant difference between flowchart and nonflowchart groups has been shown, thereby calling into question the utility of detailed flowcharting.
Communications of the ACMRequirements specification
210 Citations1994Iris Vessey, Sue Conger
An exploratory study is conducted to investigate the performance of three methodologies in aiding novice systems analysts who were learning to specify information requirements and the structured techniques and JSD were investigated.
IEEE SoftwareStructured flowcharts outperform pseudocode: an experimental comparison
158 Citations1989David A. Scanlan
The author describes an experiment that he designed to find out if real differences in comprehension exist between structured flowcharts and pseudocode when used to describe conditional logic, and results strongly indicate that structuredflowcharts do indeed aid algorithm comprehension.
Communications of the ACMSystem structure and software maintenance performance
140 Citations1989Virginia R. Gibson, James A. Senn
Results indicate that system improvements lead to decreased total maintenance time and decreased frequency of ripple effect errors, which suggests that improving old systems may be worthwhile and may yield benefits over the remaining life of the system.
Human Factors The Journal of the Human Factors and Ergonomics SocietyGoals and Performance in Computer Programming
103 Citations1974Gerald M. Weinberg, Edward L. Schulman
Experiments are reported which show how programming performance can be strongly influenced by slight differences in performing objectives.
Lecture notes in computer scienceCICS project report experiences and results from the use of Z in IBM
70 Citations1991Iain Houston, Steve King
Experiences and results arising from the use of Z in two major projects at the Hursley Park laboratory of IBM 1 United Kingdom Laboratories Ltd, concerning the formal specification of the CICS Application Programming Interface (API) and the description of an already existing interface.
IEEE Transactions on Software EngineeringResearch on Structured Programming: An Empiricist's Evaluation
64 Citations1984Iris Vessey, Ron Weber
The empirical studies that have been undertaken are reviewed and critiques them from the viewpoints of the soundness of their methodology and their ability to contribute to scientific understanding.
IEEE SoftwareEstimating size and effort in fourth-generation development
53 Citations1988June Verner, Graham Tate
The authors report on the building of an information system for a correspondence school with both many students and many types of students, for which they recommended a fourth-generation-language approach.
Observations on industrial practice using formal methods
31 Citations1993Susan L. Gerhart, Dan Craigen +1 more
IEEE SoftwareThird-generation versus fourth-generation software development
26 Citations1988SK Misra, Paul J. Jalics
A case study examines how fourth-generation languages do well and how they come up short compared to their predecessors and found that even though the code sizes were smaller with both fourth- Generation tools, Cobol was clearly superior in performance.
The Computer JournalUnderstanding Turing's Universal Machine — Personal Style in Program Description
24 Citations1993Peter Naur
Observations on industrial practice using formal methods
22 Citations2002S. Gerhart, Dan Craigen +1 more
The authors summarize observations on their use in a dozen applications in industrial settings using a structured interview process and analysis of results using a set of features covering various aspects of practice: process, methods, tools, and technology transfer.
Journal of Systems and SoftwareImpacts of object-oriented technologies: Seven years of software engineering
11 Citations1993Mike Stark
The evolution of the use of OOT in the Sel “Experience Factory” is described in terms of the SEL's original expectations, focusing on how successive generations of projects have used OOT.
Communications of the ACMAn experimental analysis of the performance of fourth generation tools on PCs
10 Citations1989Victor Matos, Paul J. Jalics
A set of performance benchmarks consisting of thirteen separate functions is presented which encompasses the areas of simulating the operators of the relational algebra, accessing records in the database, and updating the database.
ComputerThe Effect of Abstract Data Types on Program Development
5 Citations1987Mitchell, Urban +1 more
It is found that the source instructions, in the specification language, for an average program developed with automated implementation of abstract data types, is about 80 percent shorter than the source code required for manually implementing an abstract data type.
WIT transactions on information and communication technologiesExperimentation In Software Engineering: ANew Framework
5 Citations1970W.E.A. Mohamed, C.J. Sadler +1 more
The paper presents a new framework for conducting formal experiments in a software engineering environment and discusses how managerial and sociological issues can affect formal experimentation in software engineering.