An evaluation of Delphi
Technological Forecasting and Social ChangePublished 1 September 1991
Fred Woudenberg
Citations511
SJR quartileQ1
SJR score3.47
SNIP3.25
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
The literature concerning quantitative applications of the Delphi method is reviewed. No evidence was found to support the view that Delphi is more accurate than other judgment methods or that consensus in a Delphi is achieved by dissemination of information to all participants. Existing data suggest that consensus is achieved mainly by group pressure to conformity, mediated by the statistical group response that is fed back to all participants.
Keywords
PsychologySocial Sciences
Judgment under Uncertainty: Heuristics and Biases
23,088 Citations1975Amos Tversky, Daniel Kahneman
Management ScienceAn Experimental Application of the DELPHI Method to the Use of Experts
6,017 Citations1963Norman C. Dalkey, Olaf Helmer
Technological forecasting for decision making
792 Citations1972Joseph P. Martino
This book describes methods for estimating the future performance of a new technology, or the likely extent of its use, and explains how to apply them in specific situations and how to avoid common pitfalls.
FuturesAn experimental study of group opinion
738 Citations1969Norman C. Dalkey
This report describes the results of an extensive set of experiments, conducted at RAND, concerned with evaluating the effectiveness of the Delphi procedures for formulating group judgements.
Academy of Management JournalThe Effectiveness of Nominal, Delphi, and Interacting Group Decision Making Processes.
694 Citations1974Aplicación De, A. L. Delbecq
Psychological ReviewGroup decision and social interaction: A theory of social decision schemes.
690 Citations1973James H. Davis
Socio-Economic Planning SciencesThe Delphi method: Substance, context, a critique and an annotated bibliography
573 Citations1971Juri Pill
The methodology and its historical development are described, it is placed in context vis-a-vis other methods of subjective scaling, and a critique is provided.
Journal of the American Statistical AssociationCognitive Processes and the Assessment of Subjective Probability Distributions
407 Citations1975Robin M. Hogarth
Organizational Behavior and Human PerformanceA comparative study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups, and nominal groups
385 Citations1973David H. Gustafson, Ramesh K. Shukla +2 more
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)ANALYSIS OF THE FUTURE: THE DELPHI METHOD
379 Citations1967Olaf Helmer
The Delphi technique, in its simplest form, eliminates committee activity among the experts altogether and replaces it with a carefully designed program of sequential individual interrogations interspersed with information and opinion feedback.
RAND Corporation eBooksREPORT ON A LONG-RANGE FORECASTING STUDY,
316 Citations1964Theodore J. Gordon, Olaf Helmer
An experimental trend-predicting exercise covering a period extending as far as fifty years into the future, using a sequence of questionnaires to elicit predictions from individual experts in six broad areas: scientific breakthroughs, population growth, automation, space progress, probability and prevention of war, and future weapon systems.
Technological Forecasting and Social ChangeForecasting: An appraisal for policy-makers and planners
298 Citations1979
Technological Forecasting and Social ChangeThe methodological worth of the Delphi forecasting technique
281 Citations1975Kim Hill, Jib Fowles
Psychological BulletinQuality of group judgment.
272 Citations1977Hillel J. Einhorn, Robin M. Hogarth +1 more
International Journal of ForecastingLong-range forecasting: From crystal ball to computer
258 Citations1986Steven P. Schnaars
Organizational Behavior and Human PerformanceProbabilistic forecasting: An experiment related to the stock market
250 Citations1972Carl-Axel S. Staël von Holstein
An attempt to tie an experiment to a “practical” situation involving the development of buying prices on the Stock Exchange and the results confirm that people can quantify their beliefs reasonably well in probabilistic terms.
Organizational Behavior and Human PerformanceImproving the quality of group judgment: Social judgment analysis and the Delphi technique
163 Citations1979John Rohrbaugh
Technological Forecasting and Social ChangeParticipants' response to the Delphi method: An attitudinal perspective
151 Citations1984Michal Bardecki
Management ScienceGroup Confidence Pressures in Iterative Decisions
120 Citations1982David M. Bøje, J. Keith Murnighan
Decision SciencesMETHODS FOR QUANTIFYING SUBJECTIVE PROBABILITIES AND MULTI‐ATTRIBUTE UTILITIES*†
120 Citations1974George P. Huber
These are the methods for eliciting subjective probabilities and multi-attribute utilities whose usefulness has been empirically studied and reported in the research literature and contains summary guidelines concerning the elicitation and use of such judgments.
Journal of Marketing ResearchThe Delphi Process in Marketing Decision Making
118 Citations1971Marvin A. Jolson, Gerald L. Rossow
A field experiment is described which uses the Delphi Process to assign subjective probabilities to the set of possible demand levels for a company's product.
Technological Forecasting and Social ChangeThe Delphi technique
113 Citations1983Walter E. Riggs
The results substantiate the claim that Delphi outperforms conference methods on the basis of accuracy for long-range forecasting.
Journal of ForecastingAn examination of factors contributing to delphi accuracy
109 Citations1984Frederick Parente, Janet K. Anderson +2 more
Three experiments examined the accuracy in the Delphi method and found that predictions derived from the group were more accurate than those of 95 per cent of the individual panelists, but did not exceed in accuracy the best panelists.
Group & Organization StudiesThe Delphi Technique: An Empirical Evaluation of the Optimal Number of Rounds
107 Citations1986Robert C. Erffmeyer, Elizabeth S. Erffmeyer +1 more
The results indicated that Delphi groups reached stability in their decision making after the fourth iteration, thereby providing empirical support for the length of the classic Delphi.
Public Opinion QuarterlyThe Prediction of Social and Technological Events
105 Citations1950Aleš Kaplan, A. L. Skogstad +1 more
Academy of Management JournalCommunications. PROBLEMS OF SELECTING EXPERTS FOR DELPHI EXERCISES.
87 Citations1972Gordon Welty
Technological Forecasting and Social ChangeMethods for analyzing data from Delphi panels: Some evidence from a forecasting study
81 Citations1987Thomas Dietz
Traditional assumptions about the proper methods for analyzing a Delphi study may be inappropriate, and the use of robust estimates of location as summaries of expert opinion yield better forecasts than nonrobust measures.
Organizational Behavior and Human PerformanceWhen oracles fail—A comparison of four procedures for aggregating subjective probability forecasts
80 Citations1981Gregory W. Fischer
Technological Forecasting and Social ChangeDelphi questionnaires versus individual and group interviews
77 Citations1990Jan van Dijk
RAND Corporation eBooksThe DELPHI Method, II: Structure of Experiments
70 Citations1969Brian Brown, S. W. Cochran +1 more
Technological Forecasting and Social ChangeEFTE: An interactive Delphi method
66 Citations1985Keith R. Nelms, Alan L. Porter
A new expert opinion technique is developed and applied to estimate the impact of information technologies on clerical work using EFTE, which offers advantages in obtaining expert opinions on complex tasks where social interaction poses little problem.
Management ScienceThe Use of the Delphi Procedures in Manpower Forecasting
64 Citations1972George T. Milkovich, Anthony J. Annoni +1 more
Group & Organization StudiesQuality and Acceptance of an Evaluative Task: The Effects of Four Group Decision-Making Formats
54 Citations1984Robert C. Erffmeyer, Irving M. Lane
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)Improving the Reliability of Estimates Obtained from a Consensus of Experts
52 Citations1964Bernice B. Brown, Olaf Helmer-Hirschberg
FuturesDelphic study examines developments in medicine
40 Citations1969A.Douglas Bender, Alvin E. Strack +2 more
This experiment with the Delphi forecasting technique correlates the opinions of experts about likely developments in the field of medicine with the results of an extramural Delphi survey.
Academy of Management JournalA Comparative Analysis of Three Diverse Group Decision Making Approaches.
40 Citations1979F. C. Miner
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)Assessing Probability with Multiple Individuals: Group Interaction Versus Mathematical Aggregation
36 Citations1979David A. Seaver
Developments in the Methodology of Social Science
36 Citations1974Werner Leinfellner, Eckehart Köhler
Technological Forecasting and Social ChangeShang inquiry as an alternative to Delphi: Some experimental findings
31 Citations1975David A. Ford
Findings indicate that Shang is generally superior to Delphi in producing accurate numerical estimates from the judgments of a group of experts.
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)PREDICTING THE FUTURE
28 Citations1968Norman C. Dalkey
The Journal of General PsychologyThe Reliability and Convergence of the Delphi Technique
27 Citations1978Fred Dagenais
Journal of the American Statistical AssociationQualitative Controlled Feedback for Forming Group Judgments and Making Decisions
27 Citations1978S. James Press
Technological Forecasting and Social ChangeDelphi: An investigation from a Bayesian viewpoint
26 Citations1975Devendra Sahal, King Yee
It is indicated that the tremendous potential of Bayesianized Delphi in appropriate situations has remained utapped and it is essential that conventional Delphi applications, at the very least, be accompanied by a Turoff-type cross impact analysis.
Technological Forecasting and Social ChangeIssues in large scale Delphi studies
26 Citations1974Vaughn Huckfeldt, Robert C. Judd
Climatic ChangeExpert judgment and climate forecasting: A methodological critique of ?climate change to the year 2000?
25 Citations1985Thomas R. Stewart, Michael H. Glantz
Technological Forecasting and Social ChangeStatistical manipulation of delphi statements: Its success and effects on convergence and stability
22 Citations1978Bradley W. Nelson
Socio-Economic Planning SciencesGoals-delphis for urban planning: Concepts in their design
22 Citations1973Margaret Skutsch, Joseph L. Schofer
Some of the major psychological forces operating in the Delphi process, particularly the influence of group pressure, are discussed, and the implications of these in terms of alternative internal designs are described.
Evaluation ReviewThe Relative Importance of Treatment Outcomes
20 Citations1982Austen Clark, Matthew J. Friedman
Improvement in client ability to be self-supporting was judged the most important outcome, with symptom reduction second, and Involvement with friends and substance abuse were judged the least important outcomes.
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)COST-EFFECTIVENESS: SOME TRENDS ANALYSIS
18 Citations1967E. S. Quade
Technological Forecasting and Social ChangeAn evaluation of the forecasting of information processing technology and applications
16 Citations1972Eugène M. Grabbe, Donald L. Pyke
Although the data are insufficient to provide conclusive evidence, the results suggest that information processing technology and applications are advancing more rapidly than predicted by the forecasts.
Long Range PlanningTechnological forecasting a criticism of the Delphi technique
10 Citations1969Robert Overbury
Improvements in the Delphi technique are suggested which would change it from an ad hoc method old crytal ball gazing into a system for continuous consultation among “responsible organizations”.
Technological Forecasting and Social ChangeAssimilation of aggregated inputs into Delphi forecasts: A regression analysis
10 Citations1973J.R. Salancik
The delphi forecasts of computer applications suggest that the computer application is forecasted to occur sooner to the extent it was judged to be technically feasible, beneficial to users or society, and not costly to develop.
Journal of the American Statistical AssociationQualitative Controlled Feedback for Forming Group Judgments and Making Decisions
8 Citations1978S. James Press
Technological Forecasting and Social ChangeA quantitative analytical methodology for judgmental and policy decisions
6 Citations1975William L. Brockhaus
The Necessity, Sufficiency and Desirability of Experts as Value Forecasters
6 Citations1974Gordon Welty
International Journal of EpidemiologyTowards a Dictionary of Epidemiological Terms
2 Citations1982John M. Last