Decision Quality, Confidence, and Commitment with Expert Systems: An Experimental Study
Journal of Public Administration Research and TheoryPublished 1 January 1997
David Landsbergen, David Coursey, Stephen Loveless, Ralph F. Shangraw
Citations44
SJR quartileQ1
SJR score3.45
SNIP3.14
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Among the findings: decision makers who utilized the ES made higher quality decisions but exhibited less confidence and commitment than did those who worked without an ES; decisionmaker involvement in the decision process corrected for this disparity.
Abstract
This experiment investigates the relationship between results produced by an expert system (ES), its physical structure and features, and the user's commitment and confidence in its solutions. One hundred one subjects among four MPA programs were asked to evaluate ten applicants for a government budget officer position. Among the findings: decision makers who utilized the ES made higher quality decisions but exhibited less confidence and commitment than did those who worked without an ES; decision-maker involvement in the decision process corrected for this disparity. We discuss the implications for ES design and future research.
Keywords
Computer ScienceDecision Sciences
Cambridge University Press eBooksProspect theory: An analysis of decision under risk
33,002 Citations1988Daniel Kahneman, Amos Tversky
Judgment under Uncertainty: Heuristics and Biases
23,088 Citations1975Amos Tversky, Daniel Kahneman
Macat Library eBooksA Theory of Cognitive Dissonance
18,338 Citations2017Léon Festinger, Alexander O’Connor
Organizational Behavior and Human PerformanceKnee-deep in the big muddy: a study of escalating commitment to a chosen course of action
2,060 Citations1976Barry M. Staw
Psychological BulletinAntecedent probability and the efficiency of psychometric signs, patterns, or cutting scores.
1,224 Citations1955Paul E. Meehl, Albert Rosen
The efficiency of the great majority of psychometric devices reported in the clinical psychology literature is difficult or impossible to evaluate for the following reasons:.
Journal of Consulting PsychologyOverconfidence in case-study judgments.
1,038 Citations1965Stuart Oskamp
This study investigated whether that increase in confidence in the psychologist's conclusions is justified by a corresponding increase in accuracy of conclusions, and found that the diagnostic confidence of experienced psychologists is less than that of less experienced persons.
The Social Animal
938 Citations1972Elliot Aronson
Academy of Management JournalVariations in Decision Makers' Use of Information Sources: The Impact of Quality and Accessibility of Information.
718 Citations1982Charles A. O’Reilly
Variations in the reported frequency of use of four information sources by decision makers was investigated, and the perceived quality of information available for decision making was related to this frequency.
CERN Document Server (European Organization for Nuclear Research)A Guide to Expert Systems
630 Citations1985D. A. Waterman
Management ScienceDecision Support System Effectiveness: A Review and an Empirical Test
435 Citations1988Ramesh Sharda, Steve H. Barr +1 more
Examination of the effectiveness of DSS-aided decision makers relative to decision makers without a DSS over an eight-week period found the groups with access to the DSS made significantly more effective decisions in the business simulation game than their non-DSS counterparts.
MIS QuarterlyComputer-Based Support for Group Problem-Finding: An Experimental Investigation1
424 Citations1988R. Brent Gallupe, Gerardine DeSanctis +1 more
Examination of the effects of group decision support systems (GDSS) technology on group decision quality and individual perceptions within a problem-finding context suggests that dissatisfaction maybe a stumbling block in user acceptance of these systems.
Administrative Science QuarterlyCommitment to a Policy Decision: A Multi-Theoretical Perspective
375 Citations1978Barry M. Staw, Jerry Ross
Human RelationsEscalation: The Determinants of Commitment to a Chosen Course of Action
301 Citations1977Barry M. Staw, Frederick V. Fox
Public Administration ReviewPublic Management Information Systems: Theory and Prescription
299 Citations1986Barry Bozeman, Stuart Bretschneider
The purposes of this paper are to provide an integrating theoretical framework for PMIS which focuses on the differences between public and private sector environments and to use the framework to develop prescriptive propositions forPMIS.
MIS QuarterlyThe Impact of Explanation Facilities on User Acceptance of Expert Systems Advice
295 Citations1995L. Richard Ye, Paul E. Johnson
The results indicate that explanation facilities can make ES-generated advice more acceptable to users and that justification is the most effective type of explanation to bring about changes in user attitudes toward the system.
IEEE Transactions on CommunicationsComputer Support for Group Versus Individual Decisions
291 Citations1982Murray Turoff, Starr Roxanne Hiltz
This paper gives several examples of computerized conferencing systems (CCS's) which have served as group decision support systems (DSS) and preliminary results are presented from a second controlled experiment which explored how a CCS may best be structured to serve as a group DSS for a specific type of managerial task.
MIS QuarterlyExploring the Factors Associated With Expert Systems Success
259 Citations1995Youngohc Yoon, Tor Guimãrães +1 more
This study identifies and empirically tests eight major variables proposed in the literature as determinants of ES success, in this case measured in terms of user satisfactions, and proposes several recommendations to enhance the likelihood of project success.
Academy of Management ReviewInformation, Cognitive Biases, and Commitment to a Course of Action
257 Citations1986Charles H. Schwenk
Choice Reviews OnlineRationality: a philosophical inquiry into the nature and the rationale of reason
244 Citations1989
MIS QuarterlyMethodological Issues in Experimental IS Research: Experiences and Recommendations
239 Citations1985Sirkka L. Järvenpää, Gary W. Dickson +1 more
Suggestions are offered to experimental IS researchers on how some of these common problems in experimental IS studies can be alleviated or even avoided, particularly in studies on the use of managerial graphics.
MIS QuarterlyProcess Tracing Methods in Decision Support Systems Research: Exploring the Black Box
228 Citations1987Peter Todd, Izak Benbasat
R Rationale is developed for why process tracing methods are an important addition to the inventory of methodologies available to researchers, stressing the need to explore the "black box" of decision processes.
Decision SciencesAN EMPIRICAL ASSESSMENT OF COMPUTER‐ASSISTED DECISION ANALYSIS*
198 Citations1986Ramon J. Aldag, Daniel Power
It is suggested that computerized decision aids should be adopted cautiously if such aids result in positive user affect and heightened decision confidence without corresponding improvements in decision quality, they may be dysfunctional.
IEEE Transactions on Systems Man and CyberneticsA Computer-Based Interactive System for Group Decisionmaking
188 Citations1981Randall Steeb, Steven C. Johnston
The rationale, design, and operation of the Perceptronics' Group Decision Aid, which is to guide the group decisionmaking process by selective elicitation of a decision tree which incorporates value and probability inputs from all group members, are described.
MIS QuarterlyEarly Expert Systems: Where Are They Now?
182 Citations1995T. Grandon Gill
An investigation exploring how the first wave of commercial expert systems, built during the early and mid-1980s, fared over time, shows that most of these systems fell into disuse or were abandoned during a five-year period from 1987 to 1992, while about a third continued to thrive.
Decision SciencesDECISION SUPPORT SYSTEMS FOR ILL‐STRUCTURED PROBLEMS: AN EMPIRICAL STUDY
160 Citations1987William L. Cats‐Baril, George P. Huber
Administrative Science QuarterlyEscalation of Commitment to an Ineffective Course of Action: The Effect of Feedback Having Negative Implications for Self-Identity
135 Citations1986Joel Brockner, Robert F. Houser +5 more
Decision SciencesApplications and Implementation DECISION SUPPORT SYSTEMS: AN EMPIRICAL ASSESSMENT FOR DECISION MAKING
97 Citations1986Martin D. Goslar, Gary I. Green +1 more
Information & ManagementExpert system applications in business: A review and analysis of the literature (1977–1993)
81 Citations1995Bo K. Wong, John A. Monaco
A survey of expert system (ES) business application papers published between 1977 and 1993 indicates that an increasing amount of ES research is being conducted for a diverse range of business activities.
Organizational Behavior and Human PerformanceThe moderating effects of strategy, visibility, and involvement on allocation behavior: An extension of staw's escalation paradigm
81 Citations1980Edward J. Conlon, Gerrit Wolf
Expert System Applications
71 Citations1988Leonard Bolc, M. J. Coombs
The volume presents an international collection of mature expert system projects from countries ranging from Japan to France, Spain to China, and from the United States, on issues that have become prominent through the application of systems to real-world problems.
Management ScienceComputer Augmented Organizational Problem Solving
66 Citations1970Robert C. Joyner, Kenneth Tunstall
The paper outlines the development of CONCORD and describes an experimental study comparing groups using CONCORD with those not using it in solving two problems, showing no difference between user and nonuser groups in quality of solutions to the two problems.
Decision SciencesAN EXPERIMENTAL EVALUATION OF THE RELATIONSHIP OF UNCERTAINTY IN THE ENVIRONMENT TO INFORMATION USED BY DECISION MAKERS*
63 Citations1975Roger G. Schroeder, Izak Benbasat
It was found that decision review frequency was not affected by demand variability, and the correlation between the information used and decision effectiveness as measured by cost was low, indicating that although variability may strongly affect preferences for different types of information, the Information used may not in turn affect decision performance.
Journal of Management Information SystemsUsing a Knowledge-Based Decision Support System in Strategic Planning Decisions: An Empirical Study
37 Citations1986Michael Goul, Barry Shane +1 more
The results of the study indicate that using knowledge-based dss can improve the decision maker’s ability to identify and assess problems in unstructured environments.
Evaluation ReviewTruth and Credibility in Sincere Policy Analysis
30 Citations1989Barry Bozeman, David Landsbergen
Public Administration ReviewIntelligent Advisory Systems for Managing and Disseminating Information
20 Citations1986Susan G. Hadden
This paper describes an alternative computer technology that draws on the techniques of artificial intelligence to embody knowledge as well as data in the computer that can assist decision makers in achieving managerial consistency and speed and has important implications for the ways in which knowledge is disseminated and used in organizations.
Journal of Public Administration Research and TheoryInformation Credibility and Choosing Policy Alternatives: An Experimental Test of Cognitive-Response Theory
14 Citations1992David Coursey
Information & ManagementImpacts of problem structure and computerized decision aids on decision attitudes and behaviors
14 Citations1994Daniel Power, Susan L. Meyeraan +1 more
Results indicate computerized decision aid users had positive attitudes toward the aid and, compared to a group of non-users, considered fewer alternatives, took more time making decisions, and used more analytical tools.
Administration & SocietyScientific and Technical Information in Public Management
6 Citations1982Barry Bozeman, Elliot Cole
This study, of public managers' orientations toward STI, is based on data gathered from questionnaires mailed to officials of the Canadian government's Environmental Protection Service to better understand patterns of STiacquisition and sharing and information channel preferences among users of S TL.
Proceedings of the Human Factors Society Annual MeetingEmpirical Evaluation of a Decision-Analytic Aid
4 Citations1980Francois G. Christen, Michael G. Samet
Knowledge, technology & policy/Knowledge in society/Knowledge, technology, & policyComputers and commitment to a public management decision: An experiment
3 Citations1989Barry Bozeman, Ralph F. Shangraw
Results indicate that access difficulty diminishes confidence in decisions and leads to lesser commitment, however, the cost of the computer information seems to have little bearing on decision commitment.