Overview: Theoretical Perspectives and Methodologies for the Evaluation of Healthcare Information Systems
Health InformaticsPublished 5 April 2006
James G. Anderson, Carolyn E. Aydin
Citations39
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Each of the methods described above is explained in detail, with sample evaluation instruments where appropriate, in Chapters 2 through 9.
Abstract
Each of the methods described above is explained in detail, with sample evaluation instruments where appropriate, in Chapters 2 through 9. The chapters also include examples of studies that make different theoretical assumptions, address different evaluation questions, and employ different research methodologies. Each study also has important practical policy implications for the organization under study.
Keywords
Decision SciencesHealth ProfessionsBusiness, Management and Accounting
Physics Today<i>The Structure of Scientific Revolutions</i>
35,519 Citations1963Thomas Kühn, Richard Schlegel
Case Study Research
15,171 Citations2004Jean Hartley
National Academies Press eBooksTo Err Is Human
14,096 Citations2000Institute of Medicine
A process for the preparation of prostaglandins which are known pharmaceutically active compounds and then R alpha , R omega -cyclopentenoids is described.
Journal for Healthcare QualityCrossing the Quality Chasm: A New Health System for the 21st Century
8,568 Citations2002Committee on Quality of Health Care in America
Contemporary Sociology A Journal of ReviewsSocial Network Analysis: A Handbook.
6,046 Citations1993Franz Urban Pappi, James G. Scott
MIS QuarterlyThe Case Research Strategy in Studies of Information Systems
4,704 Citations1987Izak Benbasat, David K. Goldstein +1 more
Criteria for the evaluation of case research are established and several characteristics useful for categorizing the studies are identified and examples of research areas that are particularly well-suited to investigation using the case research approach are concluded.
Contemporary Sociology A Journal of ReviewsLabor and Monopoly Capital: The Degradation of Work in the Twentieth Century.
3,003 Citations1976Dale Tomich, Harry Braverman
Evaluation: A Systematic Approach
2,952 Citations1979Peter H. Rossi, Mark W. Lipsey +1 more
Communications of the ACMPower, politics, and MIS implementation
2,196 Citations1983M. Lynne Markus
The task of evaluating the theories of resistance to management information systems on the bases of the differences is begun and data from a case study is used to illustrate the theories and to demonstrate the superiority, for implementors, of the interaction theory.
Cambridge University Press eBooksTechnology as an occasion for structuring: evidence from observations of CT scanners and the social order of radiology departments
2,141 Citations2007Stephen R. Barley
A theory of how technology might occasion different organizational structures by altering institutionalized roles and patterns of interaction is outlined, showing how identical CT scanners occasioned similar structuring processes in two radiology departments and yet led to divergent forms of organization.
Management ScienceInformation Technology and Organizational Change: Causal Structure in Theory and Research
2,110 Citations1988M. Lynne Markus, Daniel Robey
This article concerns theories about why and how information technology affects organizational life and examines theories in terms of their structures-theorists' assumptions about the nature and direction of causal influence.
Library & Information Science ResearchEvaluation: A Systematic Approach
1,940 Citations2005Danny P. Wallace
Journal of the American Medical Informatics AssociationSome Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors
1,800 Citations2003Joan S. Ash
With a heightened awareness of these issues, informaticians can educate, design systems, implement, and conduct research in such a way that they might be able to avoid the unintended consequences of these subtle silent errors.
MIS QuarterlyCombining Qualitative and Quantitative Methods in Information Systems Research: A Case Study1
1,082 Citations1988Bonnie Kaplan, Dennis Duchon
No one approach to information systems research can provide the richness that information systems, as a discipline, needs for further advancement, so the desirability for a variety of approaches to studying information systems is found.
Lexikon des gesamten Buchwesens OnlineEncyclopedia of Library and Information Science
909 Citations2017Allen Kent
"Names as Catalog Entries, A. M. Abdul Huq Nashville Public Libraries, David Marshall Stewart National Agricultural Library, Leila P. Moran National Archives (United States), James B. Myatt National Libraries (Translated by Rosalind Kent), Natalia Tyulina National Libraries Task Force",
ACM Computing SurveysSocial Analyses of Computing: Theoretical Perspectives in Recent Empirical Research
781 Citations1980Rob Kling
The roles of computer technologies in the workplace, in decision making, in altering power relationships, and in influencing personal privacy are examined and two broad perspectives are contrasted.
International Journal of Medical InformaticsImplementing information systems in health care organizations: myths and challenges
708 Citations2001Marc Berg
This paper discusses three myths that often hamper implementation processes in patient care information systems (PCIS) and suggests a top down framework for the implementation is crucial to turn user-input into a coherent steering force, creating a solid basis for organizational transformation.
Administrative Science QuarterlyAttitudes Toward New Organizational Technology: Network Proximity as a Mechanism for Social Information Processing
625 Citations1991Ronald E. Rice, Carolyn Aydin
This study explicates and tests three network-based mechanisms whereby individuals' attitudes toward an integrated health information system may be influenced by the attitudes of proximate sources of social information.
Advances in computersThe Web of Computing: Computer Technology as Social Organization
595 Citations1982Rob Kling, Walt Scacchi
It is noted that web models allow better predictions of the outcomes of using socially-complex computing developments in contrast to the discrete-entity models.
Choice Reviews OnlineComputerization and controversy: value conflicts and social choices
494 Citations1992
Management ScienceA Framework for Research in Computer-Based Management Information Systems
484 Citations1980Blake Ives, Scott Hamilton +1 more
The paper presents a comprehensive framework for research in Management Information Systems MIS, useful not only in understanding and classifying MIS research but also in generating potential hypotheses for future research.
Computers and medicineEvaluation Methods in Medical Informatics
452 Citations1997Charles P. Friedman, Jeremy C Wyatt
This chapter discusses Subjectivist Approaches to Evaluation, the design and conduct of Subjectivist Studies, and Organizational Evaluation of Medical Information Resources.
Journal of the American Medical Informatics AssociationManaging Change: An Overview
411 Citations2000Nancy M. Lorenzi, Robert T. Riley
This paper looks at four major areas-why information system failures occur, the core theories supporting change management, the practical applications ofchange management, and the change management efforts in informatics.
Health AffairsOvercoming Barriers To Adopting And Implementing Computerized Physician Order Entry Systems In U.S. Hospitals
410 Citations2004Eric G. Poon, David Blumenthal +4 more
Senior management at twenty-six hospitals were interviewed to identify ways to overcome barriers to adopting and implementing CPOE, and several policy levers to speed the adoption of this important patient safety technology are highlighted.
Computers and Biomedical ResearchAn analysis of physician attitudes regarding computer-based clinical consultation systems
333 Citations1981Randy L. Teach, Edward H. Shortliffe
Physician attitudes regarding computer-based clinical decision aids and the effect of a 2-day tutorial on medical computing are studied, indicating that physicians are accepting of applications that enhance their patient management capabilities, but tend to oppose applications in which they perceive an infringement on their management role.
Journal of the American Medical Informatics AssociationComputerized Physician Order Entry in U.S. Hospitals: Results of a 2002 Survey
294 Citations2003Joan S. Ash
Despite increasing consensus about the desirability of computerized physician order entry (CPOE) use, these data indicate that only 9.6% of U.S. hospitals presently have CPOE completely available.
ACM Computing SurveysDifferent perspectives on information systems: problems and solutions
293 Citations1987Kalle Lyytinen
Using the IS research framework suggested by Ives, Hamilton, and Davis, research into IS problems is classified into several perspectives whose relevance in coping with the problems is discussed.
Telematics and InformaticsOxford Surveys in Information Technology
256 Citations1988Information Technology
The author's preface about the contributors F. Kamijo: Information technology activities in the Japanese software industry S. Hekmatpour and D.C. Ince: Rapid software prototyping W.H. Melody: Telecommunication - policy directions for the technology and information services P.J. Rowley: Text retrieval systems - an outline.
Journal of the American Medical Informatics AssociationAntecedents of the People and Organizational Aspects of Medical Informatics: Review of the Literature
238 Citations1997Nancy M. Lorenzi, Robert T. Riley +3 more
The behavioral and business referent disciplines that can potentially contribute to improved implementations and on-going management of change in the medical informatics arena are reviewed.
Journal of the American Medical Informatics AssociationComputerized Physician Order Entry: Helpful or Harmful?
220 Citations2003R. G. Berger
Computerized physician order entry is touted as a major improvement in patient safety, but actual improvements in medical outcomes have not been documented and installation of such systems could actually increase the number of adverse drug events and result in higher overall medical costs, particularly in the first few years of their adoption.
Academy of Management JournalRESEARCH NOTES. EFFECTS OF WORK REDESIGN ON EMPLOYEE PERCEPTIONS, ATTITUDES, AND BEHAVIORS: A LONG-TERM INVESTIGATION.
207 Citations1991Ricky W. Griffin
Journal of the American Medical Informatics AssociationA Cross-site Qualitative Study of Physician Order Entry
182 Citations2003Joan S. Ash, Paul Gorman +5 more
An organizational culture characterized by collaboration and trust and an ongoing process that includes active clinician engagement in adaptation of the technology were important elements in successful implementation of physician order entry at the institutions that were studied.
Information & ManagementExpectation failure concept and systems analysts' view of information system failures: Results of an exploratory study
181 Citations1988Kalle Lyytinen
The study shows that systems analysts' perceptions of information system failures can be largely accounted for by their professional and structural position in the systems development process and associated interests, which supports the view that a perception of IS failure is largely stakeholder-dependent.
International Journal of Medical InformaticsIndicators of organizational readiness for clinical information technology/systems innovation: a Delphi study
177 Citations2001Rita Snyder‐Halpern
The overall purposes of this exploratory study were to validate the seven IT/S innovation readiness sub-dimensions of a heuristic organizational information technology/systems innovation model (OITIM) developed in phase one of the research program, and identify indicators to assess the validated sub-Dimensions.
Journal of the American Medical Informatics AssociationAddressing Organizational Issues into the Evaluation of Medical Systems
175 Citations1997Bonnie Kaplan
A social interactionist framework for researching these kinds of organizational issues is described, based on research within medical informatics and other disciplines over the past 20 years, to address organizational issues concerning computer information systems in medicine and health care.
Academy of Management ReviewVarieties of Qualitative Research
171 Citations1984Marvin Harris, John van Maanen +2 more
Communications of the ACMA cross-cultural comparison of IS designer values
171 Citations1990Kuldeep Kumar, Niels Bjørn‐Andersen
The values of system designers have a significant influence on the extent to which information system meet the broad effectiveness needs of an organization.
International Journal of Medical InformaticsLessons from a failed information systems initiative: issues for complex organisations☆
155 Citations1999Gray Southon, Christian Sauer +1 more
It is demonstrated that the environment of large complex distributed organisations introduces a complex of issues that are not normally considered in implementation strategy.
Journal of the American Medical Informatics AssociationInformation Technology in Complex Health Services: Organizational Impediments to Successful Technology Transfer and Diffusion
149 Citations1997F. C. G. Southon, Christian Sauer +1 more
The large-scale developments of integrated health services present great challenges to the efficient and reliable implementation of information technology, especially in large, divisionalized organizations.
Journal of the American Medical Informatics AssociationA Consensus Action Agenda for Achieving the National Health Information Infrastructure
142 Citations2004W. A. Yasnoff
Community and regional implementation projects, including consumer access to a personal health record, were seen as necessary to demonstrate comprehensive functional systems that can serve as models for the entire nation.
Methods of Information in MedicineFuture Directions in Evaluation Research: People, Organizational, and Social Issues
142 Citations2004Nicola Shaw, Bonnie Kaplan
Evaluation research is key in identifying how people, organizational, and social issues – all crucial to system design, development, implementation, and use – interplay with informatics projects.
Journal of the Operational Research SocietyOffice Automation: A Social and Organizational Perspective.
131 Citations1986Christine Harbottle, Rudy Hirschheim
A justification and rationale for a social theoretic perspective of Office Automation and the implications of technology change in the Office Conclusions Appendices.
Behaviour and Information TechnologyWhat do professional persons think about computers?
109 Citations1982Elizabeth Zoltan, A. Chapanis
Journal of the American Medical Informatics AssociationThe Use of Computers for Clinical Care: A Case Series of Advanced U.S. Sites
103 Citations2003David Doolan, David W. Bates +1 more
There are many similarities between sites in the clinical information systems in use and the factors important to successful implementation and the experience of these sites may provide a valuable guide for others who are yet to start, or are just beginning, the implementation ofclinical information systems.
MIS QuarterlyNew information technology and organizational culture
101 Citations1982Margrethe H. Olson
Journal of the American Medical Informatics AssociationEvaluating the Capability of Information Technology to Prevent Adverse Drug Events: A Computer Simulation Approach
100 Citations2002James G. Anderson, S J Jay +2 more
Computers and medicineWhat Do Professional Persons Think about Computers?
100 Citations1982Elizabeth Zoltan-Ford, A. Chapanis
A 64-item questionnaire was distributed through the mail to certified public accountants, lawyers, pharmacists and physicians in the Baltimore City area to determine their experience with, and attitudes towards, electronic computers.
Social NetworksProgress, problems and prospects for network research: Investigating relationships in the age of electronic communication technologies
94 Citations1987Everett M. Rogers
A positive assessment of the past scientific accomplishments of network research is tempered by serious epistemological problems: inadequate attention to network theory, network sampling problems that restrict the generalizability of results, an underemphasis upon data-gathering and measurement.
MIS QuarterlyNew Information Technology and Organizational Culture
92 Citations1982Margrethe H. Olson
This article focuses on changes in individual work patterns, management control, and organizational structure that may occur as a result of implementation of office technology.
Communications of the ACMThe new media
87 Citations1994Roy Rada, George S. Carson
In this new age, a field engineer may access a simulation of a plane engine on a palmtop computer while in the process of repairing the engine.
Information & ManagementSocial worlds, individual differences, and implementation
83 Citations1991Carolyn E. Aydin, Ronald E. Rice
It is proposed that, especially in health care organizations, both occupational and departmental social worlds are additional, important predictors of individual reactions to medical information systems, and the importance of membership in social worlds in influencing those attitudes is added.
Computers and medicineUse and Impact of Computers in Clinical Medicine
81 Citations1987James G. Anderson, Stephen J. Jay
There is a gap between current practice and the state-of-the-art, and the falling cost of computers suggests that there will be even more extensive use in the near future.
Administrative Science QuarterlyManaging Computer Impact: An International Study of Management and Organizations.
80 Citations1987Niels Bjo .KC, rn-Andersen +2 more
Describing research undertaken in eight organizations in five countries, results at several levels of analysis support the conclusion that few changes are determined by computer technology.
Computers and medicineDo Hospital Staff Interfere with Computer System Implementation?
79 Citations1980Alan F. Dowling
Wide-spread interference, along with other implementation problems, cripples the ability of MCBIS to function properly and affects health care costs and quality of services.
Academy of Management JournalResearch Notes. Effects of Work Redesign on Employee Perceptions, Attitudes, and Behaviors: A Long-Term Investigation
76 Citations1991Ricky W. Griffin
International Journal of Medical InformaticsOrganizational issues in health informatics: a model approach
68 Citations1998Jos Aarts, Victor Peel +1 more
A model that describes the stages of the implementation of an information system in a health care organization in a cyclic order and provides also the conceptual basis for a higher education course of health informatics that is focusing on organizational change and the pivotal role of information and communication technology.
Social Science & MedicineComputers and clinical judgement: The role of physician networks
66 Citations1985James G. Anderson, Stephen J. Jay
The results suggest that the center-periphery model of diffusion of new ideas among professionals may be too simplistic and that the communication network may involve multiple central cohesive subgroups of physicians who differentially initiate patient referrals and consultations with physicians in other subgroups.
Journal of the American Medical Informatics AssociationOvercoming Structural Constraints to Patient Utilization of Electronic Medical Records: A Critical Review and Proposal for an Evaluation Framework
65 Citations2003Warren Winkelman
It appears that traditional information system research and development methods may not wholly capture many pertinent social issues that arise when expanding access of EPR systems to patients.
Journal of the Royal Society of MedicineWhy Doctors Don't Use Computers: Some Empirical Findings
63 Citations1986James G. Anderson, S J Jay +2 more
Attitudes of physicians recognize the potential of computers to improve patient care, but are concerned about the possibility of increased governmental and hospital control, threats to privacy, and legal and ethical problems.
PubMedBringing social worlds together: computers as catalysts for new interactions in health care organizations.
61 Citations1992C E Aydin, Ronald E. Rice
Canadian Journal of CommunicationCommunication Technologies and Society: Conceptions of Causality and the Politics of Technological Intervention
61 Citations1985Robin E. Manseli
PubMedBroadening our approach to evaluating medical information systems.
60 Citations1991Diana E. Forsythe, B. G. Buchanan
The conventional wisdom on evaluation is described, pointing out some of its underlying assumptions and suggesting that these assumptions are problematic when applied to some aspects of evaluation.
JAMAPhysician Attitudes Toward Applications of Computer Data Base Systems
59 Citations1983Joseph Singer
Among internists, randomized control trials (RCTs) were viewed as clearly the most useful source of data and otolaryngologists indicated that RCTs and patient registries were both very helpful.
Social Science Computer ReviewThe Impacts of Computer Technology on the Worklife of Information Workers
57 Citations1990Kenneth L. Kraemer, James Ν. Danziger
This article assesses recent research which examines the impacts of computing on the worklife of information workers using a broad analytic framework to assess the consistency and coherence of the research, and to suggest where systematic comparative analysis is needed in the future.
Journal of the American Medical Informatics AssociationPhysicians, Information Technology, and Health Care Systems: A Journey, Not a Destination
54 Citations2003Clement J. McDonald
Two papers in this issue of JAMIA discuss computerized physician order entry (CPOE) and a third one discusses patient clinical information systems (PCISs), which often include CPOE, and challenge the current push toward rapid adoption in the health care industry.
Journal of the American Medical Informatics AssociationTermination of a Contract to Implement an Enterprise Electronic Medical Record System
52 Citations2000Bryan Goddard
The development of integrated health care systems, the building of distributed computer networks throughout them, and the advent of easy-to-use electronic medical records for ambulatory practices combine to create a powerful argument for an enterprise electronic medical record.
Health Care Management ReviewDo Hospital Staff Interfere with Computer System Implementation?
50 Citations1980Alan F. Dowling
PubMedAsking questions: information needs in a surgical intensive care unit.
48 Citations2002Madhu Reddy, Wanda Pratt +2 more
It was found that organizational information was extremely important to SICU team members and the first resource that team members utilized was not electronic or paper but rather human: another team member.
International Journal of Medical InformaticsUsing a descriptive model of change when implementing large scale clinical information systems to identify priorities for further research
45 Citations1999Jos Aarts, Victor Peel
Journal of Health and Social BehaviorOccupational Adaptation to Computerized Medical Information Systems
45 Citations1989Carolyn E. Aydin
Interviews were conducted with informants from the pharmacy and nursing departments at two hospitals currently using medical information systems for communicating physicians' medication orders from the nursing station to the pharmacy, resulting in increased interdependence between the two departments.
MIS QuarterlyThe Manager-Analyst Interface in Systems Development*
41 Citations1982Kate M. Kaiser, William R. King
The user-analyst liaison function in system development was studied in thirty-eight large firms using a structured interviewing process and revealed that the most prevalent form of liaison is still the traditional systems representative and the liaison function is generally performed much less formally than the IS literature would suggest.
Computers in Biology and MedicineEvaluation: salvation or nemesis of medical informatics?
40 Citations2002Jochen R. Moehr
It is argued that insistence on the application of the objectivist principles to real information systems may hamper rather than advance insights and progress, and the need to include systems engineering approaches in, and to further extend, the evaluation methodology.
Journal of Medical SystemsInitial impact of a clinical laboratory computer system
32 Citations1987Bonnie Kaplan
Primary changes caused by the computer system were increases in the amount of paper work performed by technologists, and improvements in laboratory results reporting.
Journal of the American Medical Informatics AssociationUse of the Equity Implementation Model to Review Clinical System Implementation Efforts: A Case Report
26 Citations2000Thomas Lauer, K.D. Joshi +1 more
The case study (implementation of a patient scheduling and appointment setting system in a large health maintenance organization) illustrates how the EIM can be used to examine users' reactions to the implementation of a new system.
Computers and medicinePhysician Communication Networks and the Adoption and Utilization of Computer Applications in Medicine
24 Citations1987James G. Anderson, Stephen J. Jay +3 more
The findings suggest that the physician’s position in the consultation network significantly influences rates of adoption and utilization of new computer technology.
An analytical framework for measuring the effectiveness/impacts of computer-based patient record systems
23 Citations2002James G. Anderson, Cevat AYDIN +1 more
A framework for diagnosing, measuring and analyzing the effectiveness and impacts of computer-based patient record systems is proposed and case studies are used to illustrate how the framework can be used to pose questions and to select measures, research designs and analytical tools to evaluate the effectiveness.
Computers and medicineImplementing Computerization in Hospitals: A Case Study of the Behavioral and Attitudinal Impacts of a Medical Information System
23 Citations1985Michael A. Counte, Kristen H. Kjerulff +2 more
Analysis of the impacts of a medical information system on work related attitudes and reported work role behavior of a randomly selected group of hospital employees suggest that over time employee attitudes toward the system became less favorable, levels of job satisfaction increased, and that the system’s introduction affected several categories of reported work activity.
Social Science & MedicinePhysician utilization of computers in medical practice: Policy implications based on a structural model
20 Citations1986James G. Anderson, Stephen J. Jay +2 more
A model of the process by which physicians change their practice behavior by utilizing a computer-based hospital information system (HIS) indicates that consultation with other physicians on a hospital service leads to greater exposure to potential computer applications resulting in less concern about the potential impact of computers on medical practice.
Journal of the American Medical Informatics AssociationPeople and Organizational Issues in Health Informatics
16 Citations1997R. Braude
Just as patient acceptance is the final factor in successful health intervention, so is acceptance of an information system by its intended users the final stage in successful information systems implementation.
Journal of Ambulatory Care ManagementComputer-Based Ambulatory Information Systems: Recent Developments
13 Citations2000James G. Anderson
The evidence suggests that computer-based information systems can increase access to clinical information, improve physician performance, enhance quality of care, and facilitate outcomes research review.
Journal of Organizational Behavior ManagementImplementing Computerization in Hospitals:
12 Citations1985Michael A. Counte, Kristen H. Kjerulff +2 more
Analysis of the impacts of a medical information system on work related attitudes and reported work role behavior of a randomly selected group of hospital employees suggest that over time employee attitudes toward the system became less favorable, levels of job satisfaction increased, and that the system's introduction affected several categories of reported work activity.
AIS Electronic Library (AISeL) (Association for Information Systems)Computerization as a Predominant Technology Effecting Work Unit Structure
10 Citations1985Richard Leifer, Edward F. McDonough
DigitalCommons - WayneState (Wayne State University)Diffusion of Computer Applications Among Physicians: A Quasi-Experimental Study
9 Citations1990James G. Anderson, Stephen J. Jay +2 more
The results of the study suggest that the identification and use of educationally influential physicians is an effective means of introducing medical innovations into clinical settings.
Purdue e-Pubs (Purdue University)Physician Utilization of a Hospital Information System: A Computer Simulation Model
8 Citations1988James L. Anderson, Stephen Jay +4 more
The results indicate that the use of personal order sets to enter orders into the HIS will result in a significant reduction in manpower, salaries and fringe benefits, and errors in order entry.
…