The Use of Focus Groups in Design Science Research
Integrated series on information systems/Integrated series in information systemsPublished 1 January 2010
Monica Chiarini Tremblay, Alan R. Hevner, Donald J. Berndt
Citations118
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This chapter discusses the adaptation of focus groups to design science research projects, and demonstrates the use of both EFGs and CFGs in a design research doctoral thesis in the health-care field.
Abstract
Focus groups to investigate new ideas are widely used in many research fields. The use of focus groups in design science research poses interesting opportunities and challenges. Traditional focus group methods must be adapted to meet two specific goals of design research. For the evaluation of an artifact design, exploratory focus groups (EFGs) study the artifact to propose improvements in the design. The results of the evaluation are used to refine the design and the cycle of build and evaluate using EFGs continues until the artifact is released for field test in the application environment. Then, the field test of the design artifact may employ confirmatory focus groups (CFGs) to establish the utility of the artifact in field use. Rigorous investigation of the artifact requires multiple CFGs to be run with opportunities for quantitative and qualitative data collection and analyses across the multiple CFGs. In this chapter, we discuss the adaptation of focus groups to design science research projects. We demonstrate the use of both EFGs and CFGs in a design research doctoral thesis in the health-care field.
Keywords
Social Sciences
MIS QuarterlyDesign Science in Information Systems Research1
9,923 Citations2004Alan R. Hevner, March March +2 more
The objective is to describe the performance of design-science research in Information Systems via a concise conceptual framework and clear guidelines for understanding, executing, and evaluating the research.
Focus Groups as Qualitative Research
8,719 Citations1997David Morgan
MIS QuarterlyDesign science in information systems research
7,723 Citations2004Alan R. Hevner, Salvatore T. March +2 more
Journal of Management Information SystemsBeyond Accuracy: What Data Quality Means to Data Consumers
4,330 Citations1996Richard Y. Wang, Diane M. Strong
Using this framework, IS managers were able to better understand and meet their data consumers' data quality needs and this research provides a basis for future studies that measure data quality along the dimensions of this framework.
Sociology of Health & IllnessThe methodology of Focus Groups: the importance of interaction between research participants
3,836 Citations1994Jenny Kitzinger
Focus group methodology is introduced, ways of conducting such groups are explored and what this technique of data collection can offer researchers in general and medical sociologists in particular are examined.
Focus Groups: Theory and Practice
3,737 Citations1990David W. Stewart, Prem N. Shamdasani
MIS QuarterlyInformation Privacy: Measuring Individuals’ Concerns About Organizational Practices1
2,238 Citations1996H. Jeff Smith, Sandra Milberg +1 more
An instrument that identifies and measures the primary dimensions of individuals' concers about organizational information privacy practices, and was rigorously tested and validated across several heterogenous populations, providing a high degree of confidence in the scales' validity, reliability, and generalizability.
Focus Groups in Social Research
2,121 Citations2001Michael Bloor, Jane Frankland +2 more
Management ScienceA Foundation for the Study of Group Decision Support Systems
2,026 Citations1987Gerardine DeSanctis, R. Brent Gallupe
A conceptual overview of GDSS based on an information-exchange perspective of decision making is presented, and a multi-dimensional taxonomy of systems is proposed as an organizing framework for research in the area.
AIS Electronic Library (AISeL) (Association for Information Systems)A Three Cycle View of Design Science Research
1,543 Citations2007Alan R. Hevner
The recognition of these three cycles in a research project clearly positions and differentiates design science from other research paradigms and concludes with a claim to the pragmatic nature of design science.
Integrated series on information systems/Integrated series in information systemsDesign Science Research in Information Systems
1,360 Citations2010Alan R. Hevner, Samir Chatterjee
Information systems as composed of inherently mutable and adaptable hardware, software, and human interfaces provide many unique and challenging design problems that call for new and creative ideas.
American Journal of SociologyThe Focused Interview
1,198 Citations1946Robert Κ. Merton, Patricia L. Kendall
MIS QuarterlyA design theory for systems that support emergent knowledge processes
1,079 Citations2002M. Lynne Markus, Ann Majchrzak +1 more
This paper developed an IS design theory for EKP support systems, which makes the development process more tractable for developers by restricting the range of effective features and therange of effective development practices to a more manageable set.
MIS QuarterlySpecial Issue on Action Research In Information Systems: Making IS Research Relevant to Practice—Foreword
725 Citations2004Baskerville, Michael Myers
This work believes action research methods provide one potential avenue to improve the relevance of IS research and sees no reason why action research should not be accepted in the field of information systems.
Management ScienceModeling Information Manufacturing Systems to Determine Information Product Quality
552 Citations1998Donald P. Ballou, Richard Wang +2 more
A set of ideas, concepts, models, and procedures appropriate to information manufacturing systems that can be used to determine the quality of information products delivered, or transferred, to information customers are presented.
Management ScienceModeling Data and Process Quality in Multi-Input, Multi-Output Information Systems
542 Citations1985Donald P. Ballou, Harold L. Pazer
A general model to assess the impact of data and process quality upon the outputs of multi-user information-decision systems and the tractability of the model for various types of information systems is presented.
Information Systems ManagementManaging the Paradoxes of Mobile Technology
492 Citations2005Sirkka L. Järvenpää, Karl R. Lang
A large-scale, international focus group study that examined the experiences of mobile technology users in Hong Kong, Japan, Finland, and the United States identifies eight central mobile technology paradoxes that shape user experience and behavior.
Information Systems ResearchResearch Commentary: Rethinking “Diversity” in Information Systems Research
422 Citations1996Izak Benbasat, Ron Weber
The benefits and costs of allowing diversity to reign in the Information Systems discipline are considered and a structure is proposed that is hoped will facilitate discourse on the benefits and cost of diversity and on the role that diversity should now play in the IS discipline.
MIS QuarterlyDesign Principles for Competence Management Systems: A Synthesis of an Action Research Study1
386 Citations2004Lindgren, Ola Henfridsson +1 more
An action research study that develops and tests design principles for competence management systems and develops an integrative model of competence that not only outlines the interaction between organizational and individual level competence and the role of technology in this process, but also incorporates a typology of competence.
Journal of Management Information SystemsComplexity of Information Systems Development Projects: Conceptualization and Measurement Development
334 Citations2005Weidong Xia, Gwanhoo Lee
This paper conceptualizes and develops valid measurements of the key dimensions of information systems development project (ISDP) complexity that adequately satisfies the criteria for unidimensionality, convergent validity, discriminant validity, reliability, factorial invariance across different types of ISDPs, and nomological validity.
The role of theory and theorising in Design Science research
311 Citations2006John Venable
A framework of activities for the interaction of Design Science with research in other scientific paradigms is developed and some ideas for standards for the form and level of detail needed for theories in Design Science are proposed.
AIS Electronic Library (AISeL) (Association for Information Systems)BEING PROACTIVE: WHERE ACTION RESEARCH MEETS DESIGN RESEARCH
290 Citations2005Robert E. Cole, Sandeep Purao +2 more
The similarities between two approaches to investigating information systems in organizations, action research and design research, both directly intervene in real-world domains and effect changes in these domains are investigated.
International Conference on Software EngineeringThe role of experimentation in software engineering: past, current, and future
270 Citations1996Victor R. Basili
AIS Electronic Library (AISeL) (Association for Information Systems)Managing risk in software process improvement: an action research approach
225 Citations2004Jakob Iversen, Lars Mathiassen +1 more
Using the focus group method in software engineering: obtaining practitioner and user experiences
183 Citations2004J. Kontio, Laura Lehtola +1 more
MIS QuarterlyManaging Risk in Software Process Improvement: An Action Research Approach1
173 Citations2004Jakob Iversen, Mathiassen +1 more
This research proposes an approach to tailor risk management to specific contexts within the information systems and software engineering disciplines and draws upon insights from the literature on SPI and software risk management as well as practical lessons learned from managing SPI risks in the participating software organizations.
Journal of Database ManagementManaging Data Quality in Dynamic Decision Environments
151 Citations2003G. Shankaranarayan, Mostafa Ziad +1 more
This paper presents a framework for managing data quality in such environments using the information product approach and posits the notion of a virtual business environment to support dynamic decision-making and describes the role of the data quality framework.
International Symposium on Empirical Software EngineeringUsing the focus group method in software engineering: obtaining practitioner and user experiences
137 Citations2004J. Kontio, Laura Lehtola +1 more
The focus group method is a cost-effective and quick empirical research approach for obtaining qualitative insights and feedback from practitioners and application users but a major limitation is that it is useful only in studying concepts that can be understood by participants in a limited time.
Annual Review of Public HealthPublic Health Informatics: How Information-Age Technology Can Strengthen Public Health
119 Citations1995Andrew Friede, Henrik L. Blum +1 more
This paper defines Public Health Informatics, outlines specific benefits that may accrue from its widespread application, and discusses why and how an academic discipline of public health informatics should be developed.
Annual Review of Public HealthAdvances in Public Health Communication
104 Citations1995Edward Maibach, David R. Holtgräve
The use of communication techniques and technologies to (positively) influence individuals, populations, and organizations for the purpose of promoting conditions conducive to human and environmental health are outlined.
Information Systems ResearchInformation Technology in the Police Context: The “Sailor” Phone
84 Citations1996Peter K. Manning
This paper examines the use of the cellular telephone in police agencies as an example of ‘low tech’ innovation in information technology and draws on qualitative data, including interviews, focus group discussions, and first-hand observations in American police agencies to illustrate the impact of cellular phones on the social organization of police work in the early 1990s.
Decision Support SystemsThe Catch data warehouse: support for community health care decision-making
80 Citations2003Donald J. Berndt, Alan R. Hevner +1 more
The technical challenges of designing and implementing an effective data warehouse for health care information and ongoing research directions in health care data warehousing and community health care decision-making are focused on.
Annual Review of Public HealthPublic Health Quality Measurement: Concepts and Challenges
60 Citations2002Stephen F. Derose, Mark A. Schuster +2 more
A well-established conceptual framework for organizing quality assessment in the context of planning and delivery of programs and services by local health departments is discussed, and the strengths and limitations of this approach for guiding quality improvement are considered.
Decision Support SystemsIdentifying issues in customer relationship management at Merck-Medco
56 Citations2005Gholamreza Torkzadeh, Jerry Chang +1 more
The study results suggest a seven-factor 21-item model describing barriers to the success of customer relationship management in terms of 'standard operating procedure compliance,' 'accountability and ownership,' 'callback information content,' 'customer contact process,' ' billing issues,' 'dispensing and replacement process,' and 'queuing procedure'.
Information Systems ManagementEmployee Relationship Management: Applying the Concept of Personalization to U.S. Navy Sailors
51 Citations2005Mark L. Gillenson, Trent C. Sanders
Some of the findings for a study sponsored by the U.S. Navy to determine how personalization can be used for a Web portal with the objective of boosting sailor morale and retention are reported.
MIS QuarterlyIncorporating Behavioral Techniques Into the Systems Development Life Cycle
48 Citations1989Marilyn Mantei, Toby J. Teorey
New categories of design and/or development effort need to be added to the traditional systems development stages, termed user factor stages, because these efforts differ from the traditional feasibility studies, requirements analyses, and tests that are currently conducted.
IEEE Transactions on Knowledge and Data EngineeringFocus groups as a knowledge elicitation technique: an exploratory study
47 Citations1991Andrew Massey, William A. Wallace
It was found that focus groups performed better in generating original responses than individual interviews and thatfocus groups were at least as good as individual interviews in terms of the quality and acceptability of ideas.
Decision SciencesThe Economic Payout Model for Service Guarantees
45 Citations2005Tim Baker, David Collier
The Economic Payout Model for Service Guarantees (EPMSG) is defined that provides an optimal service guarantee economic payout under certain conditions and its objective function considers customer revenue over the short- and long-term, the cost of creating and providing the service, thecost of recovery, the probability of a service failure, and the likelihood of customer retention as a function of economic payout.
Annual Review of Public HealthMeasuring Quality of Care and Performance from a Population Health Care Perspective
45 Citations2003Stephen F. Derose, Diana B. Petitti
The definitions of quality health care and the framework for measuring quality are described, with emphasis on the performance of organizations involved in the delivery and assurance of population health care.
Decision Support SystemsNew tools for the determination of e-commerce inhibitors
41 Citations2002Roger Debreceny, Martin Putterill +2 more
A rich and far-reaching set of conjectures about the EC inhibitor process are presented, combining a survey, focus group discussions with group decision support systems, and computer-assisted qualitative analysis of the Group Decision Support Systems-facilitated focus groups (Computer-Assisted Qualitative Data Analysis, CAQDAS).
Decision Support SystemsDoing more with more information: Changing healthcare planning with OLAP tools
37 Citations2006Monica Chiarini Tremblay, Robert M. Fuller +2 more
The results of a qualitative field study show that after the OLAP implementation, knowledge workers made use of the additional capabilities of OLAP, thereby leveraging their individual abilities to enhance and expand on the tasks they performed for their community.
Communications of the Association for Information SystemsIn Search of the Primary Suppliers of IS Research: Who Are They and Where Did They Come From?
26 Citations2006Jan Guynes Clark, John T. Warren
The purpose of this study was to determine the leading IS researchers and the universities that supply them and to provide a means for assessing research productivity within the IS field.
Communications of the Association for Information SystemsInformation Systems and Health Care XI: Public Health Knowledge Management Architecture Design: A Case Study
13 Citations2006Cynthia M. Le Rouge, Fred Niederman
This paper presents the results of a case study based on the creation of a knowledge management program architecture in the public health domain using the program logic model as a framework for conducting a series of six focus groups.