Cognitive walkthroughs: a method for theory-based evaluation of user interfaces
International Journal of Man-Machine StudiesPublished 1 May 1992
Peter G. Polson, Clayton Lewis, John Rieman, Cathleen Wharton
Citations805
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The cognitive walkthrough methodology, described in detail, is an adaptation of the design walkthrough techniques that have been used for many years in the software engineering community and is based on a theory of learning by exploration presented.
Abstract
This paper presents a new methodology for performing theory-based evaluations of user interface designs early in the design cycle. The methodology is an adaptation of the design walkthrough techniques that have been used for many years in the software engineering community. Traditional walkthroughs involve hand simulation of sections of code to ensure that they implement specified functionality. The method we present involves hand simulation of the cognitive activities of a user, to ensure that the user can easily learn to perform tasks that the system is intended to support. The cognitive walkthrough methodology, described in detail, is based on a theory of learning by exploration presented in this paper. There is a summary of preliminary results of effectiveness and comparisons with other design methods.
Keywords
Computer ScienceEngineering
Psychological ReviewThe role of knowledge in discourse comprehension: A construction-integration model.
4,311 Citations1988Walter Kintsch
This chapter discusses data concerning the time course of word identification in a discourse context and a simulation of arithmetic word-problem understanding provides a plausible account for some well-known phenomena.
The Psychology of Human-Computer Interaction
4,079 Citations2018Stuart K. Card, Thomas P. Moran +1 more
This work focuses on applying Psychology to Design Reprise, and the GOMS Model of Manuscript Editing, as an application to Information-Processing Psychology.
The American Journal of PsychologyThe Psychology of Everyday Things
3,480 Citations1990Dominic W. Massaro, Donald A. Norman
Heuristic evaluation of user interfaces
3,431 Citations1990Jakob Nielsen, Rolf Molich
Four experiments showed that individual evaluators were mostly quite bad at doing heuristic evaluations and that they only found between 20 and 51% of the usability problems in the interfaces they evaluated.
Artificial IntelligenceSOAR: An architecture for general intelligence
2,396 Citations1987John E. Laird, Allen Newell +1 more
SOAR, an implemented proposal for a foundation for a system capable of general intelligent behavior, is presented and its organizational principles, the system as currently implemented, and demonstrations of its capabilities are described.
The American Journal of PsychologyUser Centered System Design: New Perspectives on Human-Computer Interaction
1,849 Citations1988Roy Pea, Donald A. Norman +1 more
Communications of the ACMImproving a human-computer dialogue
816 Citations1990Rolf Molich, Jakob Nielsen
A survey of seventy-seven highly motivated industrial designers and programmers indicates that the identification of specific, potential problems in a human-computer dialogue design is difficult.
Guidelines for Designing User Interface Software
753 Citations1986Sidney L. Smith, Jane N. Mosier
These design guidelines cover six functional areas: data entry, data display, sequence control, user guidance, data transmission, and data protection.
IEEE Transactions on Software EngineeringAdvances in software inspections
627 Citations1986Michael Fagan
Studies and experiences are presented which enhance the use of the inspection process and improve its contribution to development of defect-free software on time and at lower cost.
User interface evaluation in the real world
615 Citations1991Robin Jeffries, James R. Miller +2 more
A user interface for a software product was evaluated prior to its release by four groups, each applying a different technique: heuristic evaluation, software guidelines, cognitive walkthroughs, and usability testing.
International Journal of Human-Computer StudiesAn approach to the formal analysis of user complexity
598 Citations1999David E. Kieras, Peter G. Polson
Elsevier eBooksUsability Engineering: Our Experience and Evolution
518 Citations1988John Whiteside, John L. Bennett +1 more
This chapter discusses the user's experience and evolution of usability engineering, which provides operationally defined criteria so that usability objectives can be used to drive an efficient and productive engineering effort.
Interfacing Thought: Cognitive Aspects of Human-Computer Interaction
409 Citations2003John M. Carroll
The twelve essays focus on the design of "user interfaces," or computers as experienced and manipulated by human users, showing how human motivation, action, and experience place constraints on the usability of computer equipment.
Elsevier eBooksHOW TO DESIGN USABLE SYSTEMS
331 Citations1987John D. Gould
This chapter describes the way in which usable systems can be designed, a combination of many factors, each of which is often developed independently, and how each aspect of usability should begin evolving from the beginning.
Elsevier eBooksTowards a Practical GOMS Model Methodology for User Interface Design
291 Citations1988David E. Kieras
This chapter presents a practical GOMS model methodology for user interface design with the basic approach to user-interface design using the cognitive complexity approach, but with the evaluation of a proposed design being done with simulation techniques rather than actual human user testing.
Human-Computer InteractionTheory-Based Design for Easily Learned Interfaces
208 Citations1990Peter G. Polson, Clayton Lewis
Design guidelines for systems that can be learned by exploration, "design for successful guessing," are derived from the theory, and these principles are compared with those developed by Norman (1988).
Human-Computer InteractionThe Acquisition and Performance of Text-Editing Skill: A Cognitive Complexity Analysis
188 Citations1990Susan Bovair, David E. Kieras +1 more
A production rule model for a simulated text editor that accounted well for both learning and execution time and for the details of the increase in speed with practice is compared to experimental data on learning and performance.
Artifact as theory-nexus: hermeneutics meets theory-based design
185 Citations1989John M. Carroll, Wendy A. Kellogg
This proposal reconciles the contrasting perspectives of theory-based design and hermeneutics, and clarifies the apparent paradox of HCI application leading HCI theory.
Design rationale: the argument behind the artifact
165 Citations1989Allan MacLean, Richard M. Young +1 more
It is asserted that the product of user interface design should be not only the interface itself but also a rationale for why the interface is the way it is, and a representation for design based around a semi-formal notation is described.
SOAR: An Architecture for General Intelligence
149 Citations1987Allen Newell, Paul S. Rosenbloom +1 more
Behaviour and Information TechnologyArtifacts as psychological theories: the case of human-computer interaction
143 Citations1989John M. Carroll, Robert L. Campbell
It is suggested that artifacts can be considered theory-like in HCI, and observed that they do play a theory- like role in the field as practiced, resolving the current methodological perplexity about the legitimacy of the field.
Programmable user models for predictive evaluation of interface designs
131 Citations1989Richard M. Young, T. R. G. Green +1 more
The research findings include analyses of the cognitive processes involved in the use of interactive computer systems, and a number of issues to be resolved in future cognitive models.
Human-Computer InteractionSoftening Up Hard Science: Reply to Newell and Card
121 Citations1986John M. Carroll, Robert L. Campbell
Combined results from the two studies suggest that judgmental performance is markedly enhanced or degraded by the degree to which the display format provides the user with an organizing structure that facilitates a matching between the relative importance of information and the psychological salience of the display's graphic features.
Cognitive ScienceRoutine Computing Tasks: Planning as Understanding
64 Citations1991Suzanne Mannes, Walter Kintsch
A system called NETWORK is described which implements the construction-integration model of Kintsch (1988) in a routine computing-task domain that builds a plan of action on-line for a given task from a set of plan elements.
Infinite detail and emulation in an ontologically minimized HCI
53 Citations1990John M. Carroll
An alternative approach is to begin from a characterization of current practice, to take seriously the requirements of the domain of endeavor, and to define areas of “science” and “application” as possible and appropriate in that context.
Why good engineers (sometimes) create bad interfaces
44 Citations1990Donald R. Gentner, Jonathan Grudin
A view of system design is presented that shows how good engineering practice can lead to poor user interfaces and where to position the user interface between the poles of the engineering model and the task model.
Lecture notes in computer scienceHuman-Computer Interaction – INTERACT 2007
30 Citations2007M. Cecília C. Baranauskas, Philippe Palanque +2 more
Elsevier eBooksDEVELOPING A USER INTERFACE TECHNOLOGY FOR USE IN INDUSTRY
26 Citations1987John L. Bennett, Douglas J. Lorch +2 more
An evolving methodology that is intended to give developers early warning indications of potential usability problems that may arise from a set of design decisions is reported on.
Using a knowledge analysis to predict conceptual errors in text-editor usage
24 Citations1990Richard M. Young, Joyce Whittington
The knowledge analysis of a device and a task, when written in an external Instruction Language and translated into rules for a programmable cognitive architecture, enables a designer to predict conceptual errors in device usage.
ACM SIGCHI BulletinHow would your favourite user model cope with these scenarios?
24 Citations1989Richard M. Young, Philip Barnard +2 more
This article summarises the argument behind the use of scenarios as one methodological route to the development of user models of broader scope, and presents five such scenarios as a challenge to the state of the art in user modelling.
Proceedings of the Human Factors Society Annual MeetingEvaluating User Interface Complexity
16 Citations1987John Karat