What does it mean for a system to be useful?
Published 20 June 2014
Craig M. MacDonald, Michael E. Atwood
Citations25
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The results show that a system's usefulness is shaped by the context in which it is used, usability is closely linked to usefulness, usefulness may have both pragmatic and hedonic attributes, and usefulness is critical in defining users' overall evaluation of a system.
Abstract
HCI has always focused on designing useful and usable interactive systems, but usability has dominated the field while research on usefulness has been largely absent. With user experience (UX) emerging as a dominant paradigm, it is necessary to consider the meaning of usefulness for modern computing contexts. This paper describes the results of an exploratory study of usefulness and its relation to contextual and experiential factors. The results show that a system's usefulness is shaped by the context in which it is used, usability is closely linked to usefulness, usefulness may have both pragmatic and hedonic attributes, and usefulness is critical in defining users' overall evaluation of a system (i.e., its goodness). We conclude by discussing the implications of this research and describing plans for extending our understanding of usefulness in other settings.
Keywords
Computer Science
MIS QuarterlyPerceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology
64,532 Citations1989Fred D. Davis
Regression analyses suggest that perceived ease of use may actually be a causal antecdent to perceived usefulness, as opposed to a parallel, direct determinant of system usage.
Usability Engineering
9,352 Citations1993Jakob Nielsen
Decision SciencesTechnology Acceptance Model 3 and a Research Agenda on Interventions
7,814 Citations2008Viswanath Venkatesh, Hillol Bala
This work draws from the vast body of research on the technology acceptance model (TAM) to develop a comprehensive nomological network of the determinants of individual level IT adoption and use and present a research agenda focused on potential pre- and postimplementation interventions that can enhance employees' adopted and use of IT.
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
1,749 Citations1994Jeffrey N. Rubin
The Handbook of Usability Testing gives you practical, step-by-step guidelines in plain English to design and administer extremely reliable tests to ensure that people find it easy and desirable to use.
Personal and Ubiquitous ComputingWhat we talk about when we talk about context
1,487 Citations2004Paul Dourish
This paper suggests that the representational stance implied by conventional interpretations of “context” misinterprets the role of context in everyday human activity, and proposes an alternative model that suggests different directions for design.
Linear Mixed Models: A Practical Guide Using Statistical Software
1,395 Citations2006Brady T. West, Kathleen B. Welch +1 more
Interacting with ComputersWhat is beautiful is usable
1,347 Citations2000Noam Tractinsky, Adi Katz +1 more
The results resemble those found by social psychologists regarding the effect of physical attractiveness on the valuation of other personality attributes and stress the importance of studying the aesthetic aspect of human–computer interaction (HCI) design and its relationships to other design dimensions.
International Journal of Human-Computer StudiesCurrent practice in measuring usability: Challenges to usability studies and research
1,083 Citations2005Kasper Hornbæk
It is argued that increased attention to the problems identified and challenges discussed may strengthen studies of usability and usability research.
Human-computer interaction seriesThe Thing and I: Understanding the Relationship Between User and Product
1,023 Citations2003Marc Hassenzahl
When second wave HCI meets third wave challenges
853 Citations2006Susanne Bødker
The topics of multiplicity, context, boundaries, experience and participation are addressed in order to discuss where second wave theory and conceptions can still be positioned to make a contribution as part of the maturing of the authors' handling of the challenges brought on by the third wave.
Journal of the Association for Information SystemsDead Or Alive? The Development, Trajectory And Future Of Technology Adoption Research.
784 Citations2007Viswanath Venkatesh, Fred D. Davis +1 more
This paper compares the progress in the area of technology adoption with two widely-researched streams in psychology and organizational behavior: theory of planned behavior and job satisfaction to conclude that there has been excellent progress in technology adoption research.
The MIT Press eBooksStudying Context: A Comparison of Activity Theory, Situated Action Models, and Distributed Cognition
725 Citations1995Bonnie Nardi
This chapter compares three approaches to the study of context: activity theory, situated action models, and distributed cognition and considers the basic concepts each approach promulgates and evaluates the usefulness of each for the design of technology.
Old wine in new bottles or novel challenges
623 Citations2011Javier A. Bargas-Avila, Kasper Hornbæk
This paper reviews how empirical research on User Experience (UX) is conducted, integrating products, dimensions of experience, and methodologies across a systematically selected sample of 51 publications from 2005-2009, reporting a total of 66 empirical studies.
Journal of Usability Studies archiveResponse interpolation and scale sensitivity: evidence against 5-point scales
596 Citations2010Kraig Finstad
The conclusion that 7-point Likert items provide a more accurate measure of a participant's true evaluation and are more appropriate for electronically-distributed and otherwise unsupervised usability questionnaires is supported.
Usability evaluation considered harmful (some of the time)
595 Citations2008Saul Greenberg, Bill Buxton
Current practice in Human Computer Interaction as encouraged by educational institutes, academic review processes, and institutions with usability groups advocate usability evaluation as a critical part of every design process.
International Journal of Human-Computer StudiesFacets of visual aesthetics
568 Citations2010Morten Moshagen, Meinald T. Thielsch
The present research suggests that the VisAWI appears to be a sound measure of visual aesthetics of websites comprising facets of both practical and theoretical interest.
Human-Computer InteractionDamaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods
484 Citations1998Wayne D. Gray, Marilyn Salzman
In this review, the design of 5 experiments that compared usability evaluation methods (UEMs) are examined, showing that small problems in the way these experiments were designed and conducted call into serious question what the authors thought they knew regarding the efficacy of various UEMs.
Decision Support SystemsUsefulness and ease of use: field study evidence regarding task considerations
422 Citations1995Mark Keil, Peggy M. Beranek +1 more
The results of a field study illustrating the hazards of focusing on EOU and overlooking usefulness are presented and it is suggested that perceived EOU may be a function of task/tool fit.
Applied ErgonomicsHuman factors for informatics usability
356 Citations1992
This book shows how knowledge and methods from the field of ergonomics can be used to help make information technology equipment easier to use.
Human-Computer InteractionThe Inference of Perceived Usability From Beauty
315 Citations2010Marc Hassenzahl, Andrew Monk
The present study's main objective is to re-examine the relation between beauty and usability, that is, the implication that “what is beautiful is usable,” and adopted an inference perspective to qualify underlying processes to examine the possibility that, under the circumstances pertaining in most studies of this kind where participants have limited experience of using a website or product, the relationship between Beauty and usability is mediated by goodness.
Communications of the ACMFunctionality and usability
277 Citations1987Nancy C. Goodwin
Usability affects how and with what effectiveness a system is used, and even whether or not it is used at all.
Meta-analysis of correlations among usability measures
268 Citations2007Kasper Hornbæk, Effie Lai‐Chong Law
A meta-analysis of correlations among usability measures calculated from the raw data of 73 studies is presented, finding that measures of users' perceptions of phenomena are generally not correlated with objective measures of the phenomena.
Interaction, usability and aesthetics
246 Citations2006Antonella De Angeli, Alistair Sutcliffe +1 more
The study revealed that perception of information quality is affected by the interaction style implemented in the interface, in a manner resembling the halo effect in person perception.
What do usability evaluators do in practice?
230 Citations2006Mie Nørgaard, Kasper Hornbæk
The study shows how practical realities rarely discussed in the literature on usability evaluation influence sessions, and discusses implications for usability researchers and professionals, including techniques for fast-paced analysis and tools for capturing observations during sessions.
Interacting with ComputersUtility and usability: research issues and development contexts
217 Citations1992Jonathan Grudin
Two research communities exist in the USA, one focused on information system functionality and organizational impact, the other on human-computer dialogues or ‘user interfaces’ to systems and applications.
Breaking down usability
124 Citations1999Martijn van Welie, Gerrit C. van der Veer +1 more
The concept of usability is broken down into a layered model that allows comparisons of the available lists and provides better understanding of them and gives a framework for evaluation by showing which usability aspects can be tested empirically and what can be formally checked by analyzing designs during the design process itself.
Usability testing
122 Citations2007Gitte Lindgaard, Jarinee Chattratichart
Evidence is provided suggesting that the focus be shifted to task coverage instead of participant recruitment on usability test performance, as no significant correlation between the percentage of problems found or of new problems and number of test users was found.
Behaviour and Information TechnologyDogmas in the assessment of usability evaluation methods
110 Citations2009Kasper Hornbæk
Detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how U EMs may be combined are emphasised.
Computers in Human BehaviorThe Internet knowledge (iKnow) measure
84 Citations2006Denise Potosky
This research improves the understanding of the concept of Internet knowledge, and provides initial support for the construct validity of a new measure of Internetknowledge with respect to its factor structure, internal consistency reliability, and concurrent validity.
Behaviour and Information TechnologyMust evaluation methods be about usability? Devising and assessing the utility inspection method
78 Citations2012Guðrún Hulda Jónsdóttir Johannessen, Kasper Hornbæk
It is argued that UIM complements existing usability evaluation methods and discusses future research on utility inspection.
Interacting with ComputersAn integrated model of interaction experience for information retrieval in a Web-based encyclopaedia
78 Citations2010Paul van Schaik, Jonathan Ling
It is found that the perceptions of three product attributes and technology acceptance variables (the beliefs of Perceived Ease of Use, Perceived Enjoyment and Perceived Usefulness, and Intention to Use) are separate underlying psychological dimensions.
The "Beauty Dilemma"
47 Citations2009Sarah Diefenbach, Marc Hassenzahl
The notion of a "beauty dilemma" - the idea that people discount beauty in a choice situation, although they value it in general, is explored, which reveals that a choices situation which requires a trade-off between beauty and usability, and which offers no way to justify choosing beauty, leads to a sharp increase in the preference of usability.
International Journal of Human-Computer InteractionAn Approach to the Evaluation of Usefulness as a Social Construct Using Technological Frames
46 Citations2007José Abdelnour-Nocera, Lynne Dunckley +1 more
An investigation of the way usefulness of an information system is shaped by sociocultural factors in a work context is described, which suggests that developers and users shape their experience of the usefulness of a system through these technological frames.
International Journal of Human-Computer StudiesEvaluating system utility and conceptual fit using CASSM
43 Citations2007Ann Blandford, Thomas R. G. Green +2 more
This paper presents CASSM, a method, which focuses on the quality of 'fit' between users and an interactive system and complements established evaluation methods by focusing on conceptual structures rather than procedures.
Changing perspectives on evaluation in HCI
41 Citations2013Craig M. MacDonald, Michael E. Atwood
The challenges the community needs to address to develop adequate methods for evaluating systems in modern use contexts are outlined and important research directions that will shape evaluation's future are discussed.
Lecture notes in computer scienceThe Effect of Brand on the Evaluation of Websites
30 Citations2009Antonella De Angeli, Jan Hartmann +1 more
Empirical evidence is presented showing that brand attitude influences the evaluation of websites, providing support to the proposition of UX as a contextual-dependent response to the interaction with computing systems and has important implications for the design and Evaluation of websites.
Communications of the ACMSlanty design
18 Citations2007Russell Beale
This new take on usability yields desirable (and the absence of undesirable) user behavior, even as it furthers grander corporate goals.
Proceedings of the American Society for Information Science and TechnologyAn analysis of formally published usability and Web usability definitions
15 Citations2009Yu‐Hui Chen, Carol Anne Germain +1 more
The results reveal that there are approximately 11 elements/attributes of usability and web usability addressed within sources from a number of sources, and the top five attributes are: learnability, effectiveness, user-related attributes, users' attitude/satisfaction, and efficiency.
Proceedings of the Human Factors Society Annual MeetingExperience, Utility and Situational Appropriateness: How does Organizational Context Influence Usability of Electronic Communications Media?
9 Citations1992Julie A. Maryniak Nelson, Barrett S. Caldwell
The results of this study support previous research regarding the situational appropriateness of different communication media but did not support the hypotheses regarding user attitudes, support for innovation and the acceptance of the new electronic mail system.
Measuring the conceptual fitness of an application in a computing ecosystem
7 Citations2004Idris Hsi
The computing ecosystem framework with its associated concepts, use niches, use potential, and activation potential is presented and it is shown how the ecosystem framework allows us to characterize the usefulness of an application through the concept of fitness.
Understanding usefulness in human-computer interaction to enhance user experience evaluation
5 Citations2012Craig Matthew MacDonald, Craig Macdonald
Quantitative and qualitative analyses showed that the usefulness of a system is shaped by the context in which it is used, that usability is a major element of usefulness, and that usefulness has both pragmatic and hedonic elements.
Visual walkthrough as a tool for utility assessment in a usability test
2 Citations2013Kristiina Juurmaa, Janne Pitkänen +1 more