Designing Effective Web Surveys
Cambridge University Press eBooksPublished 1 September 2008
Mick P. Couper
Citations457
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Designing Effective Web Surveys is a practical guide to designing Web surveys, based on empirical evidence and grounded in scientific research and theory, intended for academic, government, and market researchers who design and conduct Web surveys.
Abstract
Designing Effective Web Surveys is a practical guide to designing web surveys, based on empirical evidence and grounded in scientific research and theory. It is designed to guide survey practitioners in the art and science of developing and deploying successful web surveys. The author guides the researcher through the steps involved, from the basic building blocks and suggests ways to increase visual impact and interactivity. Throughout, he considers the importance of layout and design, and attention is also given to the way questions are put together. The book is intended for academic, government, and market researchers who design and conduct web surveys.
Keywords
Social SciencesComputer Science
Journal of the American Statistical AssociationStatistical Analysis With Missing Data
17,489 Citations1989Maureen Lahiff, Roderick J. A. Little +1 more
Psychological MethodsMissing data: Our view of the state of the art.
10,918 Citations2002Joseph L. Schafer, J. A. Graham
2 general approaches that come highly recommended: maximum likelihood (ML) and Bayesian multiple imputation (MI) are presented and may eventually extend the ML and MI methods that currently represent the state of the art.
Mail and internet surveys : the tailored design method
9,659 Citations2007Don A. Dillman
Contemporary Sociology A Journal of ReviewsMail and Telephone Surveys: The Total Design Method.
6,895 Citations1982Earl Babbie, Don A. Dillman
Journal of Experimental Psychology GeneralThe information capacity of the human motor system in controlling the amplitude of movement.
6,321 Citations1992Paul M. Fitts
The experiments reported in the present paper extend the theory to the human motor system, including the visual and proprioceptive feedback loops that permit S to monitor his own activity and create an experimental situation in which it is reasonable to assume that performance is limited primarily by the capacity of the motor system.
Applied ErgonomicsDesigning the user interface: Strategies for effective human-computer interaction
5,616 Citations1993
Cambridge University Press eBooksThe Psychology of Survey Response
4,650 Citations2000Roger Tourangeau, Lance J. Rips +1 more
Principles Of Gestalt Psychology
4,257 Citations2013K. Koffka
University of New Hampshire Scholars Repository (University of New Hampshire at Manchester)Information Visualization: Perception for Design
3,776 Citations2000Colin Ware
Applied Cognitive PsychologyResponse strategies for coping with the cognitive demands of attitude measures in surveys
2,393 Citations1991Jon A. Krosnick
Public Opinion QuarterlyNonresponse Rates and Nonresponse Bias in Household Surveys
2,365 Citations2006Robert M. Groves
Public Opinion QuarterlyWeb Surveys
2,066 Citations2000Mick P. Couper
By offering a typology of Web survey designs, the intent of this article is to facilitate the task of evaluating and improving Web surveys.
Public Opinion QuarterlyA Comparison of Web and Mail Survey Response Rates
1,670 Citations2004Michael D. Kaplowitz, T. D. Hadlock +1 more
The Internet (also called the World Wide Web or the Web) is increasingly looked at as a means of surveying the public and in populations with access to the Internet, response rates for e-mail and Web surveys may not match those of other survey methods.
University of Maribor digital library (University of Maribor)Designing Web Usability
1,620 Citations1999Jakob Nielsen
The author concludes that Simplicity in Web Design is the most important quality in web design and that international use and international use should be considered separately.
Kegan Paul, Trench, Trubner & Company eBooksLaws of organization in perceptual forms.
1,472 Citations1938Max Wertheimer
Journal of the American Statistical AssociationSurvey Errors and Survey Costs.
1,452 Citations1990G. David Faulkenberry, Robert M. Groves
Journal of Educational PsychologyCognitive principles of multimedia learning: The role of modality and contiguity.
1,418 Citations1999Roxana Moreno, Richard E. Mayer
Information Processing & ManagementReal life, real users, and real needs: a study and analysis of user queries on the web
1,318 Citations2000Bernard J. Jansen, Amanda Spink +1 more
A failure analysis was conducted, identifying trends among user mistakes, and a summary of findings and a discussion of the implications of these findings were concluded.
Public Opinion QuarterlyAsking Sensitive Questions: The Impact of Data Collection Mode, Question Format, and Question Context
1,317 Citations1996Roger Tourangeau, Tom Smith
ACM SIGIR ForumAnalysis of a very large web search engine query log
1,159 Citations1999Craig Silverstein, Hannes Marais +2 more
It is shown that web users type in short queries, mostly look at the first 10 results only, and seldom modify the query, suggesting that traditional information retrieval techniques may not work well for answering web search requests.
Journal of AdvertisingMeasures of Perceived Interactivity: An Exploration of the Role of Direction of Communication, User Control, and Time in Shaping Perceptions of Interactivity
1,042 Citations2002Sally J. McMillan, Jangsun Hwang
A multistage method is used to identify and refine measures of perceived interactivity (MPI), and three overlapping constructs that are central to interactivity are explored: direction of communication, user control, and time.
TechnometricsNonresponse in Household Interview Surveys
1,015 Citations1999Eric R. Ziegel, Robert M. Groves +1 more
American PsychologistPsychological Research Online: Report of Board of Scientific Affairs' Advisory Group on the Conduct of Research on the Internet.
926 Citations2004Robert E. Kraut, Judith Olson +4 more
Communications of the ACMTelling humans and computers apart automatically
906 Citations2004Luis von Ahn, Manuel Blum +1 more
Educational Psychology ReviewPictorial Illustrations Still Improve Students' Learning from Text
859 Citations2002Russell N. Carney, Joel R. Levin
Public Opinion QuarterlyDevelopment of a Standard E-Mail Methodology: Results of an Experiment
834 Citations1998David R. Schaefer, Don A. Dillman
The multimode approach proved to be successful and techniques shown to be effective in standard mail surveys were also found to be appropriate for an E-mail survey.
Marketing LettersResponse Rate and Response Quality of Internet-Based Surveys: An Experimental Study
828 Citations2004Elisabeth Deutskens, Ko de Ruyter +2 more
The results show that short questionnaires have a higher response rate, although long questionnaires still generate a surprisingly high response, and vouchers seem to be the most effective incentive in long questionnaire, while lotteries are more efficient in short surveys.
Consciousness and CognitionEffects of Perceptual Fluency on Judgments of Truth
824 Citations1999Rolf Reber, Norbert Schwarz
It is concluded that perceptual fluency affects judgments of truth in statements presented in colors that made them easy or difficult to read against a white background.
Public Opinion QuarterlyAn Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
809 Citations1987Jon A. Krosnick, Duane F. Alwin
Journal of Official StatisticsTo mix or not to mix data collection modes in surveys.
809 Citations2005Edith D. de Leeuw
Journal of Applied PsychologyA meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews.
795 Citations1999Wendy L. Richman, Sara Kiesler +2 more
A meta-analysis of social desirability distortion compared computer questionnaires with traditional paper-and-pencil questionnaires and face-to-face interviews in 61 studies, finding a near-zero overall effect size.
Public Opinion QuarterlyWeb Survey Design and Administration
781 Citations2001Mick P. Couper, Michael W. Traugott +1 more
The overall implementation and outcome of the survey is discussed, the results of the imbedded design experiments are described, and they are described.
Field MethodsAdvantages and Disadvantages of Internet Research Surveys: Evidence from the Literature
739 Citations2002Ronald D. Fricker, Matthias Schonlau
The authors evaluate popular claims that Internet-based surveys can be conducted more quickly, effectively, cheaply, and/or easily than surveys conducted via conventional modes and find that the realities of cost and speed often do not live up to the hype.
Public Opinion QuarterlyEstimating the Effect of Incentives on Mail Survey Response Rates: A Meta-Analysis
704 Citations1993Allan H. Church
Journal of Applied Social PsychologyAre Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices
639 Citations1997Clifford Nass, Youngme Moon +1 more
There is evidence that the tendency to gender stereotype is extremely powerful, extending even to stereotyping of machines, as tested under conditions in which all suggestions of gender were removed.
RAND Corporation eBooksConducting Research Surveys via E-mail and the Web
605 Citations2002Ronald D. Fricker, Marc N. Elliott +1 more
New Media & SocietyInteractivity: a concept explication
585 Citations2002Spiro Kiousis
It is suggested that interactivity is both a media and psychological factor that varies across communication technologies, communication contexts, and people’s perceptions.
Social Science Computer ReviewWeb Surveys
569 Citations2001Scott Crawford, Mick P. Couper +1 more
The authors examined the decision to respond to a Web survey by embedding a series of experiments in a survey of students at the University of Michigan, designed to vary the burden of the survey request.
Public Opinion QuarterlyResponse Effects in the Electronic Survey
567 Citations1986Sara Kiesler, Lee Sproull
An experimental sample survey on health attitudes, behaviors, and personal traits using two forms of administra- tion: electronic and paper mail found closed-end responses in the electronic survey were less socially desirable and tended to be more extreme than were response in the paper survey.
Journal of Marketing ResearchPreference Fluency in Choice
546 Citations2007Nathan Novemsky, Ravi Dhar +2 more
Medical Entomology and ZoologyCognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
540 Citations2014Norbert Schwarz
Wiley series in probability and statisticsDesigning Rating Scales for Effective Measurement in Surveys
508 Citations1997Jon A. Krosnick, Leandre R. Fabrigar
Journal of Product Innovation ManagementThe virtual customer
457 Citations2002Ely Dahan
This article reviews six web-based methods of customer input as examples of the improved Internet capabilities of communication, conceptualization, and computation and discusses how they complement existing methods.
A primer of visual literacy
454 Citations1973Donis A. Dondis
Marketing ScienceA Choice Model with Conjunctive, Disjunctive, and Compensatory Screening Rules
449 Citations2004Timothy J. Gilbride, Greg M. Allenby
Management ScienceEffects of Color as an Executional Cue in Advertising: They're in the Shade
443 Citations1997Gerald J. Gorn, Amitava Chattopadhyay +2 more
Public Opinion QuarterlyRating Scales: Numeric Values May Change the Meaning of Scale Labels
405 Citations1991Norbert Schwarz, Bärbel Knaüper +3 more
Journal of Applied Social PsychologyAre People Polite to Computers? Responses to Computer‐Based Interviewing Systems<sup>1</sup>
402 Citations1999Clifford Nass, Youngme Moon +1 more
Testing whether people are “polite” to computers found that among people, an interviewer who directly asks about him- or herself will receive more positive and less varied responses than if the same question is posed by a third party.
Public Opinion QuarterlySpacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
396 Citations2004Roger Tourangeau
Medical Decision MakingReducing the Influence of Anecdotal Reasoning on People’s Health Care Decisions: Is a Picture Worth a Thousand Statistics?
382 Citations2005Angela Fagerlin, Catharine Wang +1 more
Presenting statistical information using a pictograph can reduce the undue influence of anecdotal reasoning on treatment choices, and two cross-sectional survey studies using hypothetical scenarios proved this.
Journal of Marketing ResearchWaiting for the Web: How Screen Color Affects Time Perception
366 Citations2004Gerald J. Gorn, Amitava Chattopadhyay +2 more
Public Opinion QuarterlyThe Impact of Candidate Name Order on Election Outcomes
353 Citations1998Joanne M. Miller, Jon A. Krosnick
Behaviour and Information TechnologyThe impact of web page text-background colour combinations on readability, retention, aesthetics and behavioural intention
339 Citations2004Richard H. Hall, Patrick Hanna
Major findings were: Colours with greater contrast ratio generally lead to greater readability, and preferred colours led to higher ratings of aesthetic quality and intention to purchase.
Choice Reviews OnlineWeb style guide: basic design principles for creating web sites
335 Citations1999Patrick J. Lynch
OPUS (Augsburg University)Incentives in Web Studies: Methodological Issues and a Review
308 Citations2006Anja S. Göritz
Two meta-analyses review the effectiveness of incentives in Web studies and reveal that once people have accessed a survey for whatever reasons, they are more likely to finish if an incentive is offered.
Social Science Computer ReviewEvaluating the Effectiveness of Visual Analog Scales
297 Citations2006Mick P. Couper, Roger Tourangeau +2 more
An experiment to explore the utility of a VAS in a web survey, comparing it to radio button input and numeric entry in a text box on a series of bipolar questions eliciting views on genetic versus environmental causes of various behaviors.
Applied Cognitive PsychologyFast times and easy questions: the effects of age, experience and question complexity on web survey response times
281 Citations2007Ting Yan, Roger Tourangeau
Examination of response times to survey questions indicates that response times are affected by question characteristics such as the total number of clauses and the number of words per clause that probably reflect reading times, and respondent-level characteristics are shown to vary randomly over questions.
Social Science ResearchNoncoverage and nonresponse in an Internet survey
276 Citations2005Mick P. Couper, Arie Kapteyn +2 more
Noncoverage (lack of access to the Internet) appears to be of greater concern than nonresponse (unwillingness to participate given access) for representation in Internet surveys of persons 50 years old and older in the US.
Journal of Studies on AlcoholMode effects for collecting alcohol and other drug use data: Web and U.S. mail.
253 Citations2002Sean Esteban McCabe, Carol J. Boyd +3 more
Journal of Product Innovation ManagementThe predictive power of internet-based product concept testing using visual depiction and animation
250 Citations2000Ely Dahan
An Internet-based product concept testing method that incorporates virtual prototypes of new product concepts, substituting them for physical prototypes to allow design teams to select the best of several new concepts within a product category with which to proceed, without having to develop physical prototypes.
John Wiley & Sons, Inc. eBooksAbout Face: The Essentials of User Interface Design
247 Citations1995Alan Cooper
About Face, respected software designer Alan Cooper shares his own real-world experience and design principles so that you, too, can fashion intuitive, effective user interfaces.
Field MethodsSurvey Mode as a Source of Instability in Responses across Surveys
244 Citations2004Don A. Dillman, Leah Melani Christian
Ktisis at Cyprus University of Technology (Cyprus University of Technology)Usability for the Web: Designing Web Sites that Work
242 Citations2001Tom Brinck, Darren Gergle +1 more
This book tells you how to design usable web sites in a systematic process applicable to almost any business need, and examines the entire spectrum of usability issues, including architecture, navigation, graphical presentation, and page structure.
Human Factors The Journal of the Human Factors and Ergonomics SocietyThe Formatting of Alphanumeric Displays: A Review and Analysis
233 Citations1983Thomas S. Tullis
Four characteristics of display formats are described and Objective measurement techniques for these characteristics are proposed and applied to two different display formats, suggesting that these measures could provide the basis for objectively evaluating a display without collecting performance data.
Journal of Consumer PsychologyAll Dressed Up With Something to Say: Effects of Typeface Semantic Associations on Brand Perceptions and Consumer Memory
233 Citations2002Terry L. Childers, Jeffrey Jass
European Journal of EpidemiologyFeasibility of Using Web-based Questionnaires in Large Population-based Epidemiological Studies
225 Citations2006Alexandra Ekman, Paul W. Dickman +3 more
It is concluded that web-based questionnaires are a feasible tool for data collection in large population based epidemiological studies in Sweden and socio-demographic patterns vary between responders to a web and a paper questionnaire.
Public Opinion QuarterlyInterviewer Gender and Gender Attitudes
202 Citations1993Emily W. Kane, Laura J. Macaulay
Research in Higher EducationThe Impact of Lottery Incentives on Student Survey Response Rates
199 Citations2003Stephen R. Porter, Michael E. Whitcomb
Social Science Computer ReviewTechnology Trends in Survey Data Collection
199 Citations2005Mick P. Couper
The state of the field with regard to emerging data collection technologies, and their implications for survey research are reviewed.
Public Opinion QuarterlyClarifying Question Meaning in a Household Telephone Survey
195 Citations2000Frederick G. Conrad, Michael F. Schober
It is concluded that respondents in a national sample may misinterpret certain questions frequently enough to compromise data quality and that such misunderstandings cannot easily be eliminated by pretesting and rewording questions alone.
The MIT Press eBooksTruth Is Beauty: Researching Embodied Conversational Agents
193 Citations2000Clifford Nass, Katherine Isbister +1 more
Wiley series in probability and statisticsTowards a Theory of Self‐Administered Questionnaire Design
190 Citations1997Cleo R. Jenkins, Don A. Dillman
Journal of DocumentationA taxonomy of relationships between images and text
188 Citations2003Emily Marsh, Marilyn Domas White
The paper uses qualitative content analysis to illustrate use of the taxonomy to analyze four image‐text pairs in government publications and discusses the implications of the research for information retrieval and document design.
Journal of Computer-Mediated CommunicationClassifying Response Behaviors in Web-based Surveys
185 Citations2006Michael Bošnjak, Tracy L. Tuten
This paper describes these seven response patterns in a typology of response behaviors as well as three possible response behaviors (unit nonresponse, item non response, and complete response) that can be addressed in traditional survey literature.
American Journal of Preventive MedicineDesign Effects in the Transition to Web-Based Surveys
182 Citations2007Don A. Dillman, Jolene D. Smyth
This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions and suggests suggested guidelines for web survey design.
Journal of the American Statistical AssociationA Split Questionnaire Survey Design
178 Citations1995Trivellore E. Raghunathan, James E. Grizzle
A multiple imputation method for analyzing data from this design is developed, in which the imputations are created by random draws from the posterior predictive distribution of the missing parts, given the observed parts by using Gibbs sampling under a general location scale model.
Social Science Computer ReviewA Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey
173 Citations2004Matthias Schonlau, Kinga Zapert +8 more
Responses to web survey responses were significantly more likely to agree with RDD responses when the question asked about the respondent’s personal health, was a factual question, and only had two as opposed to multiple response categories.
Social Psychology QuarterlyRace in the Live and the Virtual Interview: Racial Deference, Social Desirability, and Activation Effects in Attitude Surveys
169 Citations2003Maria Krysan, Mick P. Couper
Journal of Computer-Mediated CommunicationDesign of Web Survey Questionnaires: Three Basic Experiments
166 Citations2006Katja Lozar Manfreda, Zenel Batagelj +1 more
Basic experiments to address question wording, form and graphic layout of the questionnaire, one vs. multiple-page design, use of logotypes, and survey topic are presented.
Social Science Computer ReviewWhat They See Is What We Get
165 Citations2004Mick P. Couper, Roger Tourangeau +2 more
The authors find evidence of response order effects but stronger evidence that visible response options are endorsed more frequently, suggesting that visibility may be a more powerful effect than primacy in web surveys.
Public Opinion QuarterlyThe Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions
165 Citations2004Christian Lovis, D. A. Dillman
International Journal of Market ResearchThe Impact of Material Incentives on Response Quantity, Response Quality, Sample Composition, Survey Outcome and Cost in Online Access Panels
165 Citations2004Anja S. Gritz
Public Opinion QuarterlyWeb Survey Design: Paging versus Scrolling
151 Citations2006Andy Peytchev, M. P. Couper +2 more
A key choice in the design of Web surveys is whether to place the survey questions in a multitude of short pages or in long scrollable pages, with advantages and disadvantages, but little empirical evidence to guide the choice.
Public Opinion QuarterlyColor, Labels, and Interpretive Heuristics for Response Scales
151 Citations2007Roger Tourangeau, Mick P. Couper +1 more
Journal of Epidemiology & Community HealthMeta-analysis of randomised trials of monetary incentives and response to mailed questionnaires
150 Citations2005Phil Edwards, Rachel Cooper +2 more
This meta-analysis of the best available evidence shows that monetary incentives increase mailed questionnaire response and researchers should include small amounts of money with mailed questionnaires rather than give no incentive at all.
Public Opinion QuarterlyThe Influence of Advance Letters on Response in Telephone Surveys: A Meta-Analysis
149 Citations2007Edith D. de Leeuw, Mario Callegaro +3 more
Ergonomics In Computerized Offices
148 Citations1986E. Grandjean
Public Opinion QuarterlyEffects of Personal Salutations in E-mail Invitations to Participate in a Web Survey
147 Citations2005Dirk Heerwegh
Using data from a Web experiment conducted among first-year university students, personalization of e-mail invitations is shown to have significantly increased the response rate, and no effects of personalization on the responses to a question probing for respondents' sexual behavior were found.
Landscape ResearchCreating Landscape Preference Models Using Internet Survey Techniques
147 Citations2000JoAnna Ruth Wherrett
Social Science Computer ReviewPrepaid and promised incentives in web surveys: an experiment
144 Citations2003Michael Bošnjak, Tracy L. Tuten
The Annals of the American Academy of Political and Social ScienceSay it with Pictures
142 Citations1996Doris Α. Graber
Behaviour and Information TechnologyHow physical text layout affects reading from screen
135 Citations2004Mary C. Dyson
A synthesis of results is offered which provides alternative interpretations of some findings and identifies the number of characters per line as the critical variable in looking at line length.
Drug and Alcohol DependenceAn Internet-based survey method for college student drinking research
133 Citations2004Kypros Kypri, Steve Gallagher +1 more
Internet-based surveys are feasible for college student research and with carefully managed recruitment, can yield a high response, and no modality effects are revealed.
Psychology and MarketingEffects of typographic factors in advertising‐based persuasion: A general model and initial empirical tests
131 Citations2002Michael McCarthy, David L. Mothersbaugh
International Journal of Social Research MethodologyThe effect of personalization on response rates and data quality in web surveys
130 Citations2005Dirk Heerwegh, Tim Vanhove +2 more
It is concluded that personalization has positive effects on the survey response rate, but one should carefully consider whether or not to personalize when a survey on sensitive topics is conducted.
…