E-mail Survey Response Rates: A Review
Journal of Computer-Mediated CommunicationPublished 23 June 2006
Kim Bartel Sheehan
Citations1,430
SJR quartileQ1
SJR score2.22
SNIP2.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Responses to e-mail surveys undertaken since 1986 are analyzed and correlation and regression analyses suggest that year that the survey was undertaken and number of follow-up contacts had the most influence on response rates.
Abstract
Electronic mail (e-mail) has been used to distribute surveys and collect data from online users for almost fifteen years. However, some have suggested that the use of e-mail is becoming obsolete. This study analyzes response rates to e-mail surveys undertaken since 1986 and examines five influences to response rates: the year the study was undertaken, the number of questions in the survey, the number of pre-notification contacts, the number of follow-up contacts and survey topic salience. Response rates to e-mail surveys have significantly decreased since 1986. Correlation and regression analyses suggest that year that the survey was undertaken and number of follow-up contacts had the most influence on response rates. A discussion of other influences and future research into this area is provided.
Keywords
Social Sciences
BiometricsThe Measurement of Observer Agreement for Categorical Data
78,934 Citations1977J. Richard Landis, Gary G. Koch
A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
Mail and internet surveys : the tailored design method
9,659 Citations2007Don A. Dillman
Educational and Psychological MeasurementA Meta-Analysis of Response Rates in Web- or Internet-Based Surveys
2,414 Citations2000Colleen Cook, Fred Heath +1 more
The number of contacts, personalized contacts, and precontacts are the factors most associated with higher response rates in the Web studies that are analyzed.
American Sociological ReviewFactors Affecting Response Rates to Mailed Questionnaires: A Quantitative Analysis of the Published Literature
1,005 Citations1978Thomas A. Heberlein, Robert Baumgartner
Journal of Marketing ResearchMail Surveys and Response Rates: A Literature Review
859 Citations1975Leslie Lazar Kanuk, Conrad Berenson
Public Opinion QuarterlyDevelopment of a Standard E-Mail Methodology: Results of an Experiment
834 Citations1998David R. Schaefer, Don A. Dillman
The multimode approach proved to be successful and techniques shown to be effective in standard mail surveys were also found to be appropriate for an E-mail survey.
Public Opinion QuarterlyUnderstanding The Decision to Participate in a Survey
818 Citations1992Robert M. Groves, Robert B. Cialdini +1 more
Public Opinion QuarterlyMail Survey Response Rate: A Meta-Analysis of Selected Techniques for Inducing Response
675 Citations1988Richard J. Fox, Melvin R. Crask +1 more
Public Opinion QuarterlyUnderstanding Mail Survey Response Behavior: A Meta-Analysis
574 Citations1991Francis J. Yammarino, Steven J. Skinner +1 more
Public Opinion QuarterlyResponse Effects in the Electronic Survey
567 Citations1986Sara Kiesler, Lee Sproull
An experimental sample survey on health attitudes, behaviors, and personal traits using two forms of administra- tion: electronic and paper mail found closed-end responses in the electronic survey were less socially desirable and tended to be more extreme than were response in the paper survey.
Personnel PsychologyAN EMPIRICAL ASSESSMENT OF DATA COLLECTION USING THE INTERNET
532 Citations1998Jeffrey M. Stanton
Analyses of the 2 data sets supported an exploration of the viability of World Wide Web data collection, and the costs and benefits of using access controls to improve sampling.
Journal of Computer-Mediated CommunicationComparative Response to a Survey Executed by Post, E-mail, & Web Form
462 Citations2006Gi Woong Yun, Craig W. Trumbo
The differences detected in the response groups indicate that using multi-mode survey techniques improved the representativeness of the sample without biasing other results.
Administrative Science QuarterlyOrganizational Survey Nonresponse
333 Citations1994Donald Tomaskovic‐Devey, Jeffrey Leiter +1 more
Journal of Advertising ResearchResponse Variation in E-Mail Surveys: An Exploration
316 Citations1999Kim Batel Sheehan, Sally J. McMillan
Journal of Computer-Mediated CommunicationCasting The Net: Surveying an Internet Population
248 Citations2006Christine B. Smith
This article contrasts e-mail and web-based survey techniques used in an ongoing study of the web presence provider industry, highlighting practical issues of web-surveying methods such as programming pitfalls, sample-building, and incentives.
Journal of Computer-Mediated CommunicationUsing E-mail To Survey Internet Users In The United States: Methodology And Assessment
230 Citations2006Kim Bartel Sheehan, Mariea Grubbs Hoy
The authors' experience using e-mail to study a national sample of Internet users is presented, beginning with a discussion of how a sample of on-line users can be selected using a ‘people finder’ search engine.
American Sociological ReviewProfit Constraints on Managerial Autonomy: Managerial Theory and the Unmaking of the Corporation President
161 Citations1981David R. James, Michael Soref
Market Research Society JournalSampling for Internet Surveys. An Examination of Respondent Selection for Internet Research
143 Citations1999Nigel Bradley
The traditional methods of probability and non-probability sample selection are applicable to Internet surveys and respondents can be selected in various ways, some of which are unique to the Internet.
International Journal of Market ResearchComparing Two Forms of an E-mail Survey: Embedded vs Attached
140 Citations2000Curt J. Dommeyer, Eleanor Moriarty
An experiment that compares an embedded e- email survey with an attached e-mail survey yielded a significantly higher response rate than the attached survey, but there were no differences between the two methods on response speed, number of item omissions, or response bias.
Teaching and Learning in MedicineResponse Rate Comparisons of E-Mail- and Mail-Distributed Student Evaluations
131 Citations2000Anthony M. Paolo, Giulia Bonaminio +3 more
Although the findings have limited generalizability because of low response rates and small sample sizes, the results suggest caution when using e-mail to collect curriculum evaluations from 4th-year medical students.
Industrial Marketing ManagementImproving response rates in industrial mail surveys
131 Citations1986David Jobber
Public Opinion QuarterlySelf-Selected and Randomly Selected Respondents in a Computer Network Survey
113 Citations1992John P. Walsh, Sara Kiesler +2 more
Using comparisons of the random sample with the self-selected group, it is sought to understand this motivated responding and the biases entailed.
UNDERSTANDING MAIL SURVEY RESPONSE BEHAVIOR
109 Citations2004A Meta-Analysis, Francis J. Yammarino +2 more
Social Science Computer ReviewInternet Surveys by Direct Mailing
104 Citations1997Walter Swoboda, Nikolai Mühlberger +2 more
Social Science Computer ReviewUsing Electronic Mail Surveys and Computer-Monitored Data for Studying Computer-Mediated Communication Systems
90 Citations1995Susan E. Anderson, Bruce M. Gansneder
The methodology used in this study demonstrated an effective and relatively cost- and time-efficient means of studying a public telecomputing system using computer-mon itored data and a lengthy electronic mail survey.
Journal of Applied PsychologyQuestionnaire design, return rates, and response favorableness in an employee attitude questionnaire.
88 Citations1990Michael T. Roberson, Eric Sundstrom
Journal of Business ResearchRiding the Wave
82 Citations2000Cindy Claycomb, Stephen S. Porter +1 more
New Directions for EvaluationInternet systems for evaluation research
70 Citations1999James H. Watt
The author provides a detailed description of diverse Web‐based data collection tools and enumerates their advantages, disadvantages, and logistical challenges.
Journal of Marketing ResearchThe Distribution of Survey Contact and Participation in the United States: Constructing a Survey-Based Estimate
63 Citations1999Barbara Bickart, David C. Schmittlein
Public Opinion QuarterlyAn Experimental Study of Factors Affecting Response to a Mail Survey of Beginning Teachers
55 Citations1961Ward S. Mason, Robert J. Dressel +1 more
Market Research Society JournalUsing the Internet for Market Research: A Study of Private Trading on the Internet
42 Citations1999Matthew Lee, Ray Kent
The results of a study of private trading over the Internet are presented, which presents the potentials and pitfalls involved and analyses approaches to the risks involved.
Journal of Business ResearchA model for estimating the response rate to a mailed survey
39 Citations1988Norman T. Bruvold, James M. Comer
Public Opinion QuarterlyUse of a Postcard Query in Mail Surveys
38 Citations1965Morton L. Brown
A query form which appeared simple to complete and minimized the work required of the physicians who had seen no patient with cystic fibrosis would elicit a higher response rate at a lower cost than would a longer questionnaire designed primarily for the physician who might have one or more cases to report.
Management Communication QuarterlyA Profile of Users of Electronic Mail in a University
37 Citations1991Susan H. Komsky
Examination of factors that differentiate among frequent and occasional users of electronic mail, for the purpose of developing a profile of users to help organizations develop strategies for increasing system usage, demonstrated that frequent users are significantly different from occasional users on all of the factors.
Industrial Marketing ManagementEffect of industrial prenotification on response rate, speed, quality, bias, and cost
36 Citations1994Sarah Hagget, Vincent‐Wayne Mitchell
Journal of Business ResearchA note on the applicability of the Bruvold-Comer model of mail survey response rates to commercial populations
28 Citations1993David Jobber, John Saunders
A new logit model was developed using commercial data and validated with a holdout sample that can be used by researchers as an aid to predicting response from commercial populations for a given survey design and as a test bed to assess the implications of alternative design configurations.
Industrial Marketing ManagementImproving survey responses with postcards
26 Citations1990Paul R. Murphy, Douglas R. Dalenberg +1 more
Journal of Current Issues & Research in AdvertisingOnline Privacy: Internet Advertising Practitioners' Knowledge and Practices
18 Citations2001Kim Bartel Sheehan, Timothy W. Gleason
Perceptual and Motor SkillsEffect on Mail Survey Return Rates of Including Questionnaires with Follow-up Letters
17 Citations1981Charles M. Futrell, Charles W. Lamb
The results suggest more than one follow-up with a questionnaire is needed and that a letter only was an ineffective method.
Developments in marketing science: proceedings of the Academy of Marketing ScienceExploring Text-Based Electronic Mail Surveys as a Means of Primary Data Collection
13 Citations2015Theresa B. Flaherty, Earl D. Honeycutt +1 more