Patterns of Unit and Item Nonresponse in the CAHPS<sup>®</sup> Hospital Survey
Health Services ResearchPublished 15 November 2005Open access
Marc N. Elliott, Carol A. Edwards, January Angeles, Katrin Hambarsoomians, Ron D. Hays
Citations146
SJR quartileQ1
SJR score1.80
SNIP1.37
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Nonresponse weights should not be used for between-hospital comparisons of the CAHPS Hospital Survey, but may make small contributions to overall estimates or demographic comparisons, especially in the absence of case-mix adjustment.
Abstract
OBJECTIVE: To examine the predictors of unit and item nonresponse, the magnitude of nonresponse bias, and the need for nonresponse weights in the Consumer Assessment of Health Care Providers and Systems (CAHPS) Hospital Survey. METHODS: A common set of 11 administrative variables (41 degrees of freedom) was used to predict unit nonresponse and the rate of item nonresponse in multivariate models. Descriptive statistics were used to examine the impact of nonresponse on CAHPS Hospital Survey ratings and reports. RESULTS: Unit nonresponse was highest for younger patients and patients other than non-Hispanic whites (p<.001); item nonresponse increased steadily with age (p<.001). Fourteen of 20 reports of ratings of care had significant (p<.05) but small negative correlations with nonresponse weights (median -0.06; maximum -0.09). Nonresponse weights do not improve overall precision below sample sizes of 300-1,000, and are unlikely to improve the precision of hospital comparisons. In some contexts, case-mix adjustment eliminates most observed nonresponse bias. CONCLUSIONS: Nonresponse weights should not be used for between-hospital comparisons of the CAHPS Hospital Survey, but may make small contributions to overall estimates or demographic comparisons, especially in the absence of case-mix adjustment.
Keywords
Social SciencesHealth ProfessionsEconomics, Econometrics and Finance
TechnometricsStatistical Analysis with Missing Data
3,118 Citations1988Subir Ghosh, Roderick J. A. Little +1 more
Health Services ResearchMeasuring Hospital Care from the Patients' Perspective: An Overview of the CAHPS<sup>®</sup> Hospital Survey Development Process
227 Citations2005Elizabeth Goldstein, Marybeth Farquhar +3 more
The current version of the CAHPS Hospital Survey has survey items in seven domains, two overall ratings of the hospital and five items used for adjusting for the mix of patients across hospitals and for analytical purposes.
Journal of Clinical EpidemiologyA high response is not essential to prevent selection bias
205 Citations2002A. Bootsma–van der Wiel, Eric van Exel +5 more
It was shown that given a moderately high direct response the additional effort was effective in increasing the response rate, but was also selective and was not necessary to prevent selection bias.
Health Services ResearchCase‐Mix Adjustment of the CAHPS<sup>®</sup> Hospital Survey
193 Citations2005A. James O’Malley, Alan M. Zaslavsky +3 more
Case-mix adjustment has a small impact on hospital ratings, but can lead to important reductions in the bias in comparisons between hospitals.
Age and AgeingNon-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men
165 Citations1998Nancy Hoeymans, Edith J. M. Feskens +2 more
The health of non-respondents was worse than that of respondents in terms of stroke, disabilities in BADL and mobility and self-rated health, and due to this selective non-response, the associations between cardiovascular diseases and functional status and self -rated health were biased.
Missing Data
153 Citations1995Roderick J. A. Little, Nathaniel Schenker
Medical CareUsing Telephone Interviews to Reduce Nonresponse Bias to Mail Surveys of Health Plan Members
152 Citations2002Floyd J. Fowler, Patricia M. Gallagher +4 more
Returns to mail surveys are likely to be related to survey content and hence are potentially biased, but telephone interviews of mail nonrespondents can produce less biased samples than mail-only protocols.
PubMedAdjusting Performance Measures to Ensure Equitable Plan Comparisons.
139 Citations2001Alan M. Zaslavsky, Lawrence Zaborski +4 more
An adjustment model that uses self-reported measures of health status, age, education, and whether someone helped the respondent with the questionnaire shows that the impact of adjustment show that the adjustments were usually small but not negligible.
Journal of GerontologyData Quality and Age: Health and Psychobehavioral Correlates of Item Nonresponse and Inconsistent Responses
125 Citations1989Patricia L. Colsher, Robert B. Wallace
Medical CareFactors Affecting Response Rates to the Consumer Assessment of Health Plans Study Survey
111 Citations2002Alan M. Zaslavsky, Lawrence Zaborski +1 more
CAHPS-MMC survey procedures have resulted in high response rates, and current case-mix strategies compensate for some of the remaining effects of differing response rates on comparisons among plans.
EpidemiologyComparison of Early and Late Respondents to a Postal Health Survey Questionnaire
99 Citations1993Annlia Paganini‐Hill, Grace Hsu +2 more
The Joint Commission Journal on Quality ImprovementUnderstanding Patient willingness to Recommend and Return: A Strategy for Prioritizing Improvement Opportunities
85 Citations1999Thomas E. Burroughs, Allyson Ross Davies +2 more
Results suggest that some core issues are of extreme importance to patients regardless of whether they are receiving care in an inpatient, outpatient, or emergency setting.
Journal of GerontologyQuality of Self-report Data: A Comparison of Older and Younger Chronically Ill Patients
77 Citations1992Cathy D. Sherbourne, Lisa S. Meredith
Results support the idea that self-report health data can be gathered from older and younger patients without significant decrements in data quality, and demonstrate similar known-groups validity across age groups.
Psychiatric ServicesMental Illness as a Predictor of Satisfaction With Inpatient Care at Veterans Affairs Hospitals
71 Citations1999Rani A. Hoff, Robert A. Rosenheck +2 more
The results suggest the need for caution in using patient satisfaction measures to compare mental health programs and other health care programs, and the association between low satisfaction and psychiatric diagnosis was more pronounced among nonblack patients.
Journal of Clinical EpidemiologyImpact of reminders and method of questionnaire distribution on patient response to mail-back satisfaction survey
63 Citations2001I. Gasquet, Bruno Falissard +1 more
Reminders do not seem necessary to estimate satisfaction of overall potential respondents, and Distributing questionnaires by mail may be preferred to distribution at discharge to optimize response rate.
Health Services ResearchEquivalence of Mail and Telephone Responses to the CAHPS<sup>®</sup> Hospital Survey
63 Citations2005Han de Vries, Marc N. Elliott +3 more
Telephone mode increases the propensity for more favorable evaluations of care for more than half of the items examined, suggesting that mode of administration should be standardized or carefully adjusted for.
Medical CareAssessment and Control of Nonresponse Bias in a Survey of Medicine Use by the Elderly
60 Citations1994Kelly M. Grotzinger, Bruce Stuart +1 more
Applying a two-stage, limited dependent variable selection model developed by Heckman to baseline Medicare enrollment and utilization data for both respondents and nonrespondents allowed us to detect and control for negative and significant nonresponse bias in estimates of prescription drug use.
American Journal of Public HealthTelephone health surveys: potential bias from noncompletion.
58 Citations1993Shiraz I. Mishra, Deborah A. Dooley +2 more
The Joint Commission Journal on Quality ImprovementChanging Priorities for Improvement: The Impact of Low Response Rates in Patient Satisfaction
46 Citations1996William M. Barkley, David H. Furse
The capriciousness of within-hospital differences based on the First 30% versus All Respondents brings into question the utility of patient satisfaction data based on low response rates even with a reliable instrument and with controlled, consistent data collection methods across hospitals.
European Journal of Public HealthMedical consumption of respondents and non-respondents to a mailed health survey
38 Citations1997Leida M. Lamers
The conclusion from this study is that when a mailed health survey is used to measure medical consumption, the non-response bias will result in a small overestimation of utilization.
Journal of GerontologyAge-Related Item Nonresponse in Surveys of Recently Discharged Patients
31 Citations1992Edward Guadagnoli, Paul D. Cleary
Quality of Self-Report Data
4 Citations2004Cathy D. Sherbourne, Lisa S. Meredith
By focusing on the extensive correspondence between Reade and Darwin, this paper reconstructs the attempt to make an explicitly Darwinian evolutionary epic in order to shed light on the moral and aesthetic demands that worked to give shape to Victorian efforts to historicise humans within a vastly expanding timeframe.