Psychometric instability of measures in novel settings: Use of psychiatric rating scales in nursing homes

Journal of Psychopathology and Behavioral AssessmentPublished 1 September 1981

William R. Shadish, Richard R. Bootzin, Diane Koller, Linda Brownell

DOI10.1007/bf01353061

Source URL

Citations9

SJR quartileQ2

SJR score0.79

SNIP0.80

TL;DR

Methods for assessing changes in both reliability and validity of a measure that is used in a novel setting, along with suggestions for how to deal with these problems are presented.

Abstract

Researchers have become increasingly concerned about problems of the quality of measurement in applied evaluation settings. Of particular importance is change in both the reliability and the validity of a measure that is used in a novel setting. This problem is illustrated by an attempt to use psychiatric rating scales to assess the behavior of chronic mental patients currently residing in nursing homes. Methods for assessing changes in both reliability and validity are presented, along with suggestions for how to deal with these problems.

Keywords

MedicineEconomics, Econometrics and FinanceHealth Professions

Psychological BulletinIntraclass correlations: Uses in assessing rater reliability.

23,020 Citations1979Patrick E. Shrout, Joseph L. Fleiss

American Educational Research JournalStatistical Theories of Mental Test Scores

8,138 Citations1969William W. Rozeboom, Frederic M. Lord +2 more

Journal of the American Statistical AssociationComputational Handbook of Statistics.

2,343 Citations1969Alfred Crofts, James L. Bruning +1 more

This work organizes data and some simple Computations into chapters for analysis of Variance, Correlation and Related Topics, and Multivariate Analyses, which summarizes the main findings.

Psychological ReportsMethods for Measuring Adjustment and Social Behavior in the Community: I. Rationale, Description, Discriminative Validity and Scale Development

523 Citations1963Martin M. Katz, Samuel B. Lyerly

Psychological ReportsNOSIE-30: A Treatment-Sensitive Ward Behavior Scale

355 Citations1966Gilbert Honigfeld, Roderic D. Gillis +1 more

The NOSIE-30, especially designed for use by subprofessional personnel, provides an economical and accurate means of systematically assessing patient status and change and cross-validation of these six factor scores and a composite score, Total Patient Assets, were obtained.

Comprehensive PsychiatryPsychological testing

236 Citations1967Marvin L. Kaplan, Michael Hirt +1 more

Evaluation QuarterlyTest-Taking and the Stability of Adjustment Scales

174 Citations1978Daniel W. Edwards, Richard M. Yarvis +3 more

Archives of General PsychiatryA Symptom Rating Scale for Use with Psychotic Patients

42 Citations1959Rachel Jenkins

Evaluation of the effectiveness of the treatment of psychotic patients in 12 Veterans Adminstration neuropsychiatrie hospitals felt the need for techniques which would make it possible to describe the symptoms of patients in some standard form, to describe change quantitatively, and to make possible prognostic groupings of patients on the basis of their symptoms.

Evaluation and Program PlanningHarnessing the reliability of outcome measures

26 Citations1979Rex S. Green, Tuan D. Nguyen +1 more

A method is presented for engineering the necessary levels of measurement reliability for evaluating ongoing programs and the utility of applying generalizability theory to achieve higher reliabilities for outcome measures is illustrated.

New Directions for Program EvaluationAn illustrative project on secondary analysis

8 Citations1978Robert F. Boruch, Paul M. Wortman

Through quantitative and qualitative analyses of program evaluations, the Project on Secondary Analysis, Northwestern University, seeks to advance understanding of program effects and improve evaluation methodology.