Users' criteria for relevance evaluation: A cross-situational comparison

Evidence is provided that a finite range of criteria exists and that these criteria are applied consistently across types of information users, problem situations, and source environments.

Abstract

This article takes a cognitive approach toward understanding the behaviors of end-users by focusing on the values or criteria they employ in making relevance judgments, or decisions about whether to obtain and use information. It compares and contrasts the results of two empirical studies in which criteria were elicited directly from individuals who were seeking information to resolve their own information problems. In one study, respondents were faculty and students in an academic environment examining print documents from traditional text-based information retrieval systems. In the other study, respondents were occupational users of weather-related information in a multimedia environment in which sources included interpersonal communication, mass media, weather instruments, and computerized weather systems. The results of the studies, taken together, provide evidence that a finite range of criteria exists and that these criteria are applied consistently across types of information users, problem situations, and source environments.