How users assess Web pages for information seeking
Journal of the American Society for Information Science and TechnologyPublished 15 December 2004
Anastasios Tombros, Ian Ruthven, Joemon M. Jose
Citations205
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The results of this study provide a set of criteria used by searchers to decide about the utility of Web pages for different types of tasks and can have implications for the design of systems that use or recommend Web pages.
Abstract
Abstract In this article, we investigate the criteria used by online searchers when assessing the relevance of Web pages for information‐seeking tasks. Twenty‐four participants were given three tasks each, and they indicated the features of Web pages that they used when deciding about the usefulness of the pages in relation to the tasks. These tasks were presented within the context of a simulated work‐task situation. We investigated the relative utility of features identified by participants (Web page content, structure, and quality) and how the importance of these features is affected by the type of information‐seeking task performed and the stage of the search. The results of this study provide a set of criteria used by searchers to decide about the utility of Web pages for different types of tasks. Such criteria can have implications for the design of systems that use or recommend Web pages.
Keywords
Computer ScienceSocial Sciences
An Introduction to Qualitative Research
8,172 Citations2023Uwe Flick
Information Processing & ManagementReal life, real users, and real needs: a study and analysis of user queries on the web
1,318 Citations2000Bernard J. Jansen, Amanda Spink +1 more
A failure analysis was conducted, identifying trends among user mistakes, and a summary of findings and a discussion of the implications of these findings were concluded.
Human-Computer Interaction
1,237 Citations2003
A visual task modeling language that can be used by system designers to model human computer interactions and can be translated into SpecTRM-RL, a blackbox specification language for modeling the automated portion of the control system.
Information Retrieval Interaction
605 Citations1992Peter Ingwersen
This electronic version was converted to PDF from the original manuscript with no changes apart from typographical adjustments and it has been ensured that the page numbering of the electronic version matches that of the printed version.
Journal of the American Society for Information ScienceRelevance: The whole history
569 Citations1997Stefano Mizzaro
This article presents the history of relevance through an exhaustive review of the literature under seven different aspects (methodological foundations, different kinds of relevance, beyond-topical criteria adopted by users, modes for expression of the relevance judgment, dynamic nature of relevance), and types of document representation.
Information Processing & ManagementA re-examination of relevance: toward a dynamic, situational definition∗
429 Citations1990Linda Schamber, Michael B. Eisenberg +1 more
This paper reviews literature over the last 30 years that presents various views of relevance as topical, user-oriented, multidimensional, cognitive, and dynamic to build a case for an approach to the problem of definition based on alternative assumptions.
Using information scent to model user information needs and actions and the Web
417 Citations2001Ed H., Peter Pirolli +2 more
Two computational methods for understanding the relationship between user needs and user actions are described, which use a concept called “information scent”, which is the subjective sense of value and cost of accessing a page based on perceptual cues.
Journal of the American Society for Information ScienceUser-defined relevance criteria: An exploratory study
403 Citations1994Carol L. Barry
The results indicate that the criteria employed by users included tangible characteristics of documents (e.g., the information content of the document, the provision of references to other sources of information, subjective qualities) and situational factors ( e.g, the time constraints under which the user was working).
Relevance and Information Behavior.
315 Citations1994Linda Schamber
The author views relevance as a manifestation of human information behavior and excludes work that views relevance only as a matching or computational functions of IR systems.
Journal of the American Society for Information ScienceDifferences between novice and experienced users in searching information on the World Wide Web
289 Citations2000Ard W. Lazonder, H.J.A. Biemans +1 more
This study examined the effect of a user’s WWW experience on both phases of the search process and indicated that subjects with WWW-experience are more proficient in locating Web sites than are noviceWWW-users.
Journal of DocumentationExperimental components for the evaluation of interactive information retrieval systems
266 Citations2000Pia Borlund
The empirical results of the meta‐evaluation provide positive evidence for the application of simulated work task situations to the evaluation of IIR systems and indicate that tailoring work task scenarios to the group of test persons is important in motivating them.
Journal of DocumentationChanges in relevance criteria and problem stages in task performance
235 Citations2000Pertti Vakkari, Nanna Hakala
The findings support to a certain extent the overall hypotheses that a person’s problem stage during task performance is related to his or her use of relevance criteria in assessing retrieved references and documents.
Incorporating quality metrics in centralized/distributed information retrieval on the World Wide Web
223 Citations2000Xiaolan Zhu, Susan Gauch
The results show that incorporating quality metrics can generally improve search effectiveness in both centralized and distributed search environments.
CERN Document Server (European Organization for Nuclear Research)Web Navigation: Designing the User Experience
214 Citations1998Jennifer Fleming
Ten Qualities of Successful Navigation Principles of successful navigation and Designing for Users Defining your audience Moving toward user-centered design Getting started with user testing.
Empirically validated web page design metrics
211 Citations2001Melody Y. Ivory, Rashmi Sinha +1 more
A quantitative analysis of a large collection of expert-rated web sites reveals that page-level metrics can accurately predict if a site will be highly rated and provides empirical evidence that important metrics differ among web site categories.
Journal of the American Society for Information Science and TechnologyCognitive and task influences on Web searching behavior
209 Citations2001Kyung‐Sun Kim, Bryce Allen
The results imply that the flexibility of the Web and Web search engines allows different users to complete different search tasks successfully, however, the search techniques used and the efficiency of the searches appear to depend on how well the individual searcher fits with the specific task.
Information Processing & ManagementA task-oriented study on the influencing effects of query-biased summarisation in web searching
120 Citations2002Ryen W. White, Joemon M. Jose +1 more
A fuel injection pump comprises a housing a pump assembly mounted within the housing and an annular armature slidable within a bore defined in the housing.
International Conference on Human-Computer InteractionThe Contribution of Thumbnail Image, Mouse-over Text and Spatial Location Memory to Web Page Retrieval in 3D.
119 Citations1999Mary Czerwinski, Maarten van Dantzich +2 more
Results indicate that the use of 3D visualization techniques such as those described in this paper can lead to improved user memory for where favorite or frequently used information is stored in an electronic environment.
Journal of the American Society for Information Science and TechnologyUser perspectives on relevance criteria: A comparison among relevant, partially relevant, and not‐relevant judgments
118 Citations2002Kelly L. Maglaughlin, Diane H. Sonnenwald
Results indicate that multiple criteria are used when making relevant, partially relevant, and not-relevant judgments, and that most criteria can have either a positive or negative contribution to the relevance of a document.
Information Processing & ManagementToward an understanding of the dynamics of relevance judgment: An analysis of one person's search behavior
115 Citations1998Rong Tang, Paul Solomon
The subject's deselection of items and associated application of judgment criteria provide specific insights into how relevance judgment occurs, and the findings help untangle the relevance judgment process for one individual and one situation.
Lecture notes in computer scienceThe Use of Implicit Evidence for Relevance Feedback in Web Retrieval
100 Citations2002Ryen W. White, Ian Ruthven +1 more
The research focuses on the degree to which implicit evidence of document relevance can be substituted for explicit evidence in terms of both user opinion and search effectiveness.
Journal of the American Society for Information Science and TechnologyA longitudinal study of World Wide Web users' information‐searching behavior
99 Citations2001Vivian Cothey
A study of the "real world" Web information searching behavior of 206 college students over a 10-month period showed that, contrary to expectations, the users adopted a more passive or browsing approach to Web information search and became more eclectic in their selection of Web hosts as they gained experience.
Computer Networks and ISDN SystemsAn investigation of documents from the World Wide Web
88 Citations1996Allison Woodruff, Paul M. Aoki +3 more
Examination of pages from the World Wide Web collected by the Inktomi Web crawler examines many characteristics of these documents, including document size; number and types of tags, attributes, file extensions, protocols, and ports; the number of in-links; and the ratio of document size to thenumber of tags and attributes.
Introduction to information science
83 Citations1970Tefko Saračević
International Journal of Flexible Manufacturing SystemsBusiness Process Reengineering and Flexibility: A Case for Unification
83 Citations2002Guy Fitzgerald, Feroz A. Siddiqui
Relevance and contributing information types of searched documents in task performance
78 Citations2000Pertti Vakkari
The results demonstrate that different types of information are sought at different stages of the writing process and thus the contribution of the information also differs at the different stages.
Journal of the American Society for Information ScienceEnd‐user searching behavior in information retrieval: A longitudinal study
75 Citations1997Weijing Yuan
Results showed that search experience affected several aspects of end-user behavior, including the increase of participants' command and feature repertoires, some change of overall language usage patterns as reflected in the significant differences in the frequency distributions of commands and features used, increase of search speeds, and change of learning approaches.
Do thumbnail previews help users make better relevance decisions about web search results?
74 Citations2002Susan Dziadosz, Raman Chandrasekar
It is found that in the combination case, users were able to make more accurate decisions about the potential relevance of results than in either of the other versions, with hardly any increase in speed of processing the page as a whole.
Information Processing & ManagementQuestions as a factor in Web search strategy
74 Citations2001Marilyn Domas White, Mirja Iivonen
A model of choice behavior shows relationships among the initial question, the reasons, and the choice of initial search strategies among Web users’ choices of search strategy in the initial stage of a search.
Journal of the American Society for Information Science and TechnologyA comparison of the use of text summaries, plain thumbnails, and enhanced thumbnails for Web search tasks
74 Citations2001Allison Woodruff, Ruth Rosenholtz +3 more
Enhanced thumbnails had more consistent performance than either text summaries or plain thumbnails, having for all categories the best performance or performance that was statistically indistinguishable from the best.
Journal of the American Society for Information ScienceDocument representations and clues to document relevance
68 Citations1998Carol L. Barry
It is concluded that document representations may differ in their effectiveness as indicators of potential relevance because different types of document representations vary in their ability to present clues for specific traits and/or qualities.
Information Processing & ManagementRelevance judgments and the incremental presentation of document representations
57 Citations1991Joseph Janes
A new approach to the solicitation and measurement of relevance judgments is presented, which attempts to resolve some of the difficulties inherent in the nature of relevance and human judgment, and which further seeks to examine how users' judgments of document representations change as more information about documents is revealed to them.
Journal of the American Society for Information ScienceDocument representations and clues to document relevance
37 Citations1998Carol L. Barry
Journal of the American Society for Information ScienceSelected results from an inquiry into testing of information retrieval systems
25 Citations1971Tefko Saračević
The human factor appears to be the main variable in all components of an IR system; length of indexes affects performance considerably more than indexing languages; question analyses and search strategies affect performance to a great extent—as much, if not more thanIndexing.
Features of documents relevant to task- and fact- oriented questions
18 Citations2002Diane Kelly, Xiaojun Yuan +3 more
An ongoing project that considers question types and document features and their relationship to retrieval techniques finds that lists and FAQs occur in more documents judged relevant to task-oriented questions than those judging relevant to fact- oriented questions.
Web page caricatures: multimedia summaries for WWW documents
16 Citations2002Michael Wynblatt, Dan Benson
A visual representation of documents is proposed, called a caricature, which emphasizes the key points of a document in a way which quickly conveys these points to the user, and thus facilitates document selection.