Automatic identification of user goals in Web search
Published 1 January 2005
Uichin Lee, Zhenyu Liu, Junghoo Cho
Citations403
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper presents the results from a human subject study that strongly indicate the feasibility of automatic query-goal identification, and proposes two types of features for the goal-identification task: user-click behavior and anchor-link distribution.
Abstract
There has been recent interests in studying the "goal" behind a user's Web query, so that this goal can be used to improve the quality of a search engine's results. Previous studies have mainly focused on using manual query-log investigation to identify Web query goals. In this paper we study whether and how we can automate this goal-identification process. We first present our results from a human subject study that strongly indicate the feasibility of automatic query-goal identification. We then propose two types of features for the goal-identification task: user-click behavior and anchor-link distribution. Our experimental evaluation shows that by combining these features we can correctly identify the goals for 90% of the queries studied.
Keywords
Computer Science
Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine
15,828 Citations1998Sergey Brin, Lawrence M. Page
This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.
Cambridge University Press eBooksAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
13,883 Citations2000Nello Cristianini, John Shawe‐Taylor
Journal of the ACMAuthoritative sources in a hyperlinked environment
9,060 Citations1999Jon Kleinberg
This work proposes and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure, and has connections to the eigenvectors of certain matrices associated with the link graph.
Programs for Machine Learning
5,794 Citations1994Steven L. Salzberg, Alberto M. Segre
In his new book, C4.5: Programs for Machine Learning, Quinlan has put together a definitive, much needed description of his complete system, including the latest developments, which will be a welcome addition to the library of many researchers and students.
ePrints Soton (University of Southampton)An Introduction to Support Vector Machines
4,120 Citations2000Nello Cristianini, John Shawe‐Taylor
BiometricsProbability and Statistics for Engineering and the Sciences.
2,519 Citations1991Jay L. Devore
ACM SIGIR ForumA taxonomy of web search
1,923 Citations2002Andrei Broder
This taxonomy of web searches is explored and how global search engines evolved to deal with web-specific needs is discussed.
Topic-sensitive PageRank
1,524 Citations2002Taher H. Haveliwala
A set of PageRank vectors are proposed, biased using a set of representative topics, to capture more accurately the notion of importance with respect to a particular topic, and are shown to generate more accurate rankings than with a single, generic PageRank vector.
Information Processing & ManagementReal life, real users, and real needs: a study and analysis of user queries on the web
1,318 Citations2000Bernard J. Jansen, Amanda Spink +1 more
A failure analysis was conducted, identifying trends among user mistakes, and a summary of findings and a discussion of the implications of these findings were concluded.
TechnometricsMathematical Statistics with Applications
1,295 Citations1987Gary E. Meek, William M. Mendenhall +2 more
ACM SIGIR ForumAnalysis of a very large web search engine query log
1,159 Citations1999Craig Silverstein, Hannes Marais +2 more
It is shown that web users type in short queries, mostly look at the first 10 results only, and seldom modify the query, suggesting that traditional information retrieval techniques may not work well for answering web search requests.
Elsevier eBooksCombating Web Spam with TrustRank
1,025 Citations2004Zoltán Gyöngyi, Héctor García-Molina +1 more
This paper proposes techniques to semi-automatically separate reputable, good pages from spam, and shows that they can effectively filter out spam from a significant fraction of the web, based on a good seed set of less than 200 sites.
Understanding user goals in web search
934 Citations2004Daniel E. Rose, Danny Levinson
A framework for understanding the underlying goals of user searches is described and the experience in using the framework to manually classify queries from a web search engine is illustrated.
Agglomerative clustering of a search engine query log
767 Citations2000Doug Beeferman, Adam Berger
Computer NetworksGrouper: a dynamic clustering interface to Web search results
716 Citations1999Oren Zamir, Oren Etzioni
This paper introduces Grouper, an interface to the results of the HuskySearch meta-search engine, which dynamically groups the search results into clusters labeled by phrases extracted from the snippets, and reports on the first empirical comparison of user Web search behavior on a standard ranked-list presentation versus a clustered presentation.
Learning to cluster web search results
582 Citations2004Hua-Jun Zeng, Qi-Cai He +3 more
This paper reformalizes the clustering problem as a salient phrase ranking problem, and first extracts and ranks salient phrases as candidate cluster names, based on a regression model learned from human labeled training data.
ComputerFrom e-sex to e-commerce: Web search changes
472 Citations2002Amanda Spink, Bernard J. Jansen +2 more
Analysis of three data sets culled from more than one million queries submitted by more than 200,000 users of the Excite Web search engine shows that public Web searching is evolving in certain directions.
Journal of the American Society for Information Science and TechnologyA review of Web searching studies and a framework for future research
414 Citations2001Bernard J. Jansen, Udo W. Pooch
The results from published studies of Web searching are reviewed and the searching characteristics of Web users are compared and contrasted with users of traditional information retrieval and online public access systems to discover if there is a need for more studies that focus predominantly or exclusively on Web searching.
Effective site finding using link anchor information
266 Citations2001Nick Craswell, David Hawking +1 more
In a different type of experiment, ranking based on link anchor text is twice as effective asranking based on document content, even though both methods used the same BM25 formula.
Query type classification for web document retrieval
250 Citations2003In-Ho Kang, Gil-Chang Kim
A user query classification scheme that uses the difference of distribution, mutual information, the usage rate as anchor texts, and the POS information for the classification and could get the best performance when the OKAPI scoring algorithm was used.
ACM Transactions on Computer-Human InteractionScentTrails
249 Citations2003Christopher Olston, Ed H.
This work introduces a novel approach called ScentTrails, based on the concept of information scent developed in the context of information foraging theory, that enables users to interpolate smoothly between searching and browsing to locate content matching complex information goals effectively.
Analysis of anchor text for web search
178 Citations2003Nadav Eiron, Kevin S. McCurley
The main premise is that anchor text behaves very much like real user queries and consensus titles, so an understanding of how anchor text is related to a document will likely lead to better understanding ofHow to translate a user’s query into high quality search results.
Mining anchor text for query refinement
171 Citations2004Reiner Kraft, Jason Y. Zien
It is shown that the usage of anchor text as a basis for query refinement produces high quality refinement suggestions that are significantly better in terms of perceived usefulness compared to refinements that are derived using the document content.
ACM SIGMOD RecordFinding replicated Web collections
136 Citations2000Junghoo Cho, Narayanan Shivakumar +1 more
Retrieving Web Pages Using Content, Links, URLs and Anchors
128 Citations2002Thijs Westerveld, Wessel Kraaij +1 more
It is found that almost every approach can improve the results of a content only run, and a very basic approach, using the depth of the path of the URL as a prior, yielded by far the largest improvement over the content only results.
Computer NetworksMirror, mirror on the Web: a study of host pairs with replicated content
114 Citations1999Krishna Bharat, Andrei Broder
A clearer picture of mirroring on the Web is presented and the technique for detecting mirrored hosts from large sets of collected URLs depends mostly on the syntactic analysis of URL strings, and requires retrieval and content analysis only for a small number of pages.
Computer NetworksQuery routing for Web search engines: architecture and experiments
99 Citations2000Atsushi Sugiura, Oren Etzioni
Q-Pilot is described, an automatic query routing system that attempts to dynamically route each user query to the appropriate specialized search engines, based on an off-line component that creates an approximate model of each specialized search engine's topic.
Cha-Cha: a system for organizing intranet search results
55 Citations1999Michael Chen, Marti Hearsty +2 more
The Cha-Cha system organizes web search results in such a way as to reflect the underlying structure of the intranet, and is designed to be helpful for users with a wide range of computer skills.
WWW (Posters)Finding Relevant Website Queries
24 Citations2003Brian D. Davison, David G. Deschenes +1 more
Relative proportions of free and bound enzymes after electrophoresis suggest that interaction between the mitochondrial enzymes is relatively weak compared to that of lysosomal hydrolases.