WebSail: From On-line Learning to Web Search
Knowledge and Information SystemsPublished 1 April 2002
Zhixiang Chen, Xiannong Meng, Binhai Zhu, Richard H. Fowler
Citations36
SJR quartileQ2
SJR score0.83
SNIP1.37
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper designs an efficient adaptive learning algorithm TW2 to search for web documents and employs TW2 together with an internal index database and a real-time meta-searcher to perform real- time adaptive learning to find desired documents with as little relevance feedback from the user as possible.
Abstract
In this paper we report our research on building WebSail, an intelligent web search engine that is able to perform real-time adaptive learning. WebSail learns from the user's relevance feedback, so that it is able to speed up its search process and to enhance its search performance. We design an efficient adaptive learning algorithm TW2 to search for web documents. WebSail employs TW2 together with an internal index database and a real-time meta-searcher to perform real-time adaptive learning to find desired documents with as little relevance feedback from the user as possible. The architecture and performance of WebSail are also discussed.
Keywords
Computer Science
Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine
15,828 Citations1998Sergey Brin, Lawrence M. Page
This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.
Modern Information Retrieval
11,544 Citations1999Ricardo Baeza‐Yates, Berthier Ribeiro‐Neto
Journal of the ACMAuthoritative sources in a hyperlinked environment
9,060 Citations1999Jon Kleinberg
This work proposes and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure, and has connections to the eigenvectors of certain matrices associated with the link graph.
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
Machine LearningQueries and Concept Learning
1,622 Citations1988Dana Angluin
This work considers the problem of using queries to learn an unknown concept, and several types of queries are described and studied: membership, equivalence, subset, superset, disjointness, and exhaustiveness queries.
Machine LearningLearning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm
1,376 Citations1988Nick Littlestone
This work presents one such algorithm that learns disjunctive Boolean functions, along with variants for learning other classes of Boolean functions.
Learning Collaborative Information Filters
1,015 Citations1998Daniel Billsus, Michael J. Pazzani
This work proposes a representation for collaborative filtering tasks that allows the application of virtually any machine learning algorithm, and identifies the shortcomings of current collaborative filtering techniques and proposes the use of learning algorithms paired with feature extraction techniques that specifically address the limitations of previous approaches.
Inferring Web communities from link topology
772 Citations1998David Gibson, Jon Kleinberg +1 more
This investigation shows that although the process by which users of the Web create pages and links is very difficult to understand at a “local” level, it results in a much greater degree of orderly high-level structure than has typically been assumed.
Computer Networks and ISDN SystemsAutomatic resource compilation by analyzing hyperlink structure and associated text
700 Citations1998Soumen Chakrabarti, Byron Dom +4 more
An evaluation of ARC suggests that the resources found by ARC frequently fare almost as well as, and sometimes better than, lists of resources that are manually compiled or classified into a topic.
CiteSeer
307 Citations1998Kurt Bollacker, Steve Lawrence +1 more
A Web based information agent that assists the user in the process of performing a scientific literature search and can find papers which are similar to a given paper using word information and byanalyzing common citations made by the papers.
Using Reinforcement Learning to Spider the Web Efficiently
213 Citations1999Jason D. M. Rennie, Andrew McCallum
This paper presents an algorithm for learning a value function that maps hyperlinks to future discounted reward using a naive Bayes text classifier and shows a threefold improvement in spidering efficiency over traditional breadth-first search, and up to a two-fold improvement over reinforcement learning with immediate reward.
A system for automatic personalized tracking of scientific literature on the Web
121 Citations1999Kurt Bollacker, Steve Lawrence +1 more
A system as part of the CiteSeer digital library project for automatic tracking of scientific literature that is relevant to a user’s research interests that is able to track and recommend topically relevant papers even when keyword based query profiles fail.
Indexing and retrieval of scientific literature
112 Citations1999Steve Lawrence, Kurt Bollacker +1 more
This paper discusses the creation of digital libraries of scientific literature on the web, including the efficient location of articles, full-text indexing of the articles, autonomous citation indexing, information extraction, display of query-sensitive summaries and citation context, hubs and authorities computation.
Search and ranking algorithms for locating resources on the World Wide Web
70 Citations2002Budi Yuwono, Dik Lun Lee
Four keyword-based search and ranking algorithms for locating relevant WWW pages with respect to user queries, including Boolean Spreading Activation, which extends the notion of word occurrence in the Boolean retrieval model by propagating the occurrence of a query word in a page to other pages linked to it.
Information and ComputationEfficient Learning with Virtual Threshold Gates
41 Citations1998Wolfgang Maass, Manfred K. Warmuth
This work reduces learning simple geometric concept classes to learning disjunctions over exponentially many variables and applies an on-line algorithm called Winnow whose number of prediction mistakes grows only logarithmically with the number of variables.
Elsevier eBooksLearning in Intelligent Information Retrieval
37 Citations1991David Lewis
Previous research on machine learning in IR systems is surveyed and promising areas for future research at the intersection of these two fields are discussed.
Journal of the American Society for Information Science and TechnologyFEATURES: Real‐time adaptive feature and document learning for web search
12 Citations2001Zhixiang Chen, Xiannong Meng +2 more
The research on building FEATURES—an intelligent web search engine that is able to perform real-time adaptive feature and document learning is reported, which designs two efficient and mutual-benefiting learning algorithms that work concurrently, one for feature learning and the other for document learning.
Lecture notes in computer scienceMultiplicative Adaptive Algorithms for User Preference Retrieval
12 Citations2001Zhixiang Chen
It is proved that algorithm MA has a substantially better mistake bound than the Rocchio's and the Perceptron algorithms in learning a user preference relation determined by a linear classifier with a small number of non-zero coefficients over the real-valued vector space [0, 1]n.
Knowledge and Information SystemsSearching the Web with Queries
6 Citations1999Zhixiang Chen, Xiannong Meng +1 more
This paper designs several efficient learning algorithms to search for any collection of documents represented by a disjunction (or a conjunction) of relevant attributes with the help of membership queries or equivalence queries.