login

The MetaCrawler architecture for resource aggregation on the Web

IEEE ExpertPublished 1 January 1997
Erik Selberg, Oren Etzioni
Citations252

TL;DR

The paper discusses the MetaCrawler Softbot parallel Web search service that has been available at the University of Washington since June 1995 and has some sophisticated features that allow it to obtain results of much higher quality than simply regurgitating the output from each search service.

Abstract

The paper discusses the MetaCrawler Softbot parallel Web search service that has been available at the University of Washington since June 1995. It provides users with a single interface for querying popular general-purpose Web search services, such as Lycos and AltaVista, and has some sophisticated features that allow it to obtain results of much higher quality than simply regurgitating the output from each search service.

Keywords

Computer Science