Expectations versus reality – search engine features needed for Web research at mid 2005
DIGITAL.CSIC (Spanish National Research Council (CSIC))Published 1 January 2005Open access
Judit Bar‐Ilan
Citations34
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The "wish list" for the ideal search engine is described, the need for the specific features is explained, and whether the currently existing major search engines can at least partially fulfil the requirements of the ultimate search tool is examined.
Abstract
Web research is based on data from or about the Web. Often data is collected using search engines. Here we describe our "wish list" for the ideal search engine, explain the need for the specific features and examine whether the currently existing major search engines can at least partially fulfil the requirements of the ultimate search tool. The major search tools are commercial and are oriented towards the "average" user and not towards the Web researcher, and therefore are unable to meet all the requests. One possible solution is for the research community to recruit the necessary funding, resources and know-how in order to build a research-oriented search tool.
Keywords
Computer SciencePhysics and Astronomy
Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine
15,828 Citations1998Sergey Brin, Lawrence M. Page
This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.
Journal of the ACMAuthoritative sources in a hyperlinked environment
9,060 Citations1999Jon Kleinberg
This work proposes and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure, and has connections to the eigenvectors of certain matrices associated with the link graph.
Computer NetworksGraph structure in the Web
2,760 Citations2000Andrei Broder, Ravi Kumar +6 more
The study of the web as a graph yields valuable insight into web algorithms for crawling, searching and community discovery, and the sociological phenomena which characterize its evolution.
NatureAccessibility of information on the web
1,356 Citations1999Steve Lawrence, C. Lee Giles
As the web becomes a major communications medium, the data on it must be made more accessible, and search engines need to make the data more accessible.
Information Processing & ManagementReal life, real users, and real needs: a study and analysis of user queries on the web
1,318 Citations2000Bernard J. Jansen, Amanda Spink +1 more
A failure analysis was conducted, identifying trends among user mistakes, and a summary of findings and a discussion of the implications of these findings were concluded.
ScienceSearching the World Wide Web
974 Citations1998Steve Lawrence, C. Lee Giles
The coverage and recency of the major World Wide Web search engines was analyzed, yielding some surprising results, including a lower bound on the size of the indexable Web of 320 million pages.
NatureGrowth dynamics of the World-Wide Web
865 Citations1999Bernardo A. Huberman, Lada A. Adamic
It is found that web pages are distributed among sites according to a universal power law: many sites have only a few pages, whereas very few sites have hundreds of thousands of pages.
Comparing top k lists
768 Citations2003Ronald Fagin, Ravi Kumar +1 more
The Information SocietyShaping the Web: Why the Politics of Search Engines Matters
682 Citations2000Lucas D. Introna
It is argued that search engines raise not merely technical issues but also political ones, raising doubts whether, in particular, the market mechanism could serve as an acceptable corrective.
On the bursty evolution of blogspace
561 Citations2003Ravi Kumar, Jasmine Novak +2 more
Journal of DocumentationThe calculation of web impact factors
466 Citations1998Peter Ingwersen
This case study reports the investigations into the feasibility and reliability of calculating impact factors for web sites, called Web Impact Factors (Web‐IF), and demonstrates that Web‐IFs are calculable with high confidence for national and sector domains whilst institutional Web‐ifs should be approached with caution.
Computer Networks and ISDN SystemsA technique for measuring the relative size and overlap of public Web search engines
393 Citations1998Krishna Bharat, Andrei Broder
A standardized, statistical way of measuring search engine coverage and overlap through random queries is described that can be implemented by third-party evaluators using only public query interfaces and suggests the size of the static, public Web as of November was over 200 million pages.
Link Analysis: An Information Science Approach
233 Citations2004Mike Thelwall
Software Practice and ExperienceA large‐scale study of the evolution of Web pages
202 Citations2004Dennis Fetterly, Mark S. Manasse +2 more
Information Processing & ManagementNew measurements for search engine evaluation proposed and tested
186 Citations2003Liwen Vaughan
A set of measurements is proposed for evaluating Web search engine performance that are adapted from the concepts of recall and precision and newly developed to evaluate search engine stability, an issue unique to Web information retrieval systems.
Journal of Information ScienceA web crawler design for data mining
144 Citations2001Mike Thelwall
A distributed design is proposed in order to effectively use idle computing resources and to help information scientists avoid the need to employ dedicated equipment.
ComputerKeeping up with the changing Web
142 Citations2000Brian Brewington, George Cybenko
What "current" means for Web search engines and how often they must reindex the Web to keep current with its changing pages and structure are quantified.
DIGITAL.CSIC (Spanish National Research Council (CSIC))Daily time series of common single word searches in AltaVista and NorthernLight
115 Citations1998Ronald W. Rousseau
Over the past year the AltaVista search engine provided irregular numbers of hits, shown by collecting a time series of daily searches, and it is suggested to use filtering techniques, such as median filtering, when dealing with irregular time series.
Journal of DocumentationWeb impact factors and search engine coverage
99 Citations2000Mike Thelwall
The results indicate that search engine coverage, even of large national domains is extremely uneven and would be likely to lead to misleading calculations.
DOAJ (DOAJ: Directory of Open Access Journals)What is this link doing here? Beginning a fine-grained process of identifying reasons for academic hyperlink creation
95 Citations2003Thelwall Mike
Information Processing & ManagementWhat do we know about links and linking? A framework for studying links in academic environments
89 Citations2004Judit Bar‐Ilan
A classification of link types in academic environments on the Web provides an insight into the diverse uses of hypertext links on the Internet, and has implications for browsing and ranking in IR systems by differentiating between different types of links.
Journal of DocumentationInternet search engines – fluctuations in document accessibility
76 Citations2001Wouter Mettrop, Paul Nieuwenhuysen
Journal of DocumentationCan search engines be used as tools for web‐link analysis? A critical view
74 Citations1999Herbert Snyder, Howard Rosenbaum
The research finds that search engines are highly variable in the results they produce, are limited in the search functions they offer, have poorly and/or incorrectly documented functions, use search logics that are opaque, and change the search function they offer over time.
DIGITAL.CSIC (Spanish National Research Council (CSIC))The Responsiveness of Search Engine Indexes
58 Citations2001Mike Thelwall
An experiment to investigate the effect of link count on the indexing of 1000 sites in three search portals over a period of seven months found that, although all engines added sites during the period of the survey, only Google showed evidence of being very responsive to the existence of links on the test site, whereas AltaVista's results were very stable over time.
Journal of Information ScienceHow do search engines respond to some non-English queries?
54 Citations2004Judit Bar‐Ilan, Tatyana Gutman
These findings are rather disturbing, since for example Google is very popular in non-English speaking countries as well, and users are either not aware of what they miss when using search tools that do not take into account the structure and the special characteristics of the specific language or have no alternatives to use these search engines.
Online Information ReviewEvaluating the stability of the search tools Hotbot and Snap: a case study
35 Citations2000Judit Bar‐Ilan
These findings are to alert users of Hotbot of its instability as of October 1999, and they raise questions about the reliability of previous studies estimating the size of Hotbots based on its overlap with other search engines.
Journal of Information ScienceHow much information do search engines disclose on the links to a web page? A longitudinal case study of the ‘cybermetrics’ home page
23 Citations2002Judit Bar‐Ilan
The results of an extensive search for links to the home page of the e-journal Cybermetrics show that the search engines do not retrieve all the link pages that are indexed by them, raising questions about the use of WIF (the Web Impact Factor) as a scientometric indicator based on data retrieved from commercial search engines.
ScientometricsData mining in a closed Web environment
19 Citations2003Cristina Faba‐Pérez, Vicente P. Guerrero‐Bote +1 more
An analysis based on the co-links that are generated within a closed web environment is proposed, using multivariate statistics (Principal Component Analysis, and Multidimensional Scaling) and a connection-based technique (Kohonen's Self-Organizing Maps).
BIROn (Birkbeck, University of London)Dynamics of Search Engine Rankings - A Case Study.
12 Citations2004Judit Bar‐Ilan, Mark Levene +1 more
The objective of this study was to characterize the changes in the rankings of the top-n results of major search engines over time and to compare the rankings between these engines, finding that the top ten results of the two search engines have surprisingly low overlap.