Carrot2 and Language Properties in Web Search Results Clustering
Lecture notes in computer sciencePublished 10 August 2007
Jerzy Stefanowski, Dawid Weiss
Citations89
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An open extensible research system for examination and development of search results clustering algorithms - Carrot2 is introduced and attempts to measuring quality of discovered clusters are discussed.
Abstract
This paper relates to a technique of improving results visualization in Web search engines known as search results clustering. We introduce an open extensible research system for examination and development of search results clustering algorithms — Carrot2. We also discuss attempts to measuring quality of discovered clusters and demonstrate results of our experiments with quality assessment when inflectionally rich language (Polish) is clustered using a representative algorithm - Suffix Tree Clustering.
Keywords
Computer Science
Cluster Analysis
9,195 Citations1974Barry J. Everitt, Sabine Landau +1 more
Reexamining the cluster hypothesis
828 Citations1996Marti A. Hearst, Jan Pedersen
This work systematically evaluates Scatter/Gather in this context and finds significant improvements over similarity search ranking alone and provides evidence validating the cluster hypothesis which states that relevant documents tend to be more similar to each other than to non-relevant documents.
Computer NetworksGrouper: a dynamic clustering interface to Web search results
716 Citations1999Oren Zamir, Oren Etzioni
This paper introduces Grouper, an interface to the results of the HuskySearch meta-search engine, which dynamically groups the search results into clusters labeled by phrases extracted from the snippets, and reports on the first empirical comparison of user Web search behavior on a standard ranked-list presentation versus a clustered presentation.
Decision Support SystemsPartitioning-based clustering for Web document categorization
261 Citations1999Daniel Boley, Maria Gini +7 more
Two new clustering algorithms are introduced that can effectively cluster documents, even in the presence of a very high dimensional feature space, and do not require pre-specified ad hoc distance functions and are capable of automatically discovering document similarities or associations.
An information-theoretic external cluster-validity measure
145 Citations2002Byron Dom
A measure of clustering quality or accuracy that is appropriate in situations where it is desirable to evaluate a clustering algorithm by somehow comparing the clusters it produces with ``ground truth' consisting of classes assigned to the patterns by manual means or some other means in whose veracity there is confidence is proposed.
Emerging infectious diseasesClustering web documents: a phrase-based method for grouping search engine results
91 Citations1999Oren Zamir, Oren Etzioni
Posting restaurant inspection results as letter grades at the point of service was associated with a decline in Salmonella infections in NYC and warrants consideration for broader use.
Ephemeral Document Clustering for Web Applications
68 Citations2001Yoelle Maarek, Ronald Fagin +2 more
The utility of ephemeral clustering for interactive use is demonstrated through a search assistance utility that embodies these ideas, and an optimal complete-link Hierarchical Agglomerative Clustering algorithm is given, with O(n) time complexity.
Structures of String Matching and Data Compression
60 Citations1999Niklas Larsson
A conscious treatment of the context tree can combine the compression performance of predictive modelling with the computational efficiency of BWT, and a semi-static source modelling scheme is presented that obtains excellent compression, yet is also capable of high decoding rates.
Human performance on clustering web pages: a preliminary study
53 Citations1998Sofus A. Macskassy, Arunava Banerjee +2 more
An initial study of human clustering of web pages, in the hope that it would provide some insight into the difficulty of automating this task, shows that subjects did not cluster identically; in fact, any two subjects had little similarity in their web-page clusters.
Web Search Results Clustering in Polish: Experimental Evaluation of Carrot
22 Citations2003Dawid Weiss, Jerzy Stefanowski
The results indicate that the characteristics of produced clusters, strongly depend on pre-processing phase, and two approaches to efficient, approximate conflation of Polish words are introduced: quasi-stemmer and an automaton-based lemmatization method.
MSEEC – A Multi Search Engine with Multiple Clustering
21 Citations2000Peter Hannappel, Reinhold Klapsing +2 more
A novel clustering technique that is based on the LZW compression method is presented that allows to process information with multiple cluster algorithms to present alternative clusters and the related cluster title to the user.
Hierarchical Clustering of Text Corpora Using Suffix Trees
1 Citations2003Irmina Masłowska, Roman Słowiński
A system is described, which automatically builds a navigable hierarchy of meaningful document groups and addresses two chief needs of the Web users: the need for efficient access to the up-to-date information on every available topic and theneed for an organized and meaningful presentation of the desired information.