Cluster-based text categorization
Published 1 January 1995
Makoto Iwayama, Takenobu Tokunaga
Citations121
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The “efficiency, effectiveness, and noise tolerance of this search strategy were confirmed to be better than those of a full search, a category-based search, and a cluster- based search with nonprobabilistic clustering.
Abstract
Article Cluster-based text categorization: a comparison of category search strategies Share on Authors: Makoto Iwayama Advanced Research Laboratory, Hitachi Ltd., Hatoyama, Saitama 350-03, Japan Advanced Research Laboratory, Hitachi Ltd., Hatoyama, Saitama 350-03, JapanView Profile , Takenobu Tokunaga Department of Computer Science, Tokyo Institute of Technology, 2-12-1, Ookayama, Meguro, Tokyo 152, Japan Department of Computer Science, Tokyo Institute of Technology, 2-12-1, Ookayama, Meguro, Tokyo 152, JapanView Profile Authors Info & Claims SIGIR '95: Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrievalJuly 1995 Pages 273–280https://doi.org/10.1145/215206.215371Online:01 July 1995Publication History 63citation1,299DownloadsMetricsTotal Citations63Total Downloads1,299Last 12 Months38Last 6 weeks6 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access
Keywords
Computer Science
IEEE Transactions on Automatic ControlA new look at the statistical model identification
50,732 Citations1974Hirotugu Akaike
Journal of the American Society for Information ScienceRelevance weighting of search terms
2,068 Citations1976Stephen Robertson, Karen Spärck Jones
This paper examines statistical techniques for exploiting relevance information to weight search terms using information about the distribution of index terms in documents in general and shows that specific weighted search methods are implied by a general probabilistic theory of retrieval.
Communications of the ACMToward memory-based reasoning
1,232 Citations1986Craig Stanfill, David L. Waltz
The intensive use of memory to recall specific episodes from the past—rather than rules—should be the foundation of machine reasoning.
Information Processing & ManagementRecent trends in hierarchic document clustering: A critical review
707 Citations1988Peter Willett
Algorithms that can be used to allow the implementation of hierarchic agglomerative clustering methods for document retrieval, and experimental evidence suggests that nearest neighbor clusters provide a reasonably efficient and effective means of including interdocument similarity information in document retrieval systems.
Journal of DocumentationON THE SPECIFICATION OF TERM VALUES IN AUTOMATIC INDEXING
577 Citations1973G. Salton, Chul‐Su Yang
It is shown that the standard theories for the specification of term values (or weights) are not adequate, and new techniques are introduced for the assignment of weights to index terms, based on the characteristics of individual document collections.
An evaluation of phrasal and clustered representations on a text categorization task
547 Citations1992David Lewis
It is shown that optimal effectiveness occurs when using only a small proportion of the indexing terms available, and that effectiveness peaks at a higher feature set size and lower effectiveness level for a syntactic phrase indexing than for word-based indexing.
Information Storage and RetrievalThe use of hierarchic clustering in information retrieval
522 Citations1971N. Jardine, C. J. van Rijsbergen
It is shown that cluster-based retrieval strategies can be devised which are as effective as linear associative retrieval strategies and much more efficient.
Classifying news stories using memory based reasoning
261 Citations1992Brij Masand, Gordon S. Linoff +1 more
A method for classifying news stories using Memory Based Reasoning (MBR) a k-nearest neighbor method, that does not require manual topic definitions, that is effective in reducing the development time to implement classification systems involving large number of topics for the purpose of classification, message routing etc.
Information Processing & ManagementModels for retrieval with probabilistic indexing
177 Citations1989Norbert Fuhr
Three retrieval models for probabilistic indexing are described along with evaluation results for each, including the binary independence indexing (BII) model, which is a generalized version of the Maron and Kuhns indexing model.
Information SystemsA model of cluster searching based on classification
143 Citations1980W. Bruce Croft
A probabilistic model of cluster searching based on query classification is described and it is tested with retrieval experiments which indicate that it can be more effective than heuristic cluster searches and cluster searches based on other models.
Journal of DocumentationHIERARCHIC AGGLOMERATIVE CLUSTERING METHODS FOR AUTOMATIC DOCUMENT CLASSIFICATION
117 Citations1984Alan Griffiths, Lesley A. Robinson +1 more
The results would suggest that the single linkage method, which has been used extensively in previous work on document clustering, is not the most effective procedure of those tested, although it should be emphasized that the experiments have used only small document test collections.
Journal of the American Society for Information ScienceUsing interdocument similarity information in document retrieval systems
109 Citations1986Alan Griffiths, H. Claire Luckhurst +1 more
A comparison of the use of clusters consisting of a document together with that document with which it is most similar with conventional best match searches suggests that the two types of search are of comparable effectiveness, but they retrieve noticeably different sets of relevant documents.
Hierarchical Bayesian clustering for automatic text classification
68 Citations1995Makoto Iwayama, Takenobu Tokunaga
A hierarchical clustering algorithm that constructs a Bet of clusters having the maximum Bayesian posterior probability, the probability that the given texts are classified into clusters is proposed.
Hierarchic document classification using Ward's clustering method
65 Citations1986Abdelmoula El-Hamdouchi, Peter Willett
A description of heuristics which can increase the efficiency of the new algorithm when it is used to cluster three document collections by Ward's method, which has been shown to perform well in experimental studies of hierarchic document clustering.
ACM Transactions on Information SystemsExperiments with a component theory of probabilistic information retrieval based on single terms as document components
53 Citations1990K. L. Kwok
A component theory of information retrieval using single content terms as component for queries and documents was reviewed and experimented with and performed substantially better than Croft's model because of the highly specific nature of document-focused feedback.
Journal of the American Society for Information ScienceDocument representation in probabilistic models of information retrieval
51 Citations1981W. Bruce Croft
This article describes how retrieval models which use either independence or dependence assumptions can be extended to include document representatives containing term significance weights and indicates that search strategies based on models modified in this way can further improve the effectiveness of document retrieval systems.
A probabilistic model for text categorization
38 Citations1994Makoto Iwayama, Takenobu Tokunaga
A new probabilistic model for text categorization, that is based on a Single random Variable with Multiple Values (SVMV) that has the following advantages; 1) it considers within-document term frequencies, 2) considers term weighting for target documents, and 3) is less affected by having insufficient training cases.
Information Storage and RetrievalFurther experiments with hierarchic clustering in document retrieval
38 Citations1974C. J. van Rijsbergen
A framework for the evaluation of cluster-based retrieval strategies is constructed and these strategies are shown to be dependent on the method of cluster representation (cluster profile) adopted.