Web Page Classification*
Studies in fuzziness and soft computingPublished 27 September 2005
B. Choi, Zhen Yao
Citations45
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The state of the art techniques and subsystems used to build automatic web page classification systems, including web page representations, dimensionality reductions, web page classifiers, and evaluation of webpage classifiers are described.
Abstract
This chapter describes systems that automatically classify web pages into meaningful categories. It first defines two types of web page classification: subject based and genre based classifications. It then describes the state of the art techniques and subsystems used to build automatic web page classification systems, including web page representations, dimensionality reductions, web page classifiers, and evaluation of web page classifiers. Such systems are essential tools for Web Mining and for the future of Semantic Web.
Keywords
Computer Science
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
Elements of Information Theory
37,533 Citations2001Thomas M. Cover, Joy A. Thomas
Machine LearningSupport-Vector Networks
33,035 Citations1995Corinna Cortes, Vladimir Vapnik
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
BiometricsClassification and Regression Trees.
23,841 Citations1984Alexander Gordon, Leo Breiman +3 more
Journal of the Operational Research SocietyIntroduction to Algorithms
16,942 Citations1991V. J. Rayward‐Smith, Thomas H. Cormen +2 more
Machine LearningInduction of Decision Trees
14,815 Citations1986J. R. Quinlan
This paper summarizes an approach to synthesizing decision trees that has been used in a variety of systems, and it describes one such system, ID3, in detail, which is described in detail.
ACM Computing SurveysData clustering
13,184 Citations1999Anil K. Jain, M. Narasimha Murty +1 more
An overview of pattern clustering methods from a statistical pattern recognition perspective is presented, with a goal of providing useful advice and references to fundamental concepts accessible to the broad community of clustering practitioners.
Journal of the American Society for Information ScienceIndexing by latent semantic analysis
12,677 Citations1990Scott Deerwester, Susan Dumais +3 more
Pattern classification and scene analysis
12,643 Citations1973Richard O. Duda, Peter E. Hart
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
Information Processing & ManagementTerm-weighting approaches in automatic text retrieval
9,532 Citations1988Gerard Salton, Chris Buckley
This paper summarizes the insights gained in automatic term weighting, and provides baseline single term indexing models with which other more elaborate content analysis procedures can be compared.
Cluster Analysis
9,195 Citations1974Barry J. Everitt, Sabine Landau +1 more
Artificial IntelligenceWrappers for feature subset selection
8,925 Citations1997Ron Kohavi, George H. John
The wrapper method searches for an optimal feature subset tailored to a particular algorithm and a domain and compares the wrapper approach to induction without feature subset selection and to Relief, a filter approach tofeature subset selection.
Lecture notes in computer scienceText categorization with Support Vector Machines: Learning with many relevant features
7,925 Citations1998Thorsten Joachims
SVMs achieve substantial improvements over the currently best performing methods and behave robustly over a variety of di-erent learning tasks, eliminating the need for manual parameter tuning.
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
ACM SIGMOD RecordMining frequent patterns without candidate generation
6,360 Citations2000Jiawei Han, Jian Pei +1 more
A Comparative Study on Feature Selection in Text Categorization
4,766 Citations1997Yiming Yang, Jan Pedersen
DF thresholding, the simplest method with the lowest cost in computation, can be reliably used instead of IG or CHI when the computation of these measures are too expensive, and strong correlations between the DF, IG and CHI values of a term are found.
Journal of DocumentationA STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVAL
4,442 Citations1972Karen Spärck Jones
It is argued that terms should be weighted according to collection frequency, so that matches on less frequent, more specific, terms are of greater value than matches on frequent terms.
Elsevier eBooksFast Effective Rule Induction
3,767 Citations1995William W. Cohen
This paper evaluates the recently-proposed rule learning algorithm IREP on a large and diverse collection of benchmark problems, and proposes a number of modifications resulting in an algorithm RIPPERk that is very competitive with C4.5 and C 4.5rules with respect to error rates, but much more efficient on large samples.
Word association norms, mutual information, and lexicography
3,674 Citations1990Kenneth Church, Patrick Hanks
IBM Journal of Research and DevelopmentThe Automatic Creation of Literature Abstracts
3,211 Citations1958H. P. Luhn
In the exploratory research described, the complete text of an article in machine-readable form is scanned by an IBM 704 data-processing machine and analyzed in accordance with a standard program.
A Survey of Clustering Data Mining Techniques
2,791 Citations2006Pavel Berkhin
This survey concentrates on clustering algorithms from a data mining perspective as a data modeling technique that provides for concise summaries of the data.
A re-examination of text categorization methods
2,660 Citations1999Yiming Yang, Xin Liu
The results show that SVM, kNN and LLSF signi cantly outperform NNet and NB when the number of positive training instances per category are small, and that all the methods perform comparably when the categories are over 300 instances.
Elsevier eBooksIrrelevant Features and the Subset Selection Problem
2,374 Citations1994George H. John, Ron Kohavi +1 more
A method for feature subset selection using cross-validation that is applicable to any induction algorithm is described, and experiments conducted with ID3 and C4.5 on artificial and real datasets are discussed.
Lecture notes in computer scienceNaive (Bayes) at forty: The independence assumption in information retrieval
2,092 Citations1998David Lewis
The naive Bayes classifier, currently experiencing a renaissance in machine learning, has long been a core technique in information retrieval, and some of the variations used for text retrieval and classification are reviewed.
Information RetrievalAn Evaluation of Statistical Approaches to Text Categorization
1,946 Citations1999Yiming Yang
Analysis and empirical evidence suggest that the evaluation results on some versions of Reuters were significantly affected by the inclusion of a large portion of unlabelled documents, mading those results difficult to interpret and leading to considerable confusions in the literature.
Society for Industrial and Applied Mathematics eBooksLINPACK Users' Guide
1,726 Citations1979Jack Dongarra, C Moler +2 more
General matrices Band matrices positive definite matrices Positive definite band matrices Symmetric Indefinite Matrices Triangular matrices Tridiagonal matrices The Cholesky decomposition The QR decomposition up to and including the singular value decomposition is studied.
Shaping Written Knowledge: The Genre and Activity of the Experimental Article in Science
1,496 Citations1988Charles Bazerman
SIAM ReviewUsing Linear Algebra for Intelligent Information Retrieval
1,484 Citations1995Michael W. Berry, Susan Dumais +1 more
A lexical match between words in users’ requests and those in or assigned to documents in a database helps retrieve textual materials from scientific databases.
Inductive learning algorithms and representations for text categorization
1,465 Citations1998Susan Dumais, John Platt +2 more
A comparison of the effectiveness of five different automatic learning algorithms for text categorization in terms of learning speed, realtime classification speed, and classification accuracy is compared.
Toward optimal feature selection
1,444 Citations1996Daphne Koller, Mehran Sahami
An efficient algorithm for feature selection which computes an approximation to the optimal feature selection criterion is given, showing that the algorithm effectively handles datasets with a very large number of features.
A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization
1,264 Citations1997Thorsten Joachims
A Probabilistic analysis of the Rocchio relevance feedback algorithm, one of the most popular learning methods from information retrieval, is presented in a text categorization framework and suggests that the probabilistic algorithms are preferable to the heuristic Rocchio classifier.
Induction of Decision Trees
999 Citations2003Quinlan
Hierarchically Classifying Documents Using Very Few Words
840 Citations1997Daphne Koller, Mehran Sahami
This work proposes an approach that utilizes the hierarchical topic structure to decompose the classification task into a set of simpler problems, one at each node in the classification tree, which can be solved accurately by focusing only on a very small set of features, those relevant to the task at hand.
Hierarchical classification of Web content
805 Citations2000Susan Dumais, Hao Chen
This paper explores the use of hierarchical structure for classifying a large, heterogeneous collection of web content using support vector machine (SVM) classifiers, which have been shown to be efficient and effective for classification, but not previously explored in the context of hierarchical classification.
Enhanced hypertext categorization using hyperlinks
775 Citations1998Soumen Chakrabarti, Byron Dom +1 more
This work has developed a text classifier that misclassified only 13% of the documents in the well-known Reuters benchmark; this was comparable to the best results ever obtained and its technique also adapts gracefully to the fraction of neighboring documents having known topics.
Management ScienceTools for Inventing Organizations: Toward a Handbook of Organizational Processes
758 Citations1999Thomas W. Malone, Kevin Crowston +10 more
Language<b>Dimensions of register variation:</b> A cross-linguistic comparison. By Douglas Biber. Cambridge: Cambridge University Press, 1995. Pp. xvi, 428.
721 Citations1999Thomas E. Nunnally
Information Processing & ManagementRecent trends in hierarchic document clustering: A critical review
707 Citations1988Peter Willett
Algorithms that can be used to allow the implementation of hierarchic agglomerative clustering methods for document retrieval, and experimental evidence suggests that nearest neighbor clusters provide a reasonably efficient and effective means of including interdocument similarity information in document retrieval systems.
DSpace@MIT (Massachusetts Institute of Technology)Support Vector Machines: Training and Applications
704 Citations1997E. Osuna, Robert M. Freund +1 more
Distributional clustering of words for text classification
683 Citations1998Lee D. Baker, Andrew Kachites McCallum
This paper describes the application of Distributional Clustering to document classi(cid:12)cation and shows that it can reduce the feature dimensionality by three orders of magnitude and lose only 2% accuracy, better than Latent Semantic In-dexing, class-based clustering, feature selection by mutual information, or Markov-blanket-based feature selection.
ScienceDevelopments in Automatic Text Retrieval
623 Citations1991Gerard Salton
The text analysis problem is examined, and modern approaches leading to the identification and retrieval of selected text items in response to search requests are discussed.
An evaluation of phrasal and clustered representations on a text categorization task
547 Citations1992David Lewis
It is shown that optimal effectiveness occurs when using only a small proportion of the indexing terms available, and that effectiveness peaks at a higher feature set size and lower effectiveness level for a syntactic phrase indexing than for word-based indexing.
Training algorithms for linear text classifiers
516 Citations1996David Lewis, Robert E. Schapire +2 more
This work proposes that two machine learning algorithms, the Widrow-Hoff and EG algorithms, be used in training linear text classifiers for IR tasks, and theoretical analysis provides performance guarantees and guidance on parameter settings for these algorithms.
A comparison of classifiers and document representations for the routing problem
451 Citations1995Hinrich Schütze, David A. Hull +1 more
This paper considers three classification techniques which have decision rules that are derived via explicit error minimization linear discriminant analysis, logistic regression, and neuraf networks, and finds that features based on latent semantic indexing are more effective for techniques such aslinear discriminant anaf-ysis and logistic regressors, which have no way to protect against overfitting.
Feature selection, perception learning, and a usability case study for text categorization
446 Citations1997Hwee Tou Ng, Wei Boon Goh +1 more
An automated learning approach to text categorization based on perception learning and a new feature selection metric, called correlation coefficient, is described and empirical results indicate that this approach outperforms the best published results on this % uters collection.
Feature Selection for Unbalanced Class Distribution and Naive Bayes
432 Citations1999Dunja Mladenić, Marko Grobelnik
This paper describes an approach to feature subset selection that takes into account problem speciics and learning algorithm characteristics, and shows that considering domain and algorithm characteristics signiicantly improves the results of classiication.
The International Journal of Supercomputing ApplicationsLarge-Scale Sparse Singular Value Computations
408 Citations1992Michael W. Berry
Four numerical methods for computing the singular value decomposition (SVD) of large sparse matrices on a multiprocessor architecture are presented and may help advance the development of future out-of-core sparse SVD methods, which can be used to handle extremely large sparsematrices associated with extremely large databases in query-based information-retrieval applications.
ACM Transactions on Information SystemsAn example-based mapping method for text categorization and retrieval
405 Citations1994Yiming Yang, Christopher G. Chute
It is evident that the LLSF approach uses the relevance information effectively within human decisions of categorization and retrieval, and achieves a semantic mapping of free texts to their representations in an indexing language.
Information Processing & ManagementConstructing literature abstracts by computer: Techniques and prospects
385 Citations1990Chris D. Paice
The question of how to achieve proper balance in auto-abstracts is a problem which has hardly been addressed hitherto; it appears that assignment of selected textual material into ‘abstract-frames’ may offer a solution.
Information RetrievalText Categorization Based on Regularized Linear Classification Methods
378 Citations2001Tong Zhang, Frank J. Oles
A number of known linear classification methods as well as some variants in the framework of regularized linear systems are compared to discuss the statistical and numerical properties of these algorithms, with a focus on text categorization.
Elsevier eBooksIncremental Reduced Error Pruning
363 Citations1994Johannes Fürnkranz, Gerhard Widmer
Experiments show that in many noisy domains this method is much more efficient than alternative algorithms, along with a slight gain in accuracy, however, the experiments show that the use of the algorithm cannot be recommended for domains which require a very specific concept description.
Automatic detection of text genre
358 Citations1997Brett Kessler, Geoffrey Numberg +1 more
A theory of genres as bundles of facets, which correlate with various surface cues, are proposed, and it is argued that genre detection based on surface cues is as successful as Detection based on deeper structural properties.
A study of thresholding strategies for text categorization
354 Citations2001Yiming Yang
Experimental results show that the choice of thresholding strategy can significantly influence the performance of kNN, and that the ``optimal'' strategy may vary by application.
Journal of Intelligent Information SystemsA Study of Approaches to Hypertext Categorization
309 Citations2002Yiming Yang, Seán Slattery +1 more
This paper examines five hypertext regularities which may (or may not) hold in a particular application domain, and whose presence (or absence) may significantly influence the optimal design of a classifier.
Recognizing text genres with simple metrics using discriminant analysis
293 Citations1994Jussi Karlgren, Douglass R. Cutting
A simple method for categorizing texts into pre-determined text genre categories using the statistical standard technique of discriminant analysis is demonstrated with application to the Brown corpus.
Human-Computer InteractionBorderline Issues: Social and Material Aspects of Design
267 Citations1994John Seely Brown, Paul Duguid
Classifying news stories using memory based reasoning
261 Citations1992Brij Masand, Gordon S. Linoff +1 more
A method for classifying news stories using Memory Based Reasoning (MBR) a k-nearest neighbor method, that does not require manual topic definitions, that is effective in reducing the development time to implement classification systems involving large number of topics for the purpose of classification, message routing etc.
Using web structure for classifying and describing web pages
256 Citations2002Eric J. Glover, Kostas Tsioutsiouliklis +3 more
By ranking words and phrases in the citing documents according to expected entropy loss, this work is able to accurately name clusters of web pages, even with very few positive examples.
Context-sensitive learning methods for text categorization
253 Citations1996William W. Cohen, Yoram Singer
Information RetrievalHierarchical Text Categorization Using Neural Networks
248 Citations2002Miguel E. Ruiz, Padmini Srinivasan
The results show that the use of the hierarchical structure improves text categorization performance with respect to an equivalent flat model, and the optimized Rocchio algorithm achieves a performance comparable with that of the Hierarchical Mixture of Experts model.
Web classification using support vector machine
219 Citations2002Aixin Sun, Ee‐Peng Lim +1 more
The use of Support Vector Machine (SVM) classifiers to classify web pages using both their text and context feature sets is proposed and it is shown that the use of context features especially hyperlinks can improve the classification performance significantly.
Lecture notes in computer scienceExperiments on the Use of Feature Selection and Negative Evidence in Automated Text Categorization
209 Citations2000Luigi Galavotti, Fabrizio Sebastiani +1 more
This work proposes a novel variant, based on the exploitation of negative evidence, of the well-known k-NN method, and reports the results of systematic experimentation of these two methods performed on the standard REUTERS-21578 benchmark.
Literary and Linguistic ComputingNot Unless You Ask Nicely: The Interpretative Nexus Between Analysis and Information
205 Citations1992J. F. Burrows
Noise reduction in a statistical approach to text categorization
196 Citations1995Yiming Yang
Noise reduction strategies are proposed and evaluated, including an aggressive removal of “non-informative words” from texts before training; the use of a truncated singular value decomposition to cut off noisy “latent semantic structures” during training.
Lecture notes in computer scienceFeature subset selection in text-learning
171 Citations1998Dunja Mladenić
Experimental comparison given on real-world data collected from Web users shows that characteristics of the problem domain and machine learning algorithm should be considered when feature scoring measure is selected.
Text genre detection using common word frequencies
166 Citations2000Efstathios Stamatatos, Nikos Fakotakis +1 more
It is shown that the most frequent words of the British National Corpus, representing the most Frequence of the written English language, are more reliable discriminators of text genre in comparison to the most frequently spoken words in a training corpus.
The Power of Word Clusters for Text Classification
158 Citations2006Noam Slonim, Naftali Tishby
This work applies the information bottleneck method to find word-clusters that preserve the information about document categories and use these clusters as features for classification, and shows that when the training sample is small word clusters can yield significant improvement in classification accuracy.
A practical hypertext catergorization method using links and incrementally available class information
148 Citations2000Hyo-Jung Oh, Sung Hyon Myaeng +1 more
This paper proposes a practical method for enhancing both the speed and the quality of hypertext categorization using hyperlinks, and achieves up to 18.5% of improvement in effectiveness while reducing the processing time dramatically.
ACM Transactions on Information SystemsGenre taxonomy
133 Citations2001Takeshi. Yoshioka, George Herman +2 more
It is suggested that this genre taxonomy may be useful in the innovation of new document templates or methods for communication because it helps to clarify different possible uses of similar genres and explicates how genres play a coordination role among people and between people and their tasks.
Enhanced word clustering for hierarchical text classification
124 Citations2002Inderjit S. Dhillon, Subramanyam Mallela +1 more
A new information-theoretic divisive algorithm for word clustering applied to text classification is proposed and it is shown that feature clustering is an effective technique for building smaller class models in hierarchical classification.
Lecture notes in computer scienceExploiting Structural Information for Text Classification on the WWW
123 Citations1999Johannes Fürnkranz
Experimental evidence is presented that confirms the working hypothesis that it is often easier to classify a hypertext page using information provided on pages that point to it instead of using information that is provided on the page itself.
Information Processing & ManagementThe selection of good search terms
122 Citations1981C. J. van Rijsbergen, David J. Harper +1 more
This paper tackles the problem of how one might select further search terms, using relevance feedback, given the search terms in the query, by generating a number of different spanning trees from a variety of association measures.
Classifying text documents by associating terms with text categories
111 Citations2002Osmar R. Zai͏̈ane, Maria-Luiza Antonie
This paper explores the use of association rule mining inBuilding a text categorization system and proposes a new fast algorithm for building a text classifier that has the advantage of a very fast training phase, and the rules of the classifier generated are easy to understand and manually tuneable.
Text genre classification with genre-revealing and subject-revealing features
105 Citations2002Yong-Bae Lee, Sung Hyon Myaeng
The experimental results show that the proposed method outperforms a direct application of a statistical learner often used for subject classification and it is conjecture that this dual feature set approach can be generalized to improve the performance of subject classification as well.
The form is the substance
74 Citations2001Nigel Dewdney, Carol VanEss-Dykema +1 more
This work investigates text classification by format style, i.e. "genre", and demonstrates, by complementing topic classification, that it can significantly improve retrieval of information.
Elsevier eBooksMDL and Categorical Theories (Continued)
72 Citations1995J. R. Quinlan
A new encoding scheme is developed that has similar benefits to the adhoc penalty function used previously and has been implemented in c4.5RULES and empirical trials reveal a small but useful improvement in classification accuracy.
Integrating automatic genre analysis into digital libraries
71 Citations2001Andreas Rauber, Alexander Müller-Kögler
An approach to automatically analyze the structure of documents and to integrate this information into an automatically created content-based organization is presented and documents on similar topics, yet representing different genres, are depicted as books in differing colors.
A loss function analysis for classification methods in text categorization
68 Citations2003Fan Li, Yiming Yang
This paper presents a formal analysis of popular text classification methods, focusing on their loss functions whose minimization is essential to the optimization of those methods, and whose decomposition into the training-set loss and the model complexity enables cross-method comparisons on a common basis from an optimization point of view.
A Linear Least Squares Fit mapping method for information retrieval from natural language texts
66 Citations1992Yiming Yang, Christopher G. Chute
This method learns empirical associations between free-form texts and canonical terms from human-assigned matches and determines a Linear Least Squares Fit (LLSF) mapping function which represents weighted connections between words in the texts and the canonical terms.
Almost-constant-time clustering of arbitrary corpus subsets4
54 Citations1997Craig Silverstein, Jan Pedersen
An algorithm for alrnostconstant-time clustering of arbitrary corpus subsets of large corpora is given, which is never slower than clustering the document set from scratch, and for medium-sised and large sets it is significantly faster.
Page and link classifications
53 Citations1998Stephanie W. Haas, Erika S. Grams
This work proposes integrated classification systems for Web pages and links which are based on a content analysis of 75 source pages, the almost 1,500 links they contained, and the target pages to which the links led.
Four text classification algorithms compared on a Dutch corpus
40 Citations1998Hein Ragas, C. H. A. Koster
Four well-known learning algorithms, Rocchio’s algorithm, the Simple Bayesian Classifier, the SBC, the Sleeping Experts and Winnow were implemented and tested on a corpus of articles from the Dutch newspaper NRC, pre-classified into four categories.
International Journal of Artificial Intelligence ToolsA HIGHLY ACCURATE BOOTSTRAPPING ALGORITHM FOR WORD SENSE DISAMBIGUATION
36 Citations2001Rada Mihalcea, Dan Moldovan
A bootstrapping algorithm for Word Sense Disambiguation is presented which succeeds in disambiguating a subset of the words in the input text with very high precision.
Automatic web page classification in a dynamic and hierarchical way
36 Citations2003Xiaogang Peng, B. Choi
This work proposes a dynamic and hierarchical classification system that is capable of adding new categories as required, organizing the web pages into a tree structure, and classifying web pages by searching through only one path of the tree structure.
Bidirectional hierarchical clustering for Web mining
19 Citations2004Zhen Yao, B. Choi
A new bidirectional hierarchical clustering system for addressing challenges of Web mining that aims to maximize the intra-cluster similarity in the bottom-up cluster-merging phase and ensures to minimize the inter-clustering in the top-down refinement phase achieves better clustering than existing one-pass approaches.
WebNetMaking Sense of Search Results by Automatic Web-page Classifications
17 Citations2001Ben Choi
The development of a system for automatically organizing Internet web pages into meaningful categories to allow Internet users to find useful information in less time and results show that combining all three types of information provides better accuracy.
Lecture notes in computer scienceApplying Semantic Links for Classifying Web Pages
6 Citations2007Ben Choi, Qing Guo
Experimental results show that the proposed approach could increase the accuracy by 35% over the approach of analyzing only the Web page itself, and its linked Web pages referred by the URLs contained within the page.
RePEc: Research Papers in EconomicsGenre Taxonomy: A Knowledge Repository of Communicative Actions
5 Citations1999Takeshi. Yoshioka, George Herman
Abstracting Keywords from Hypertext Documents
3 Citations2002Ben Choi, Baolin Li
This paper presents a process for abstracting keywords from hypertext or text documents that can be used, for example, to identify the contents of HTML documents returned from a search engine, to allow users to quickly find their needed information.
…