Web classification using support vector machine
Published 8 November 2002Open access
Aixin Sun, Ee‐Peng Lim, Wee Keong Ng
Citations219
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The use of Support Vector Machine (SVM) classifiers to classify web pages using both their text and context feature sets is proposed and it is shown that the use of context features especially hyperlinks can improve the classification performance significantly.
Abstract
In web classification, web pages from one or more web sites are assigned to pre-defined categories according to their content. Since web pages are more than just plain text documents, web classification methods have to consider using other context features of web pages, such as hyperlinks and HTML tags. In this paper, we propose the use of Support Vector Machine (SVM) classifiers to classify web pages using both their text and context feature sets. We have experimented our web classification method on the WebKB data set. Compared with earlier Foil-Pilfs method on the same data set, our method has been shown to perform very well. We have also shown that the use of context features especially hyperlinks can improve the classification performance significantly.
Keywords
Computer Science
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
Lecture notes in computer scienceText categorization with Support Vector Machines: Learning with many relevant features
7,925 Citations1998Thorsten Joachims
SVMs achieve substantial improvements over the currently best performing methods and behave robustly over a variety of di-erent learning tasks, eliminating the need for manual parameter tuning.
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
Information RetrievalAn Evaluation of Statistical Approaches to Text Categorization
1,946 Citations1999Yiming Yang
Analysis and empirical evidence suggest that the evaluation results on some versions of Reuters were significantly affected by the inclusion of a large portion of unlabelled documents, mading those results difficult to interpret and leading to considerable confusions in the literature.
Inductive learning algorithms and representations for text categorization
1,465 Citations1998Susan Dumais, John Platt +2 more
A comparison of the effectiveness of five different automatic learning algorithms for text categorization in terms of learning speed, realtime classification speed, and classification accuracy is compared.
Hierarchical classification of Web content
805 Citations2000Susan Dumais, Hao Chen
This paper explores the use of hierarchical structure for classifying a large, heterogeneous collection of web content using support vector machine (SVM) classifiers, which have been shown to be efficient and effective for classification, but not previously explored in the context of hierarchical classification.
Enhanced hypertext categorization using hyperlinks
775 Citations1998Soumen Chakrabarti, Byron Dom +1 more
This work has developed a text classifier that misclassified only 13% of the documents in the well-known Reuters benchmark; this was comparable to the best results ever obtained and its technique also adapts gracefully to the fraction of neighboring documents having known topics.
A study of thresholding strategies for text categorization
354 Citations2001Yiming Yang
Experimental results show that the choice of thresholding strategy can significantly influence the performance of kNN, and that the ``optimal'' strategy may vary by application.
Econstor (Econstor)Combining statistical learning with a knowledge-based approach: A case study in intensive care monitoring
354 Citations1999Katharina Morik, Peter Brockhausen +1 more
Journal of Intelligent Information SystemsA Study of Approaches to Hypertext Categorization
309 Citations2002Yiming Yang, Seán Slattery +1 more
This paper examines five hypertext regularities which may (or may not) hold in a particular application domain, and whose presence (or absence) may significantly influence the optimal design of a classifier.
Using web structure for classifying and describing web pages
256 Citations2002Eric J. Glover, Kostas Tsioutsiouliklis +3 more
By ranking words and phrases in the citing documents according to expected entropy loss, this work is able to accurately name clusters of web pages, even with very few positive examples.
A practical hypertext catergorization method using links and incrementally available class information
148 Citations2000Hyo-Jung Oh, Sung Hyon Myaeng +1 more
This paper proposes a practical method for enhancing both the speed and the quality of hypertext categorization using hyperlinks, and achieves up to 18.5% of improvement in effectiveness while reducing the processing time dramatically.
Machine LearningRelational Learning with Statistical Predicate Invention: Better Models for Hypertext
126 Citations2001Mark Craven, Seán Slattery
This work presents a new approach to learning hypertext classifiers that combines a statistical text-learning method with a relational rule learner and demonstrates that this new approach is able to learn more accurate classifiers than either of its constituent methods alone.
Lecture notes in computer scienceExploiting Structural Information for Text Classification on the WWW
123 Citations1999Johannes Fürnkranz
Experimental evidence is presented that confirms the working hypothesis that it is often easier to classify a hypertext page using information provided on pages that point to it instead of using information that is provided on the page itself.
Probabilistic Models of Text and Link Structure for Hypertext Classification
77 Citations2001Lise Getoor, Eran Segal +2 more
This work proposes a unified probabilistic model for both the textual content and the link structure of a document collection based on the recently introduced framework of Probabilistic Relational Models (PRMs), which allows us to capture correlations between linked documents.
European Conference on Artificial IntelligenceTurning Yahoo to Automatic Web-Page Classifier.
62 Citations1998Dunja Mladenić
This preliminary study suggests that in the second trimester, Angptl6 levels are higher in women with subsequent PIH.
Lecture notes in computer scienceA Machine Learning Approach to Web Mining
9 Citations2000Floriana Esposito, Donato Malerba +2 more
A Web mining tool for content-based classification of Web pages is presented and conclusions are drawn on the relevance of the HTML layout structure for classification purposes, on the significance of words selected by the scoring measure, as well as on the performance of the different classifiers.