Text Classification by Boosting Weak Learners based on Terms and Concepts

Published 31 March 2005

Stephan Bloehdorn, Andreas Hotho

DOI10.1109/icdm.2004.10077

Citations81

TL;DR

Experimental evaluations on two well known text corpora support the proposed enhancement of the classical document representation through concepts extracted from background knowledge through Boosting.

Abstract

Document representations for text classification are typically based on the classical bag-of-words paradigm. This approach comes with deficiencies that motivate the integration of features on a higher semantic level than single words. In this paper we propose an enhancement of the classical document representation through concepts extracted from background knowledge. Boosting is used for actual classification. Experimental evaluations on two well known text corpora support our approach through consistent improvement of the results.

Keywords

Computer Science

Journal of Computer and System SciencesA Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting

20,320 Citations1997Yoav Freund, Robert E. Schapire

ACM Computing SurveysMachine learning in automated text categorization

7,899 Citations2002Fabrizio Sebastiani

This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.

View PDF

Ontologies improve text document clustering

353 Citations2004Andreas Hotho, Steffen Staab +1 more

This work integrates core ontologies as background knowledge into the process of clustering text documents and compares clustering techniques based on pre-categorizations of texts from Reuters newsfeeds and on a smaller domain of an eLearning course about Java.

WordNet improves text document clustering

272 Citations2003Andreas Hotho, Steffen Staab +1 more

This work integrates background knowledge — in the authors' application Wordnet — into the process of clustering text documents, and clusters the documents by a standard partitional algorithm.

Lecture notes in computer scienceKAON — Towards a Large Scale Semantic Web

215 Citations2002Erol Bozsak, Marc Ehrig +15 more

KAON - the Karlsruhe Ontology and Semantic WebTool Suite is introduced, specifically designed to provide the ontology and metadata infrastructure needed for building, using and accessing semantics-driven applications on the Web and on your desktop.

Lecture notes in computer scienceBoosting for Text Classification with Semantic Features

146 Citations2006Stephan Bloehdorn, Andreas Hotho

This paper proposes an enhancement of the classical document representation through concepts extracted from background knowledge through Boosting, a successful machine learning technique used for classification.

Text categorization by boosting automatically extracted concepts

117 Citations2003Lijuan Cai, Thomas Hofmann

This paper investigates the use of concept-based document representations to supplement word- or phrase-based features, and proposes to use AdaBoost to optimally combine weak hypotheses based on both types of features.

Journal of Intelligent Information SystemsA Comparison of Word- and Sense-Based Text Categorization Using Several Classification Algorithms

98 Citations2003Athanasios Kehagias, Vassilios Petridis +2 more

This paper compares the categorization accuracy of classifier based on words to that of classifiers based on senses, and a series of experiments indicates that the use of senses does not result in any significant categorization improvement.