The SVM With Uneven Margins and Chinese Document Categorization

Published 1 October 2003

Yaoyong Li, John Shawe‐Taylor

Citations44

TL;DR

The experiments showed that the new algorithm significantly outperformed the SVM with respect to the document categorisation for small categories, which is believed to be the first result on this new Chinese corpus.

Abstract

We propose and study a new variant of the SVM — the SVM with uneven margins, tailored for document categorisation problems (i.e. problems where classes are highly unbalanced). Our experiments showed that the new algorithm significantly outperformed the SVM with respect to the document categorisation for small categories. Furthermore, we report the results of the SVM as well as our new algorithm on the Reuters Chinese corpus for document categorisation, which we believe is the first result on this new Chinese corpus.

Keywords

Computer Science

Lecture notes in computer scienceText categorization with Support Vector Machines: Learning with many relevant features

7,925 Citations1998Thorsten Joachims

SVMs achieve substantial improvements over the currently best performing methods and behave robustly over a variety of di-erent learning tasks, eliminating the need for manual parameter tuning.

Technical reportsMaking Large-Scale SVM Learning Practical

4,317 Citations2006Thorsten Joachims

This chapter presents algorithmic and computational results developed for SVM light V 2.0, which make large-scale SVM training more practical and give guidelines for the application of SVMs to large domains.

View PDF

ePrints Soton (University of Southampton)An Introduction to Support Vector Machines

4,120 Citations2000Nello Cristianini, John Shawe‐Taylor

A re-examination of text categorization methods

2,660 Citations1999Yiming Yang, Xin Liu

The results show that SVM, kNN and LLSF signi cantly outperform NNet and NB when the number of positive training instances per category are small, and that all the methods perform comparably when the categories are over 300 instances.

View PDF

Journal of Machine Learning ResearchRCV1: A New Benchmark Collection for Text Categorization Research

2,600 Citations2004David Lewis, Yiming Yang +2 more

This work describes the coding policy and quality control procedures used in producing the RCV1 data, the intended semantics of the hierarchical category taxonomies, and the corrections necessary to remove errorful data.

Information RetrievalText Categorization Based on Regularized Linear Classification Methods

378 Citations2001Tong Zhang, Frank J. Oles

A number of known linear classification methods as well as some variants in the framework of regularized linear systems are compared to discuss the statistical and numerical properties of these algorithms, with a focus on text categorization.

View PDF

A study of thresholding strategies for text categorization

354 Citations2001Yiming Yang

Experimental results show that the choice of thresholding strategy can significantly influence the performance of kNN, and that the ``optimal'' strategy may vary by application.

Econstor (Econstor)Combining statistical learning with a knowledge-based approach: A case study in intensive care monitoring

354 Citations1999Katharina Morik, Peter Brockhausen +1 more

View PDF

Journal of the ACMThe Association for Computing Machinery

270 Citations1954Samuel B. Williams

View PDF

Applied IntelligenceOn Machine Learning Methods for Chinese Document Categorization

72 Citations2003Ji He, Ah-Hwee Tan +1 more

A comparative evaluation of three machine learning methods, namely k Nearest Neighbor, Support Vector Machines (SVM), and Adaptive Resonance Associative Map for Chinese document categorization found that SVM is highly efficient in learning from well organized samples of moderate size, although on relatively large and noisy data the efficiency of SVM and ARAM are comparable.

View PDF