Chi Square Feature Extraction Based Svms Arabic Language Text Categorization System
Journal of Computer SciencePublished 1 June 2007
Abdelwadood Mesleh
Citations241
SJR quartileQ4
SJR score0.20
SNIP0.31
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This system shows a high classification effectiveness for Arabic data set in term of F-measure (F=88.11) and uses CHI square method as a feature selection method in the pre-processing step of the Text Classification system design procedure.
Abstract
This paper aims to implement a Support Vector Machines (SVMs) based text classification system for Arabic language articles. This classifier uses CHI square method as a feature selection method in the pre-processing step of the Text Classification system design procedure. Comparing to other classification methods, our system shows a high classification effectiveness for Arabic data set in term of F-measure (F=88.11).
Keywords
Computer Science
An Introduction to the Bootstrap
39,744 Citations1994Bradley Efron, Robert Tibshirani
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Cambridge University Press eBooksAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
13,883 Citations2000Nello Cristianini, John Shawe‐Taylor
Modern Information Retrieval
11,544 Citations1999Ricardo Baeza‐Yates, Berthier Ribeiro‐Neto
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
Lecture notes in computer scienceText categorization with Support Vector Machines: Learning with many relevant features
7,925 Citations1998Thorsten Joachims
SVMs achieve substantial improvements over the currently best performing methods and behave robustly over a variety of di-erent learning tasks, eliminating the need for manual parameter tuning.
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
A Comparative Study on Feature Selection in Text Categorization
4,766 Citations1997Yiming Yang, Jan Pedersen
DF thresholding, the simplest method with the lowest cost in computation, can be reliably used instead of IG or CHI when the computation of these measures are too expensive, and strong correlations between the DF, IG and CHI values of a term are found.
A re-examination of text categorization methods
2,660 Citations1999Yiming Yang, Xin Liu
The results show that SVM, kNN and LLSF signi cantly outperform NNet and NB when the number of positive training instances per category are small, and that all the methods perform comparably when the categories are over 300 instances.
Machine LearningBoosTexter: A Boosting-based System for Text Categorization
2,194 Citations2000Robert E. Schapire, Yoram Singer
This work describes in detail an implementation, called BoosTexter, of the new boosting algorithms for text categorization tasks, and presents results comparing the performance of Boos Texter and a number of other text-categorization algorithms on a variety of tasks.
Information RetrievalAn Evaluation of Statistical Approaches to Text Categorization
1,946 Citations1999Yiming Yang
Analysis and empirical evidence suggest that the evaluation results on some versions of Reuters were significantly affected by the inclusion of a large portion of unlabelled documents, mading those results difficult to interpret and leading to considerable confusions in the literature.
Learning to Classify Text Using Support Vector Machines
1,366 Citations2002Thorsten Joachims
This book gives a concise introduction to SVMs for pattern recognition, and it includes a detailed description of how to formulate text-classification tasks for machine learning.
Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms
934 Citations2002Thorsten Joachims
IEEE Transactions on Pattern Analysis and Machine IntelligenceSupport vector machines for 3D object recognition
809 Citations1998Massimiliano Pontil, Alessandro Verri
The proposed system does not require feature extraction and performs recognition on images regarded as points of a space of high dimension without estimating pose, indicating that SVMs are well-suited for aspect-based recognition.
A comparison of classifiers and document representations for the routing problem
451 Citations1995Hinrich Schütze, David A. Hull +1 more
This paper considers three classification techniques which have decision rules that are derived via explicit error minimization linear discriminant analysis, logistic regression, and neuraf networks, and finds that features based on latent semantic indexing are more effective for techniques such aslinear discriminant anaf-ysis and logistic regressors, which have no way to protect against overfitting.
Improving stemming for Arabic information retrieval
360 Citations2002Leah S. Larkey, Lisa Ballesteros +1 more
Several light stemmers based on heuristics and a statistical stemmer based on co-occurrence for Arabic retrieval and the retrieval effectiveness of these stemmers and of a morphological analyzer on the TREC-2001 data were compared.
Learning the Similarity of Documents: An Information-Geometric Approach to Document Retrieval and Categorization
126 Citations1999Thomas Hofmann
The project pursued in this paper is to develop from first information-geometric principles a general method for learning the similarity between text documents based on a latent class decomposition of the term-document matrix, a low-dimensional (curved) multinomial subfamily is learned.
Lecture notes in computer scienceAn kNN Model-Based Approach and Its Application in Text Categorization
78 Citations2004Gongde Guo, Hui Wang +3 more
A new classifier called the kNN model-based classifier is proposed by unifying the strengths of k-NN and Rocchio classifier and adapting to characteristics of text categorization problems.
Journal of the American Society for Information ScienceUsing corpus statistics to remove redundant words in text categorization
62 Citations1996Yiming Yang, John Wilbur
It is evident in this study that automated word removal based on corpus statistics has a practical and significant impact on the computational tractability of categorization methods in large databases.
Conference on Computational Natural Language LearningModeling Category Structures with a Kernel Function
5 Citations2004Hiroya Takamura, Yuji Matsumoto +1 more
This work constructs a TOP kernel, regarding the probabilistic model of negative examples as a mixture of several component models respectively corresponding to given categories, and shows that the computational advantage is shared by a more general class of models.