KEEL: a software tool to assess evolutionary algorithms for data mining problems
Soft ComputingPublished 22 May 2008Open access
Jesús Alcalá‐Fdez, Luciano Sánchez, Salvador García, María José del Jesús, Sebastián Ventura, Josep M. Garrell
Citations1,493
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
This paper introduces a software tool named KEEL which is a software tool to assess evolutionary algorithms for Data Mining problems of various kinds including as regression, classification, unsupervised learning, etc. It includes evolutionary learning algorithms based on different approaches: Pittsburgh, Michigan and IRL, as well as the integration of evolutionary learning techniques with different pre-processing techniques, allowing it to perform a complete analysis of any learning model in comparison to existing software tools. Moreover, KEEL has been designed with a double goal: research and educational.
Keywords
Computer Science
Choice Reviews OnlineGenetic algorithms in search, optimization, and machine learning
49,278 Citations1989
This book brings together the computer techniques, mathematical tools, and research results that will enable both students and practitioners to apply genetic algorithms to problems in many fields.
The MIT Press eBooksAdaptation in Natural and Artificial Systems
35,568 Citations1992John H. Holland
Initially applying his concepts to simply defined artificial systems with limited numbers of parameters, Holland goes on to explore their use in the study of a wide range of complex, naturally occuring processes, concentrating on systems having multiple factors that interact in nonlinear ways.
Elsevier eBooksData Mining: Practical Machine Learning Tools and Techniques
25,718 Citations2011Ian H. Witten, Eibe Frank
C4.5: Programs for Machine Learning
23,665 Citations1992J. R. Quinlan
A complete guide to the C4.5 system as implemented in C for the UNIX environment, which starts from simple core learning methods and shows how they can be elaborated and extended to deal with typical problems such as missing data and over hitting.
Genetic Algorithms in Search, Optimization and Machine Learning
17,773 Citations1988David E. Goldberg, David Robson
A study of cross-validation and bootstrap for accuracy estimation and model selection
10,733 Citations1995Ron Kohavi
The results indicate that for real-word datasets similar to the authors', the best method to use for model selection is ten fold stratified cross validation even if computation power allows using more folds.
Introduction to Data Mining
7,026 Citations2008
Natural computing seriesIntroduction to Evolutionary Computing
4,175 Citations2003A. E. Eiben, James E. Smith
Neural ComputationApproximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
3,654 Citations1998Thomas G. Dietterich
This article reviews five approximate statistical tests for determining whether one learning algorithm outperforms another on a particular learning task and measures the power (ability to detect algorithm differences when they do exist) of these tests.
IEEE Transactions on Systems Man and CyberneticsGenerating fuzzy rules by learning from examples
2,876 Citations1992L.-X. Wang, Jerry M. Mendel
IEEE Transactions on Pattern Analysis and Machine IntelligenceRotation Forest: A New Classifier Ensemble Method
1,877 Citations2006Juan J. Rodríguez, Ludmila I. Kuncheva +1 more
This work examined the rotation forest ensemble on a random selection of 33 benchmark data sets from the UCI repository and compared it with bagging, AdaBoost, and random forest and prompted an investigation into diversity-accuracy landscape of the ensemble models.
Data preparation for data mining
1,369 Citations1999Dorian Pyle
A twenty-five-year veteran of what has become the data mining industry, Pyle shares his own successful data preparation methodology, offering both a conceptual overview for managers and complete technical details for IT professionals.
Studies in classification, data analysis, and knowledge organizationKNIME: The Konstanz Information Miner
1,266 Citations2008Michael R. Berthold, Nicolas Cebron +8 more
Some of the design aspects of the underlying architecture of the Konstanz Information Miner are described and briefly sketch how new nodes can be incorporated.
Machine LearningReduction Techniques for Instance-Based Learning Algorithms
1,188 Citations2000D.R. Wilson, Tony Martinez
Of those algorithms that provide substantial storage reduction, the DROP algorithms have the highest average generalization accuracy in these experiments, especially in the presence of uniform class noise.
YALE
1,018 Citations2006Ingo Mierswa, Michael Wurst +3 more
Yale is described, a free open-source environment for KDD and machine learning which provides a rich variety of methods which allows rapid prototyping for new applications and makes costlyre-implementations unnecessary and offers extensive functionality for process evaluation and optimization.
Data Mining and Knowledge DiscoveryDiscretization: An Enabling Technique
979 Citations2002Huan Liu, Farhad Hussain +2 more
This paper aims at a systematic study of discretization methods with their history of development, effect on classification, and trade-off between speed and accuracy.
IEEE Transactions on Pattern Analysis and Machine IntelligenceHybrid genetic algorithms for feature selection
925 Citations2004Il-Seok Oh, Jin-Seon Lee +1 more
Experiments revealed that the proposed hybrid GA is superior to both a simple GA and sequential search algorithms, and showed better convergence properties compared to the classical GAs.
Applied Artificial IntelligenceAn analysis of four missing data treatment methods for supervised learning
889 Citations2003Gustavo Batista, Maria Carolina Monard
This analysis indicates that missing data imputation based on the k-nearest neighbor algorithm can outperform the internal methods used by C4.5 and CN2 to treat missing data, and can also outperforms the mean or mode imputation method, which is a method broadly used to treatMissing values.
Natural computing seriesData Mining and Knowledge Discovery with Evolutionary Algorithms
768 Citations2002Alex A. Freitas
This book integrates two areas of computer science, namely data mining and evolutionary algorithms, and emphasizes the importance of discovering comprehensible, interesting knowledge, which is potentially useful for intelligent decision making.
Genetic Fuzzy Systems: Evolutionary Tuning And Learning Of Fuzzy Knowledge Bases
755 Citations2002Óscar Cordón, Francisco Herrera +2 more
Applied Artificial IntelligenceData preparation for data mining
501 Citations2003Shichao Zhang, Chengqi Zhang +1 more
The importance of data preparation in data analysis is shown, some research achievements in the area of data preparedness are introduced, and some future directions of research and development are suggested.
Lecture notes in computer scienceOrange: From Experimental Machine Learning to Interactive Data Mining
429 Citations2004Janez Demšar, Blaž Zupan +2 more
Orange provides a visual programming framework with emphasis on interactions and creative combinations of visual components for explorative data analysis and offers scripting to easily prototype new algorithms and experimental procedures.
IEEE Transactions on Evolutionary ComputationUsing evolutionary algorithms as instance selection for data reduction in KDD: an experimental study
331 Citations2003José-Ramón Cano, Francisco Herrera +1 more
The results show that the evolutionary instance selection algorithms consistently outperform the nonevolutionary ones, the main advantages being: better instance reduction rates, higher classification accuracy, and models that are easier to interpret.
Genetic Algorithms for Pattern Recognition
242 Citations2017Sankar K. Pal, Paul P. Wang
Genetic Algorithms for Pattern Recognition covers a broad range of applications in science and technology, describing the integration of genetic algorithms in pattern recognition and machine learning problems to build intelligent recognition systems.
Kluwer Academic Publishers eBooksData Mining Using Grammar Based Genetic Programming and Applications
195 Citations2002Man Leung Wong, Kwong‐Sak Leung
Describes a framework, called GGP (Generic Genetic Programming), that integrates GP and ILP based on a formalism of logic grammers that accelerates the learning speed and/or improves the quality of the knowledge induced.
User Modeling and User-Adapted InteractionKnowledge Discovery with Genetic Programming for Providing Feedback to Courseware Authors
167 Citations2004Crist�bal Romero, Sebastián Ventura +1 more
A specific data mining tool is presented that can help non-experts in data mining carry out the complete rule discovery process, and its utility is demonstrated by applying it to an adaptive Linux course that was developed.
Soft ComputingJCLEC: a Java framework for evolutionary computation
154 Citations2007Sebastián Ventura, Cristóbal Romero +3 more
JCLEC, a Java software system for the development of evolutionary computation applications, has been designed as a framework, applying design patterns to maximize its reusability and adaptability to new paradigms with a minimum of programming effort.
IEEE Transactions on Fuzzy SystemsInduction of Fuzzy-Rule-Based Classifiers With Evolutionary Boosting Algorithms
139 Citations2004María José del Jesús, Frank Hoffmann +2 more
A novel Adaboost algorithm to learn fuzzy-rule-based classifiers using evolutionary boosting scheme and performance comparisons between the proposed method and other classification schemes applied on a set of benchmark classification tasks are assessed.
EGC eBooksTANAGRA : un logiciel gratuit pour l'enseignement et la recherche.
134 Citations2005Ricco Rakotomalala
International Journal of Intelligent SystemsMOGUL: A methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach
118 Citations1999O. Cord�n, María José del Jesús +2 more
A specific evolutionary learning process obtained from the paradigm proposed to design unconstrained approximate Mamdani‐type fuzzy rule‐based systems will be introduced, and its accuracy in the solving of a real‐world electrical engineering problem will be analyzed.
International Journal of Artificial Intelligence ToolsGENERICITY IN EVOLUTIONARY COMPUTATION SOFTWARE TOOLS: PRINCIPLES AND CASE-STUDY
116 Citations2006Christian Gagné, Marc Parizeau
Six basic principles are proposed to guide the development of generic software development tools in evolutionary computations (EC), and these principles are used to evaluate six freely available, widely used EC software tools.
IEEE Transactions on Evolutionary ComputationDomain of Competence of XCS Classifier System in Complexity Measurement Space
107 Citations2005Ester Bernadó-Mansilla, T.K. Ho
This paper investigates the domain of competence of XCS by means of a methodology that characterizes the complexity of a classification problem by a set of geometrical descriptors, and focuses on XCS with hyperrectangle codification, which has been predominantly used for real-attributed domains.
Applied IntelligenceSolving Electrical Distribution Problems Using Hybrid Evolutionary Data Analysis Techniques
105 Citations1999Óscar Cordón, Francisco Herrera +1 more
This paper shows that Genetic Fuzzy Rule-Based Systems and Genetic Programming techniques are good choices for tackling with some practical modeling problems and that both evolutionary processes may produce good numerical results while providing us with a model that can be interpreted by a human being.
Neural NetworksEvolutionary product unit based neural networks for regression
104 Citations2006Alfonso Carlos Martínez-Estudillo, Francisco José Martínez-Estudillo +2 more
The proposed model evolves both the weights and the structure of these networks by means of an evolutionary programming algorithm and shows better overall performance in the benchmark functions as well as the real-world problem of microbial growth modeling.
Intelligent Technologies for Information Analysis
99 Citations2004Ning Zhong, Jiming Liu
This chapter discusses Grid-Based Data Mining and Knowledge Discovery, Constructing Hybrid Intelligent Systems for Data Mining from Agent Perspectives, and Making Agents Acceptable to People.
Soft ComputingHybrid learning models to get the interpretability–accuracy trade-off in fuzzy modeling
97 Citations2005Rafael Alcalá, Jesús Alcalá‐Fdez +3 more
This work analyzes seven hybrid approaches to develop accurate and still interpretable fuzzy rule-based systems, which will be tested considering two real-world problems.
Soft ComputingInduction of descriptive fuzzy classifiers with the Logitboost algorithm
90 Citations2005José Otero, Luciano Sánchez
It is shown that the basic extension of the backfitting algorithm to learn classification rules may produce worse results than Adaboost, and it is suggested that this is caused by the stricter requirements that Logitboost demands to the weak learners, which are not fulfilled by fuzzy rules.
The MiningMart Approach to Knowledge Discovery in Databases
83 Citations2004Katharina Morik, Martin Scholz
The MiningMart system presented in this chapter focuses on setting up and re-using best practice cases of preprocessing data stored in very large databases using a metadata model named M4, which allows reuse of best practice cases published on the Internet.
IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)A multiobjective evolutionary algorithm toolbox for computer-aided multiobjective optimization
75 Citations2001Kay Chen Tan, T.H. Lee +2 more
The effectiveness and applications of the toolbox are illustrated via the design optimization problem of a practical ill-conditioned distillation system and performance of the algorithm in MOEA toolbox is compared with other well-known evolutionary MO optimization methods upon a benchmark problem.
Computers & GeosciencesADaM: a data mining toolkit for scientists and engineers
68 Citations2005John Rushing, Rahul Ramachandran +4 more
The architecture and design of the ADaM toolkit is presented and its application in detecting cumulus cloud fields in satellite imagery is discussed.
Studies in fuzziness and soft computingEvolutionary Computation in Data Mining
63 Citations2005Ashish Ghosh
This paper presents an Evolutionary Modularized Data Mining Mechanism for Financial Distress Forecasts and strategies for Scaling Up Evolutionary Instance Reduction Algorithms for Data Mining.
UWE Research Repository (UWE Bristol)MAFRA: A java memetic algorithms framework
27 Citations2000Natalio Krasnogor, James E. Smith
Soft ComputingA new hybrid methodology for cooperative-coevolutionary optimization of radial basis function networks
27 Citations2006Antonio J. Rivera, Ignacio Rojas +2 more
The results of applying this new multiobjective cooperative–coevolutive hybrid algorithm to function approximation and time series prediction problems are presented and compared with other alternatives proposed in the bibliography.
IEEE Transactions on Power SystemsAn extensible genetic algorithm framework for problem solving in a common environment
22 Citations2000A.S. Chuang, F. Wu
An object-oriented framework for solving mathematical programs using genetic algorithms (GA's) that incorporates a graphical uscr's interface that may be used to build new GA's as well as run GA simulations.
Soft ComputingEvolutionary learning of a fuzzy controller for wall-following behavior in mobile robotics
20 Citations2005Manuel Mucientes, David L. Moreno +2 more
The automated design of a fuzzy controller using genetic algorithms for the implementation of the wall-following behavior in a mobile robot is described, based on the iterative rule learning approach.
Soft ComputingIntelligent data analysis with fuzzy decision trees
20 Citations2006Xiaomeng Wang, Detlef Nauck +2 more
This work investigates fuzzy decision trees as a method of intelligent data analysis for classification problems and presents the whole process from fuzzy tree learning, missing value handling to fuzzy rules generation and pruning, and shows a real-world application for the quality control of car surfaces using this approach.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)Design and implementation of a distributed evolutionary computing software
20 Citations2003Kay Chen Tan, Arthur Tay +1 more
This paper presents a Java-based distributed evolutionary computing software (Paladin-DEC), which enhances the concurrent processing and performance of evolutionary algorithms by allowing inter-communications of subpopulations among various computers over the Internet.
Intelligent Data AnalysisPrototype induction and attribute selection via evolutionary algorithms
16 Citations2003Xavier Llorà, Josep M. Garrell
Results suggest that GALE is competitive and robust for inducing sets of partially-defined instances and achieves better reduction rates in storage requirements without losses in generalization accuracy.
ACM SIGEVOlutionE2K
15 Citations2006Xavier Llorà
Evolvica was a first attempt to create a visual programming oriented framework that allows beginners and researchers to share a common ground that allow them to deploy and quickly reuse the basic components of evolutionary algorithms.
Soft ComputingVariants of evolutionary learning for interactive image retrieval
9 Citations2006Zoran Stejić, Yasufumi Takama +1 more
Comparison with the representative of the existing RF methods shows that EAs are both effective and efficient approaches for SSS learning in region-based image retrieval.
RePEc: Research Papers in EconomicsA Generic Approach to an Object-Oriented Learning Classifier System Library
6 Citations2006Matthias Meyer, Klaus Hufschlag
The basic ideas behind a LCS library are presented, which can relieve simulation researchers of some of the technical work and can provide a generic structure for modelling LCS.