NeuroLinear: From neural networks to oblique decision rules
NeurocomputingPublished 1 September 1997Open access
Rudy Setiono, Huan Liu
Citations124
SJR quartileQ4
SJR score0.11
SNIP0.06
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
NeuroLinear is a system for extracting oblique decision rules from neural networks that have been trained for classification of patterns that is effective in extracting compact and comprehensible rules with high predictive accuracy from Neural networks.
Abstract
10.1016/S0925-2312(97)00038-6
Keywords
Computer Science
C4.5: Programs for Machine Learning
23,665 Citations1992J. R. Quinlan
A complete guide to the C4.5 system as implemented in C for the UNIX environment, which starts from simple core learning methods and shows how they can be elaborated and extended to deal with typical problems such as missing data and over hitting.
Chi2: feature selection and discretization of numeric attributes
944 Citations2002Huan Liu, Rudy Setiono
Chi2 is a simple and general algorithm that uses the /spl chi//sup 2/ statistic to discretize numeric attributes repeatedly until some inconsistencies are found in the data, and achieves feature selection via discretization.
Behavioral and Brain SciencesOn artificial intelligence
885 Citations1985Peter H. Schönemann
This paper aims to boost the accuracy of a DP logistic regression (LR) via a pre-training module via a pre-training module and shows that adding a pre-training module significantly improves the accuracy of the DP-LR model.
Communications of the ACMConnectionist expert systems
665 Citations1988Stephen I. Gallant
Connectionist networks can be used as expert system knowledge bases and can be constructed from training examples by machine learning techniques, giving a way to automate the generation of expert systems for classification problems.
IEEE Transactions on Neural NetworksA simple procedure for pruning back-propagation trained neural networks
664 Citations1990Ehud D. Karnin
Shadow arrays are introduced which keep track of the incremental changes to the synaptic weights during a single pass of back-propagating learning and are ordered by decreasing sensitivity numbers so that the network can be efficiently pruned by discarding the last items of the sorted list.
National Conference on Artificial IntelligenceChiMerge: discretization of numeric attributes
603 Citations1992Randy Kerber
ChiMerge is described, a general, robust algorithm that uses the χ2 statistic to discretize (quantize) numeric attributes.
Machine LearningExtracting Refined Rules from Knowledge-Based Neural Networks
587 Citations1993Geoffrey G. Towell, Jude Shavlik
This article proposes and empirically evaluates a method for the final, and possibly most difficult, step of the refinement of existing knowledge and demonstrates that neural networks can be used to effectively refine symbolic knowledge.
Machine LearningExtracting refined rules from knowledge-based neural networks
490 Citations1993Geoffrey G. Towell, Jude Shavlik
This article proposes and empirically evaluates a method for the final, and possibly most difficult, step of the refinement of existing knowledge and demonstrates that neural networks can be used to effectively refine symbolic knowledge.
Neural NetworksImproving the convergence of the back-propagation algorithm
417 Citations1992Arjen van Ooyen, Bernard Nienhuis
The modified back-propagation method consists of a simple change in the total error-of-performance function that is to be minimized by the algorithm, and the final approach to the desired response function is accelerated by an amount that can be predicted analytically.
Machine LearningSymbolic and Neural Learning Algorithms: An Experimental Comparison
285 Citations1991Jude Shavlik, Raymond J. Mooney +1 more
Experimental results suggest that backpropagation can work significantly better on data sets containing numerical data, and occasionally outperforms the other two systems when given relatively small amounts of training data.
Minds at UW (University of Wisconsin)Pattern Recognition Via Linear Programming: Theory and Application to Medical Diagnosis
257 Citations1989William H. Wolberg, O. L. Mangasarian +1 more
IEEE International Conference on Neural NetworksMedical diagnostic expert system based on PDP model
213 Citations1988Saito, Nakano
The applicability of PDP (parallel distributed processing) models to knowledge processing is clarified and a method to extract rules from the network and usage of the rules in a confirmation process are proposed.
Medical Entomology and ZoologyLarge-Scale Numerical Optimization
199 Citations1990Thomas F. Coleman, Yuying Li
Papers from a workshop held at Cornell University, Oct. 1989, and sponsored by Cornell's Mathematical Sciences Institute, show the potential of big data analytics to improve the quality of education in the classroom.
Neural ComputationA Penalty-Function Approach for Pruning Feedforward Neural Networks
192 Citations1997Rudy Setiono
Machine LearningSymbolic and neural learning algorithms: An experimental comparison
191 Citations1991Jude Shavlik, Raymond J. Mooney +1 more
ComputerSymbolic representation of neural networks
188 Citations1996Rudy Setiono, Huan Liu
This algorithm uses symbolic rules to represent the network decision process and extracts rules from a neural network with discretized hidden unit activation values to preserve network accuracy and explain the prediction process.
National Conference on Artificial IntelligenceRule learning by searching on adapted nets
161 Citations1991LiMin Fu
The KT algonhm is a novel algonthm for generating rules from an adapted net efficiently that is able to deal with both single-layer and multi-layer networks, and can learn both confirming and disconfirming rules.
IEEE Transactions on Neural NetworksClassification trees with neural network feature extraction
148 Citations1992Hong Guo, S.B. Gelfand
An empirical comparison of ID3 and back-propagation
126 Citations1989Douglas Fisher, Kathleen B. McKusick
This work experiments with a system from each paradigm: ID3 and back-propagation, and identifies aspects of each system that may account for distinct performance differences across a variety of domains.
Conference on Learning TheoryComparing connectionist and symbolic learning methods
106 Citations1994J. R. Quinlan
Results suggest that SWAP-70-374 can activate some signaling pathways, including the ERK1/2 pathway, to transform MEFs.
Elsevier eBooksA Comparative Study of ID3 and Backpropagation for English Text-to-Speech Mapping
79 Citations1990Thomas G. Dietterich, Hermann Hild +1 more
The performance of the error backpropagation (BP) and ID3 learning algorithms was compared on the task of mapping English text to phonemes and stresses and it was shown that BP consistently out-performs ID3 on this task by several percentage points.
X2R: A fast rule generator
54 Citations1995Huan Liu, Sun Teck Tan
X2R is introduced, a simple and fast algorithm that can be applied to both numeric and discrete data, and generate rules from datasets, like season-classification and golf-playing that contain continuous and/or discrete data.
PubMedDiagnostic schemes for fine needle aspirates of breast masses.
13 Citations1988Wolberg Wh, Tanner Ma +1 more
It is concluded that, while statistically designed, computer-generated dichotomous decision trees identify a starting sequence for applying cytologic characteristics to distinguish between benign and malignant breast aspirates, modifications based on human expert knowledge may result in schemes that improve diagnostic performance.