Application of independent component analysis to microarrays
Genome biologyPublished 24 October 2003Open access
Su‐In Lee, Serafim Batzoglou
Citations261
SJR quartileQ1
SJR score5.71
SNIP2.21
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
ICA outperforms other leading methods, such as principal component analysis, k-means clustering and the Plaid model, in constructing functionally coherent clusters on microarray datasets from Saccharomyces cerevisiae, Caenorhabditis elegans and human.
Abstract
We apply linear and nonlinear independent component analysis (ICA) to project microarray data into statistically independent components that correspond to putative biological processes, and to cluster genes according to over- or under-expression in each component. We test the statistical significance of enrichment of gene annotations within clusters. ICA outperforms other leading methods, such as principal component analysis, k-means clustering and the Plaid model, in constructing functionally coherent clusters on microarray datasets from Saccharomyces cerevisiae, Caenorhabditis elegans and human.
Keywords
ChemistryComputer ScienceBiochemistry, Genetics and Molecular Biology
Proceedings of the National Academy of SciencesCluster analysis and display of genome-wide expression patterns
16,395 Citations1998Michael B. Eisen, Paul T. Spellman +2 more
A system of cluster analysis for genome-wide expression data from DNA microarray hybridization is described that uses standard statistical algorithms to arrange genes according to similarity in pattern of gene expression, finding in the budding yeast Saccharomyces cerevisiae that clustering gene expression data groups together efficiently genes of known similar function.
ScienceMolecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring
11,622 Citations1999Todd R. Golub, Donna K. Slonim +10 more
A generic approach to cancer classification based on gene expression monitoring by DNA microarrays is described and applied to human acute leukemias as a test case and suggests a general strategy for discovering and predicting cancer classes for other types of cancer, independent of previous biological knowledge.
Neural ComputationAn Information-Maximization Approach to Blind Separation and Blind Deconvolution
9,194 Citations1995Anthony J. Bell, Terrence J. Sejnowski
It is suggested that information maximization provides a unifying framework for problems in "blind" signal processing and dependencies of information transfer on time delays are derived.
IEEE Transactions on Neural NetworksFast and robust fixed-point algorithms for independent component analysis
6,275 Citations1999Aapo Hyvärinen
Using maximum entropy approximations of differential entropy, a family of new contrast (objective) functions for ICA enable both the estimation of the whole decomposition by minimizing mutual information, and estimation of individual independent components as projection pursuit directions.
International Conference on Neural Information ProcessingAdvances in kernel methods: support vector learning
5,815 Citations1999Bernhard Schölkopf, Christopher J. C. Burges +1 more
Support vector machines for dynamic reconstruction of a chaotic system, Klaus-Robert Muller et al pairwise classification and support vector machines, Ulrich Kressel.
Molecular Biology of the CellGenomic Expression Programs in the Response of Yeast Cells to Environmental Changes
4,932 Citations2000Audrey P. Gasch, Paul T. Spellman +6 more
Analysis of genomic expression patterns in the yeast Saccharomyces cerevisiae implicated the transcription factors Yap1p, as well as Msn2p and Msn4p, in mediating specific features of the transcriptional response, while the identification of novel sequence elements provided clues to novel regulators.
Molecular Biology of the CellComprehensive Identification of Cell Cycle–regulated Genes of the Yeast<i>Saccharomyces cerevisiae</i>by Microarray Hybridization
4,799 Citations1998Paul T. Spellman, Gavin Sherlock +7 more
A comprehensive catalog of yeast genes whose transcript levels vary periodically within the cell cycle is created, and it is found that the mRNA levels of more than half of these 800 genes respond to one or both of these cyclins.
BioinformaticsMissing value estimation methods for DNA microarrays
4,266 Citations2001Olga G. Troyanskaya, Michael Cantor +6 more
It is shown that KNNimpute appears to provide a more robust and sensitive method for missing value estimation than SVDimpute, and both SVD Impute and KNN Impute surpass the commonly used row average method (as well as filling missing values with zeros).
IEEE Transactions on Neural NetworksAn introduction to kernel-based learning algorithms
3,490 Citations2001K. Müller, S. Mika +3 more
This paper provides an introduction to support vector machines, kernel Fisher discriminant analysis, and kernel principal component analysis, as examples for successful kernel-based learning methods.
Journal of Computational BiologyUsing Bayesian Networks to Analyze Expression Data
3,320 Citations2000Nir Friedman, Michal Linial +2 more
Proceedings of the National Academy of SciencesInterpreting patterns of gene expression with self-organizing maps: Methods and application to hematopoietic differentiation
2,946 Citations1999Pablo Tamayo, Donna K. Slonim +6 more
The application of self-organizing maps, a type of mathematical cluster analysis that is particularly well suited for recognizing and classifying features in complex, multidimensional data, is described.
Neural ComputationNatural Gradient Works Efficiently in Learning
2,700 Citations1998Шун-ичи Амари
The dynamical behavior of natural gradient online learning is analyzed and is proved to be Fisher efficient, implying that it has asymptotically the same performance as the optimal batch estimation of parameters.
Nature GeneticsSystematic determination of genetic network architecture
2,556 Citations1999Saeed Tavazoie, Jason D. Hughes +3 more
A systematic set of statistical algorithms are applied, based on whole-genome mRNA data, partitional clustering and motif discovery, to identify transcriptional regulatory sub-networks in yeast—without any a priori knowledge of their structure or any assumptions about their dynamics.
Signal ProcessingBlind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
2,522 Citations1991Christian Jutten, Jeanny Hérault
Proceedings of the National Academy of SciencesKnowledge-based analysis of microarray gene expression data by using support vector machines
2,315 Citations2000Michael P. Brown, William Noble Grundy +6 more
A method of functionally classifying genes by using gene expression data from DNA microarray hybridization experiments, based on the theory of support vector machines (SVMs), to predict functional roles for uncharacterized yeast ORFs based on their expression data is introduced.
Molecular CellA Genome-Wide Transcriptional Analysis of the Mitotic Cell Cycle
2,076 Citations1998Raymond J. Cho, Michael J. Campbell +9 more
The genome-wide characterization of mRNA transcript levels during the cell cycle of the budding yeast S. cerevisiae indicates a mechanism for local chromosomal organization in global mRNA regulation and links a range of human genes to cell cycle period-specific biological functions.
Proceedings of the National Academy of SciencesSingular value decomposition for genome-wide expression data processing and modeling
2,012 Citations2000Orly Alter, Patrick O. Brown +1 more
Using singular value decomposition in transforming genome-wide expression data from genes x arrays space to reduced diagonalized "eigengenes" x "eigenarrays" space gives a global picture of the dynamics of gene expression, in which individual genes and arrays appear to be classified into groups of similar regulation and function, or similar cellular state and biological phenotype.
Nature GeneticsMicroarray data normalization and transformation
2,007 Citations2002John Quackenbush
This review focuses on the much more mundane but indispensable tasks of 'normalizing' data from individual hybridizations to make meaningful comparisons of expression levels, and of 'transforming' them to select genes for further analysis and data mining.
Neural ComputationIndependent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources
1,978 Citations1999Te-Won Lee, Mark Girolami +1 more
An extension of the infomax algorithm of Bell and Sejnowski (1995) is presented that is able blindly to separate mixed signals with sub- and supergaussian source distributions and is effective at separating artifacts such as eye blinks and line noise from weaker electrical signals that arise from sources in the brain.
Independent Component Analysis of Electroencephalographic Data
1,934 Citations1995Scott Makeig, Anthony J. Bell +2 more
First results of applying the ICA algorithm to EEG and event-related potential (ERP) data collected during a sustained auditory detection task show that ICA training is insensitive to different random seeds and ICA may be used to segregate obvious artifactual EEG components from other sources.
European Journal of BiochemistryThe AMP‐Activated Protein Kinase
1,314 Citations1997D. Grahame Hardie, David Carling
The central hypothesis is that the AMP-activated protein kinase cascade appears to be an ancient system which evolved to protect cells against the effects of nutritional or environmental stress, and protects the cell by switching off ATP-consuming pathways and switching on alternative pathways for ATP generation.
Journal of Computational BiologyClustering Gene Expression Patterns
1,229 Citations1999Amir Ben‐Dor, Ron Shamir +1 more
Neural ComputationHigh-Order Contrasts for Independent Component Analysis
1,221 Citations1999J.-F. Cardoso
This article considers high-order measures of independence for the independent component analysis problem and discusses the class of Jacobi algorithms for their optimization and compares the proposed approaches with gradient-based techniques from the algorithmic point of view and also on a set of biomedical data.
Survey on Independent Component Analysis
1,122 Citations1999Aapo Hyvärinen
This paper surveys the existing theory and methods for independent component analysis (ICA), in which the desired representation is the one that minimizes the statistical dependence of the components of the representation.
Genome ResearchCreating the Gene Ontology Resource: Design and Implementation
963 Citations2001The Gene Ontology Consortium
The Gene Ontology project seeks to provide a set of structured vocabularies for specific biological domains that can be used to describe gene products in any organism, which includes building three extensive ontologies to describe molecular function, biological process, and cellular component.
Neural NetworksImproving support vector machine classifiers by modifying kernel functions
922 Citations1999Шун-ичи Амари, Si Wu
Simulation results for both artificial and real data show remarkable improvement of generalization errors, supporting the idea of modifying a kernel function to enlarge the spatial resolution around the separating boundary surface by a conformal mapping, such that the separability between classes is increased.
The Mouseion at the JAXlibrary (Jackson Laboratory)Creating the gene ontology resource: design and implementation.
829 Citations2001Judith A. Blake, John Corradi +4 more
CellDevelopment of Genetic Circuitry Exhibiting Toggle Switch or Oscillatory Behavior in Escherichia coli
745 Citations2003Mariette R. Atkinson, Michael A. Savageau +2 more
Analysis of the system design principles of signaling systems requires model systems where all components and regulatory interactions are known, and component systems used to construct genetic circuits that display toggle switch or oscillatory behavior.
Nature GeneticsRegulatory element detection using correlation with expression
732 Citations2001Harmen J. Bussemaker, Hao Li +1 more
Analysis of publicly available expression data for Saccharomyces cerevisiae reveals several new putative regulatory elements, some of which plausibly control the early, transient induction of genes during sporulation.
ScienceGenomic Cis-Regulatory Logic: Experimental and Computational Analysis of a Sea Urchin Gene
687 Citations1998Chiou‐Hwa Yuh, Hamid Bolouri +1 more
A quantitative computational model was constructed that explicitly reveals the logical interrelations hard-wired into the DNA of a sea urchin control element that directs the expression of a gene in the endoderm during development.
ScienceA Gene Expression Map for <i>Caenorhabditis elegans</i>
664 Citations2001Stuart K. Kim, Jim Lund +7 more
This work assembled data from Caenorhabditis elegans DNA microarray experiments involving many growth conditions, developmental stages, and varieties of mutants to create a three-dimensional expression map that displays correlations of gene expression profiles as distances in two dimensions and gene density in the third dimension.
Electroencephalography and Clinical NeurophysiologyExtraction of ocular artefacts from EEG using independent component analysis
637 Citations1997Ricardo Vigário
Through the statistical technique of independent component analysis, it is possible to isolate pure eye activity in the EEG recordings (including EOG channels), and so reduce the amount of brain activity that is subtracted from the measurements, when extracting portions of the EOG signals.
Journal of Biomedical OpticsRatio-based decisions and the quantitative analysis of cDNA microarray images
550 Citations1997Yidong Chen
Gene expression can be quantitatively analyzed by hybridizing fluor-tagged mRNA to targets on a cDNA micro-array and based on a hypothesis test and confidence interval to quantify the significance of observed differences in expression ratios.
Neural NetworksNonlinear independent component analysis: Existence and uniqueness results
526 Citations1999Aapo Hyvärinen, P. Pajunen
It is shown that if the space of mixing functions is not limited there exists always an infinity of solutions, and that for two dimensions, the solution is unique up to a rotation, if the mixing function is constrained to be a conformal mapping together with some other assumptions.
Physiological GenomicsA compendium of gene expression in normal human tissues
516 Citations2001Li-Li Hsiao, Fernando Dangond +21 more
A compendium of gene expression in normal human tissues suitable as a reference for defining basic organ systems biology is created and subsets of tissue-selective genes are identified that define key biological processes characterizing each organ.
Nature Reviews Drug DiscoveryThe use and analysis of microarray data
480 Citations2002Atul J. Butte
The different ways to analyse large sets of microarray data are reviewed, including the questions that can be asked and the challenges in interpreting the measurements.
BioinformaticsA variance-stabilizing transformation for gene-expressionmicroarray data
476 Citations2002Blythe Durbin, J.S. Hardin +2 more
A transformation is introduced that stabilizes the variance of microarray data across the full range of expression, and simulation studies suggest that this transformation approximately symmetrizes micro array data.
Journal of Computational BiologyA Model for Measurement Error for Gene Expression Arrays
437 Citations2001David M. Rocke, Blythe Durbin
This model, together with analysis methods, data transformations, and weighting, allows much more precise comparisons of gene expression, and provides guidance for analysis of background, determination of confidence intervals, and preprocessing data for multivariate analysis.
IEEE Transactions on Signal ProcessingSource separation in post-nonlinear mixtures
412 Citations1999Anas Abu Taleb, Christian Jutten
It is proved that in the general case, it is not possible to separate the sources without nonlinear distortion, and this work focuses on specific nonlinear mixtures known as post-nonlinear mixture, which are realistic models in many situations and emphasize interesting properties i.e., in such nonlinearmixtures, sources can be estimated with the same indeterminacies as in instantaneous linear mixtures.
IEEE Transactions on Neural NetworksA class of neural networks for independent component analysis
403 Citations1997Juha Karhunen, Erkki Oja +3 more
This paper proposes neural structures related to multilayer feedforward networks for performing complete independent component analysis (ICA) and modify the previous nonlinear PCA type algorithms so that their separation capabilities are greatly improved.
BioinformaticsLinear modes of gene expression determined by independent component analysis
336 Citations2002Wolfram Liebermeister
Studying cell cycle-related gene expression in yeast, it is found that the dominant expression modes could be related to distinct biological functions, such as phases of the cell cycle or the mating response.
Genome biologyApplication of independent component analysis to microarrays
261 Citations2003Su‐In Lee, Serafim Batzoglou
ICA outperforms other leading methods, such as principal component analysis, k-means clustering and the Plaid model, in constructing functionally coherent clusters on microarray datasets from Saccharomyces cerevisiae, Caenorhabditis elegans and human.
Neural Information Processing SystemsIndependent Component Analysis for Identification of Artifacts in Magnetoencephalographic Recordings
220 Citations1997Ricardo Vigário, Veikko Jousmäki +3 more
The results demonstrate the capability of the independent component analysis (ICA) method to identify and clearly isolate the produced artifacts.
Neural NetworksBlind separation of sources: A nonlinear neural algorithm
215 Citations1992Gilles Burel
A new algorithm, based on ideas of back propagation learning, is proposed for source separation, and the algorithm can deal even with nonlinear mixtures.
NeuroImageSpatiotemporal Independent Component Analysis of Event-Related fMRI Data Using Skewed Probability Density Functions
186 Citations2002James V. Stone, John Porrill +2 more
It is argued that skew-stICA works because it is based on physically realistic assumptions and that the potential of ICA can only be realized if such prior knowledge is incorporated into ICA methods.
Chaos An Interdisciplinary Journal of Nonlinear ScienceDesign principles for elementary gene circuits: Elements, methods, and examples
186 Citations2001Michael A. Savageau
This three-part review reviews several elements of design that enter into the characterization of elementary gene circuits in prokaryotic organisms and identifies four design principles that make specific predictions regarding the realizability of alternative gene circuits and their response to phased environmental cues.
Support Vector Machine Classification of Microarray Data
181 Citations2001Sayan Mukherjee, Ryan Rifkin
This work uses a Support Vector Machine (SVM) classifier to predict cancer morphologies and treatment success and determine the relevant genes in the inference and introduced a confidence interval on the output of the SVM that allows it to reject points with low confidence values.
Current Topics in Computational Molecular Biology
177 Citations2002Tao Jiang, Michael Zhang +1 more
This survey of computational molecular biology covers traditional topics such as protein structure modeling and sequence alignment, and more recent ones such as expression data analysis and comparative genomics.
Dynamically Adapting Kernels in Support Vector Machines
153 Citations1998Nello Cristianini, Colin Campbell +1 more
In this procedure model selection and learning are not separate, but kernels are dynamically adjusted during the learning process to find the kernel parameter which provides the best possible upper bound on the generalisation error.
Genome ResearchInteractive Exploration of Microarray Gene Expression Patterns in a Reduced Dimensional Space
151 Citations2002Jatin Misra, William Schmitt +5 more
In this study, PCA projection facilitated discriminatory gene selection for different tissues and identified tissue-specific gene expression signatures for liver, skeletal muscle, and brain samples.
Neural NetworksIndependent component analysis for noisy data — MEG data analysis
143 Citations2000Shiro Ikeda, Keisuke Toyama
This article implements a factor analysis model for pre-processing of neurobiological data and shows an approach to separate noise-contaminated data without knowing the number of independent components is effective.
DECOMPOSING GENE EXPRESSION INTO CELLULAR PROCESSES
103 Citations2002Eran Segal, Alexis Battle +1 more
An iterative procedure, based on the EM algorithm, for decomposing the expression matrix into a given number of processes, which indicates that the approach identifies real biological processes.
American Journal of Respiratory Cell and Molecular BiologyPractical Approaches to Analyzing Results of Microarray Experiments
86 Citations2002Naftali Kaminski, Nir Friedman
A practically oriented review focusing on methods for analysis of large-scale gene expression data in the research laboratory, focusing on the statistical meaning of microarray results, especially with regard to the problem of multiple testing.
International Journal of Neural SystemsAN EXPERIMENTAL COMPARISON OF NEURAL ALGORITHMS FOR INDEPENDENT COMPONENT ANALYSIS AND BLIND SEPARATION
86 Citations1999Xavier Giannakopoulos, Juha Karhunen +1 more
Comparing five prominent neural or adaptive algorithms designed for Independent Component Analysis and blind source separation reveals robustness of the ICA algorithms with respect to modest modeling imperfections, and the superiority of fixed-point algorithms withrespect to the computational load.
PubMedRoles of the AMP-activated/SNF1 protein kinase family in the response to cellular stress.
75 Citations1999D. Grahame Hardie
Japanese Journal of Cancer ResearchFuzzy Neural Network Applied to Gene Expression Profiling for Predicting the Prognosis of Diffuse Large B‐cell Lymphoma
59 Citations2002Tatsuya Ando, Miyuki Suguro +4 more
A fuzzy neural network (FNN) model was developed to analyze gene expression profiling data for DLBCL and identified four genes that could be used to predict prognosis with 93% accuracy.
Proceedings of International Conference on Neural Networks (ICNN'97)Generalised independent component analysis through unsupervised learning with emergent Bussgang properties
36 Citations2002Mark Girolami, Colin Fyfe
An information theoretic criterion for exploratory projection pursuit is utilised and it is shown that maximisation by natural gradient ascent of the divergence of a multivariate distribution from normality, using the negentropy as a distance measure, yields a generalised independent component analysis (ICA).
Kernel Feature Spaces and Nonlinear Blind Souce Separation
23 Citations2001Stefan Harmeling, Andreas Ziehe +2 more
Handling Missing Data with Variational Bayesian Learning of ICA
1 Citations2002Kwokleung Chan, Te-Won Lee +1 more
A variational Bayesian method is developed to perform Independent Component Analysis (ICA) on high-dimensional data containing missing entries that allows direct probability estimation of missing values in the high dimensional space and avoids dimension reduction preprocessing which is not feasible with missing data.