General multilayer perceptron demixer scheme for nonlinear blind signal separation

IEE Proceedings - Vision Image and Signal ProcessingPublished 1 January 2002

Wai Lok Woo, S. Sali

DOI10.1049/ip-vis:20020548

Citations25

TL;DR

A new technique is presented for instantaneous blind signal separation from nonlinear mixtures using a general neural network based demixer scheme and the superiority and the generality of the new technique compared with existing methods are illustrated.

Abstract

A new technique is presented for instantaneous blind signal separation from nonlinear mixtures using a general neural network based demixer scheme. The nonlinear demixer model follows directly from the general mixer model. In the first part of the paper a general mixer model is described which includes linear mixtures as a special case. In the second part the general framework for a demixer based on a feedforward multilayer perceptron (FMLP) employing a class of continuously differentiable nonlinear functions is presented. A detailed derivation of the learning algorithm used to adapt the demixer's parameters is given. Cost functions based on both maximum entropy (ME) and minimum mutual information (MMI) have been studied. The performance of the new technique was investigated using various experiments derived from the general mixer model and using real-time data. These studies illustrated the superiority and the generality of the new technique compared with existing methods.

Keywords

ChemistryComputer Science

Mathematics of Control Signals and SystemsApproximation by superpositions of a sigmoidal function

13,684 Citations1989George Cybenko

Neural ComputationAn Information-Maximization Approach to Blind Separation and Blind Deconvolution

9,194 Citations1995Anthony J. Bell, Terrence J. Sejnowski

It is suggested that information maximization provides a unifying framework for problems in "blind" signal processing and dependencies of information transfer on time delays are derived.

Signal ProcessingIndependent component analysis, A new concept?

8,154 Citations1994Pierre Comon

View PDF

IEEE Transactions on Signal ProcessingA blind source separation technique using second-order statistics

2,746 Citations1997Adel Belouchrani, Karim Abed‐Meraim +2 more

A new source separation technique exploiting the time coherence of the source signals is introduced, which relies only on stationary second-order statistics that are based on a joint diagonalization of a set of covariance matrices.

Neural ComputationNatural Gradient Works Efficiently in Learning

2,700 Citations1998Шун-ичи Амари

The dynamical behavior of natural gradient online learning is analyzed and is proved to be Fisher efficient, implying that it has asymptotically the same performance as the optimal batch estimation of parameters.

Proceedings of the IEEEAdaptive blind signal processing-neural network approaches

469 Citations1998Шун-ичи Амари, Andrzej Cichocki

Learning algorithms and underlying basic mathematical ideas are presented for the problem of adaptive blind signal processing, especially instantaneous blind separation and multichannel blind deconvolution/equalization of independent source signals.

IEEE Transactions on Signal ProcessingSource separation in post-nonlinear mixtures

412 Citations1999Anas Abu Taleb, Christian Jutten

It is proved that in the general case, it is not possible to separate the sources without nonlinear distortion, and this work focuses on specific nonlinear mixtures known as post-nonlinear mixture, which are realistic models in many situations and emphasize interesting properties i.e., in such nonlinearmixtures, sources can be estimated with the same indeterminacies as in instantaneous linear mixtures.

Neural NetworksBlind separation of sources: A nonlinear neural algorithm

215 Citations1992Gilles Burel

A new algorithm, based on ideas of back propagation learning, is proposed for source separation, and the algorithm can deal even with nonlinear mixtures.

IEEE Transactions on Neural NetworksNonlinear blind source separation using a radial basis function network

162 Citations2001Ying Tan, Jun Wang +1 more

By virtue of the RBF neural network, this proposed approach takes advantage of high learning convergence rate of weights in the hidden layer and output layer, natural unsupervised learning characteristics, modular structure, and universal approximation capability.

Signal ProcessingInformation–theoretic approach to blind separation of sources in non-linear mixture

153 Citations1998Howard H. Yang, Шун-ичи Амари +1 more

A two-layer perceptron is used as a de-mixing system to separate sources in non-linear mixture to derive the learning equations for the hidden layer.