Maximum a posteriori-based approach to blind nonlinear underdetermined mixture
IEE Proceedings - Vision Image and Signal ProcessingPublished 1 January 2006
Wei Chen, Wai Lok Woo, S.S. Dlay, L.C. Khor
Citations6
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new learning algorithm is proposed to solve the separation problem of the blind nonlinear underdetermined mixtures and utilises the generalised Gaussian distribution to model the prior probability distribution of the source signals and the mixing variables.
Abstract
A new learning algorithm is proposed to solve the separation problem of the blind nonlinear underdetermined mixtures. The mixing system is characterised by the post-nonlinear structure and concurrently the number of sensors is less than the number of sources. The proposed algorithm utilises the generalised Gaussian distribution to model the prior probability distribution of the source signals and the mixing variables. A novel iterative technique based on alternate optimisation within the Bayesian framework has been developed for estimating the source signals, mixing matrix and the nonlinear distortion. It is shown that through formal Bayesian derivation, the update of the mixing matrix can be decomposed into two separate constituents given by linear and nonlinear parts. Furthermore, the post-nonlinear distortion functions in the mixing model are approximated by a set of polynomials and the coefficients are found by solving a least square error problem. Simulations have been carried out to verify the effectiveness in separating signals under nonlinear and underdetermined conditions. An average margin of 130% improvement has been obtained when compared with the existing linear algorithm.
Keywords
ChemistryComputer ScienceEngineering
Proceedings of the IEEEBlind signal separation: statistical principles
1,852 Citations1998J.-F. Cardoso
The objectives of this paper are to review some of the approaches that have been developed to address blind signal separation and independent component analysis, to illustrate how they stem from basic principles, and to show how they relate to each other.
IEEE Transactions on Signal ProcessingSparse Bayesian Learning for Basis Selection
1,528 Citations2004David Wipf, Bhaskar D. Rao
This paper adapts SBL to the signal processing problem of basis selection from overcomplete dictionaries, proving several results about the SBL cost function that elucidate its general behavior and providing solid theoretical justification for this application.
Proceedings of the National Academy of SciencesBlind separation of auditory event-related brain responses into independent components
1,207 Citations1997Scott Makeig, Tzyy‐Ping Jung +3 more
This paper reports the application of a method based on information theory that decomposes one or more ERPs recorded at multiple scalp sensors into a sum of components with fixed scalp distributions and sparsely activated, maximally independent time courses.
Neural ComputationLearning Overcomplete Representations
1,142 Citations2000Michael S. Lewicki, Terrence J. Sejnowski
It is shown that overcomplete bases can yield a better approximation of the underlying statistical distribution of the data and can thus lead to greater coding efficiency and provide a method for Bayesian reconstruction of signals in the presence of noise and for blind source separation when there are more sources than mixtures.
IEEE Transactions on Signal ProcessingAn affine scaling methodology for best basis selection
523 Citations1999Bhaskar D. Rao, Kenneth Kreutz-Delgado
A methodology is developed to derive algorithms for optimal basis selection by minimizing diversity measures proposed by Wickerhauser (1994) and Donoho (1994), which include the p-norm-like (l/sub (p/spl les/1)/) diversity measures and the Gaussian and Shannon entropies.
Proceedings of the IEEEAdaptive blind signal processing-neural network approaches
469 Citations1998Шун-ичи Амари, Andrzej Cichocki
Learning algorithms and underlying basic mathematical ideas are presented for the problem of adaptive blind signal processing, especially instantaneous blind separation and multichannel blind deconvolution/equalization of independent source signals.
IEEE Transactions on Signal ProcessingSource separation in post-nonlinear mixtures
412 Citations1999Anas Abu Taleb, Christian Jutten
It is proved that in the general case, it is not possible to separate the sources without nonlinear distortion, and this work focuses on specific nonlinear mixtures known as post-nonlinear mixture, which are realistic models in many situations and emphasize interesting properties i.e., in such nonlinearmixtures, sources can be estimated with the same indeterminacies as in instantaneous linear mixtures.
IEEE Transactions on Signal ProcessingSubset selection in noise based on diversity measure minimization
321 Citations2003Bhaskar D. Rao, Kjersti Engan +3 more
A Bayesian framework is used to account for noise in the data and a maximum a posteriori (MAP) estimation procedure leads to an iterative procedure which is a regularized version of the focal underdetermined system solver (FOCUSS) algorithm that is superior to the OMP in noisy environments.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Blind source separation by sparse decomposition</title>
203 Citations2000Michael Zibulevsky, Barak A. Pearlmutter
This work exploits the property of the sources to have a sparse representation in a corresponding signal dictionary, which provides faster and more robust computations, when there are an equal number of sources and mixtures.
Cambridge University Press eBooksModern Mathematical Methods for Physicists and Engineers
198 Citations2000C. D. Cantrell
Neural ComputationA Variational Method for Learning Sparse and Overcomplete Representations
194 Citations2001Mark Girolami
An expectation-maximization algorithm for learning sparse and overcomplete data representations is presented, which exploits a variational approximation to a range of heavy-tailed distributions whose limit is the Laplacian.
IEEE Transactions on Neural NetworksNonlinear blind source separation using a radial basis function network
162 Citations2001Ying Tan, Jun Wang +1 more
By virtue of the RBF neural network, this proposed approach takes advantage of high learning convergence rate of weights in the hidden layer and output layer, natural unsupervised learning characteristics, modular structure, and universal approximation capability.
Signal ProcessingInformation–theoretic approach to blind separation of sources in non-linear mixture
153 Citations1998Howard H. Yang, Шун-ичи Амари +1 more
A two-layer perceptron is used as a de-mixing system to separate sources in non-linear mixture to derive the learning equations for the hidden layer.
Computers & Chemical EngineeringEvolution of multivariate statistical process control: application of independent component analysis and external analysis
148 Citations2003Manabu Kano, Shinji Hasebe +2 more
External analysis is proposed to distinguish faults from normal changes in operating conditions and to further improve the monitoring performance, a new MSPC method based on independent component analysis (ICA) is used.
IEE Proceedings - Vision Image and Signal ProcessingSimple mixture model for sparse overcomplete ICA
93 Citations2004Marc Davies, Nikolaos Mitianoudis
An efficient clustering algorithm is derived whose complexity grows linearly with the number of sources and it is shown that it is capable of performing reasonable separation.
Cambridge University Press eBooksBlind source separation by sparse decomposition in a signal dictionary
85 Citations2001Michael Zibulevsky, Barak A. Pearlmutter +2 more
This work suggests a two-stage separation process: a priori selection of a possibly overcomplete signal dictionary in which the sources are assumed to be sparsely representable, followed by unmixing the sources by exploiting the their sparse representability.
Signal ProcessingPhoneme recognition using ICA-based feature extraction and transformation
84 Citations2004Oh‐Wook Kwon, Te-Won Lee
A new scheme is proposed that shows how the phase sensitivity can be removed by using an analytical description of the ICA-adapted basis functions via the Hilbert transform, and since the basis functions are not shift invariant, is extended to include a frequency-based ICA stage that removes redundant time shift information.
Learning Sparse Codes with a Mixture-of-Gaussians Prior
83 Citations1999Bruno A. Olshausen, K. Jarrod Millman
This work describes a method for learning an overcomplete set of basis functions for the purpose of modeling sparse structure in images and shows that when the prior is in such a form, there exist efficient methods for learning the basis functions as well as the parameters of the prior.
IEEE Transactions on Signal ProcessingPerformance Analysis of Minimum&lt;tex&gt;$ell_1$&lt;/tex&gt;-Norm Solutions for Underdetermined Source Separation
81 Citations2004Ichigaku Takigawa, Mineichi Kudo +1 more
Results of the analysis of the performance of minimum /spl lscr//sub 1/-norm solutions in underdetermined blind source separation, that is, separation of n sources from m(<n) linearly mixed observations, are presented.
Signal ProcessingThree easy ways for separating nonlinear mixtures?
78 Citations2003Christian Jutten, Massoud Babaie‐Zadeh +1 more
This paper mainly discusses three different ways for regularizing the solutions of the nonlinear Blind Source Separation BSS and independent component analysis (ICA) problems, that have been recently explored.
IEEE Transactions on Neural NetworksNonlinear blind source separation using kernels
70 Citations2003Dominique Martinez, Austin M. Bray
A new method is derived for solving nonlinear blind source separation problems by exploiting second-order statistics in a kernel induced feature space using the kernel trick originally applied in support vector machines (SVMs).
IEEE Transactions on Speech and Audio ProcessingEstimation of handset nonlinearity with application to speaker recognition
55 Citations2000Thomas F. Quatieri, D.A. Reynolds +1 more
A method is described for estimating telephone handset nonlinearity by matching the spectral magnitude of the distorted signal to the output of a nonlinear channel model, driven by an undistorted reference, allowing the model to directly match unwanted speech formants that arise over nonlinear channels and that are a potential source of degradation in speaker and speech recognition algorithms.
NeurocomputingBlind signal separation and independent component analysis
41 Citations2002S. Amari, Aapo Hyvärinen +3 more
This special issue on ICA and BSS is a timely publication covering important recent 0ndings in ICA theory as well as new applications of ICA in data analysis.
Loudspeaker nonlinearities-analysis and compensation
32 Citations2003Walter A. Frank, R. Reger +1 more
The concept of linearization, the restrictions, and the implementation on a digital signal processing (DSP) system are elucidated and measurements of the loudspeaker output signal with and without compensation are presented.
IEE Proceedings - Vision Image and Signal ProcessingGeneral multilayer perceptron demixer scheme for nonlinear blind signal separation
25 Citations2002Wai Lok Woo, S. Sali
A new technique is presented for instantaneous blind signal separation from nonlinear mixtures using a general neural network based demixer scheme and the superiority and the generality of the new technique compared with existing methods are illustrated.
AIP conference proceedingsNonlinear approaches to Independent Component Analysis
23 Citations2000Te-Won Lee
Two approaches are presented to tackle the nonlinear mixing case, and nonlinear ICA solutions are summarized for overcomplete representation as well as additive noise problems.
IEE Proceedings - Vision Image and Signal ProcessingRegularised nonlinear blind signal separation using sparsely connected network
17 Citations2005Wai Lok Woo, S.S. Dlay
A nonlinear approach based on the Tikhonov regularised cost function is presented for blind signal separation of nonlinear mixtures and it is shown that this approach can be jointly used to extract independent components while constraining the overall perceptron network to be as sparse as possible.
IEE Proceedings - Vision Image and Signal ProcessingNonlinear blind signal separation with intelligent controlled learning
8 Citations2005L.C. Khor, Wai Lok Woo +1 more
A new nonlinear blind source separation algorithm with hybridisation of fuzzy logic based learning rate control and simulated annealing to improve the global solution search is proposed.
A FOCUSS-based algorithm for nonlinear overcomplete Independent Component Analysis
3 Citations2004Wei Chen, Wai Lok Woo +1 more
A new neural network approach is proposed to solve the blind signal separation problem under both nonlinear and overcomplete conditions and the corresponding parameter learning algorithm for the proposed neural network is presented through formal derivation.