Cogprints

Faster Training in Nonlinear ICA using MISEP

Almeida, Luis B. (2003) Faster Training in Nonlinear ICA using MISEP. [Conference Paper]

This is the latest version of this eprint.

Full text available as:

[img]
Preview
 PDF
164Kb

Abstract

MISEP has been proposed as a generalization of the INFOMAX method in two directions: (1) handling of nonlinear mixtures, and (2) learning the nonlinearities to be used at the outputs, making the method suitable to the separation of components with a wide range of statistical distributions. In all implementations up to now, MISEP had used multilayer perceptrons (MLPs) to perform the nonlinear ICA operation. Use of MLPs sometimes leads to a relatively slow training. This has been attributed, at least in part, to the non-local character of the MLP's units. This paper investigates the possibility of using a network of radial basis function (RBF) units for performing the nonlinear ICA operation. It shows that the local character of the RBF network's units allows a significant speedup in the training of the system. The paper gives a brief introduction to the basics of the MISEP method, and presents experimental results showing the speed advantage of using an RBF-based network to perform the ICA operation.

Item Type:Conference Paper
Keywords:Independent components analysis, nonlinear, blind source separation, ICA, BSS
Subjects:Computer Science > Statistical Models
Computer Science > Machine Learning
Computer Science > Neural Nets
ID Code:2854
Deposited By: Almeida, Prof. Luis B.
Deposited On:30 Mar 2003
Last Modified:11 Mar 2011 08:55

Available Versions of this Item

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

G. Burel, ``Blind separation of sources: A nonlinear neural algorithm,'' Neural Networks, vol. 5, no. 6, pp. 937--947, 1992.

G. Deco and W. Brauer, ``Nonlinear higher­order statistical decorrelation by volume­conserving neural architectures,'' Neural Networks, vol. 8, pp. 525--535, 1995.

G. C. Marques and L. B. Almeida, ``An objective function for independence,'' in Proc. International Conference on Neural Networks, Washington DC, 1996, pp. 453--457.

G. C. Marques and L. B. Almeida, ``Separation of nonlinear mixtures using pattern repulsion,'' in Proc. First Int. Worksh. Independent Component Analysis and Signal Separation, J. F. Cardoso, C. Jutten, and P. Loubaton, Eds., Aussois, France, 1999, pp. 277--282.

H. Valpola, ``Nonlinear independent component analysis using ensemble learning: Theory,'' in Proc. Second Int. Worksh. Independent Component Analysis and Blind Signal Separation, Helsinki, Finland, 2000, pp. 251--256.

L. B. Almeida, ``Linear and nonlinear ICA based on mutual information,'' in Proc. Symp. 2000 on Adapt. Sys. for Sig. Proc., Commun. and Control, Lake Louise, Alberta, Canada, 2000.

L. B. Almeida, ``Simultaneous MI­based estimation of independent components and of their distributions,'' in Proc. Second Int. Worksh. Independent Component Analysis and Blind Signal Separation, Helsinki, Finland, 2000, pp. 169--174.

L. B. Almeida, ``MISEP ­ linear and nonlinear ICA based on mutual information,'' Journal of Machine Learning Research, submitted for publication; available at http://neural.inesc­id.pt/lba/papers/jmlr03.pdf.

A. Bell and T. Sejnowski, ``An information­maximization approach to blind separation and blind deconvolution,'' Neural Computation, vol. 7, pp. 1129--1159, 1995.

L. B. Almeida, ``Multilayer perceptrons,'' in Handbook of Neural Computation, E. Fiesler and R. Beale, Eds. Institute of Physics, 1997, Oxford University Press, available at http://www.iop.org/Books/CIL/HNC/pdf/NCC1\_2.PDF.

J. Moody and C. Darken, ``Learning with localized receptive fields,'' in Proc. 1988 Connectionist Summer School, D. Touretzky, G. Hinton, and T. Sejnowski, Eds. 1988, pp. 133--143, Morgan Kaufmann, San Mateo, CA.

Metadata

Repository Staff Only: item control page

Cogprints is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.