Separating a Real-Life Nonlinear Image Mixture

Almeida, Luis B. (2005) Separating a Real-Life Nonlinear Image Mixture. [Preprint]

Full text available as:



When acquiring an image of a paper document, the image printed on the back page sometimes shows through. The mixture of the front- and back-page images thus obtained is markedly nonlinear, and thus constitutes a good real-life test case for nonlinear blind source separation. This paper addresses a difficult version of this problem, corresponding to the use of "onion skin" paper, which results in a relatively strong nonlinearity of the mixture, which becomes close to singular in the lighter regions of the images. The separation is achieved through the MISEP technique, which is an extension of the well known INFOMAX method. The separation results are assessed with objective quality measures. They show an improvement over the results obtained with linear separation, but have room for further improvement.

Item Type:Preprint
Keywords:independent component analysis, source separation, nonlinear, image separation, document processing
Subjects:Computer Science > Statistical Models
Computer Science > Machine Learning
Computer Science > Neural Nets
Computer Science > Artificial Intelligence
ID Code:4360
Deposited By: Almeida, Prof. Luis B.
Deposited On:20 May 2005
Last Modified:11 Mar 2011 08:56

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

L.B. Almeida. Faster training in nonlinear ICA using MISEP. In Proc. Int. Worksh. Independent Component Analysis and Blind Signal Separation, pages 113–118, Nara, Japan, 2003a. URL

L.B. Almeida. MISEP – Linear and nonlinear ICA based on mutual information. Journal of Machine Learning Research, 4:1297–1318, 2003b. URL

L.B. Almeida and M. Faria. Separating a real-life nonlinear mixture of images. In Carlos G. Puntonet and Alberto Prieto, editors, Independent Component Analysis and Blind Signal Separation (Proc. ICA’2004), number 3195 in Lecture Notes in Computer Science, pages 729–736, Granada, Spain, 2004. Springer-Verlag. URL

S. Amari, A. Cichocki, and H. H. Yang. A new learning algorithm for blind signal separation. In David Touretzky, Michael Mozer, and Mark Hasselmo, editors, Advances in Neural Information Processing Systems 8, pages 757–763. MIT Press, 1996

A. Bell and T. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7:1129–1159, 1995

G. Burel. Blind separation of sources: A nonlinear neural algorithm. Neural Networks, 5(6):937–947, 1992

P. Comon. Independent component analysis – a new concept? Signal Processing, 36:287–314, 1994

G. Darmois. Analyse generale des liaisons stochastiques. Rev. Inst. Internat. Stat., 21:2–8, 1953

G. Deco and W. Brauer. Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures. Neural Networks, 8:525–535, 1995

M. Haritopoulos, H. Yin, and N. Allinson. Image denoising using SOM-based nonlinear independent component analysis. Neural Networks, 15(8–9):1085–1098, 2002

S. Harmeling, A. Ziehe, M. Kawanabed, and K.-R. M¨uller. Kernel-based nonlinear blind source separation. Neural Computation, 15:1089–1124, 2003. URL on ktdsep.pdf

A. Hyvarinen and E. Oja. Independent component analysis: Algorithms and applications. Neural Networks, 13(4-5):411–430, 2000. URL tutorialweb/

A. Hyvarinen and P. Pajunen. Nonlinear independent component analysis: Existence and uniqueness results. Neural Networks, 12(3):429–439, 1999

C. Jutten and J. Karhunen. Advances in blind source separation (BSS) and independent component analysis (ICA) for nonlinear mixtures. International Journal of Neural Systems, 14(5):267–292, 2004. URL

A. Kraskov, H. Stogbauer, and P. Grassberger. Estimating mutual information. Physical Review E, 69:066138, 2004. URL

H. Lappalainen and A. Honkela. Bayesian nonlinear independent component analysis by multi-layer perceptrons. In M. Girolami, editor, Advances in Independent Component Analysis, pages 93–121. Springer-Verlag, 2000

S.-I. Lee and S. Batzoglou. Application of independent component analysis to microarrays. Genome Biology, 4(11):R76, 2003. ISSN 1465-6906. URL

J.B. Maintz. A survey of medical image registration. Medical Image Analysis, 2(1):1–36, 1998. URL

G.C. Marques and L.B. Almeida. Separation of nonlinear mixtures using pattern repulsion. In J. F. Cardoso, C. Jutten, and P. Loubaton, editors, Proc. First Int. Worksh. Independent Component Analysis and Signal Separation, pages 277–282, Aussois, France, 1999

F. Palmieri, D. Mattera, and A. Budillon. Multi-layer independent component analysis (MLICA). In J. F. Cardoso, C. Jutten, and P. Loubaton, editors, Proc. First Int. Worksh. Independent Component Analysis and Signal Separation, pages 93–97, Aussois, France, 1999

B. Pearlmutter and L. Parra. Maximum likelihood blind source separation: A context-sensitive generalization of ica. In Advances in Neural Information Processing Systems, pages 613–619. MIT press, 1997. URL (preprint).

J. Schmidhuber. Learning factorial codes by predictability minimization. Neural Computation, 4(6):863–879, 1992

A. Taleb and C. Jutten. Source separation in post-nonlinear mixtures. IEEE Trans. Sig. Proc., 47:2807–2820, 1999

F.J. Theis, C.G. Puntonet, and E.W. Lang. Nonlinear geometric ICA. In Proc. Int. Worksh. Independent Component Analysis and Blind Signal Separation, pages 275–280, Nara, Japan, 2003. URL ICA03.pdf

H. Valpola and J. Karhunen. An unsupervised ensemble learning method for nonlinear dynamic state-space models. Neural Computation, 14(11):2647–2692, 2002. URL


Repository Staff Only: item control page