Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Hyvärinen, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Hyvärinen, A.
(Neural Computation. 1999;11:1739-1768.)
© 1999 The MIT Press


Letter

Sparse Code Shrinkage: Denoising of Nongaussian Data by Maximum Likelihood Estimation

Aapo Hyvärinen

Helsinki University of Technology, Laboratory of Computer and Information Science, FIN-02015 HUT, Finland

Sparse coding is a method for finding a representation of data in which each of the components of the representation is only rarely significantly active. Such a representation is closely related to redundancy reduction and independent component analysis, and has some neurophysiological plausibility. In this article, we show how sparse coding can be used for denoising. Using maximum likelihood estimation of nongaussian variables corrupted by gaussian noise, we show how to apply a soft-thresholding (shrinkage) operator on the components of sparse coding so as to reduce noise. Our method is closely related to the method of wavelet shrinkage, but it has the important benefit over wavelet methods that there presentation is determined solely by the statistical properties of the data. The wavelet representation, on the other hand, relies heavily on certain mathematical properties (like self-similarity) that may be only weakly related to the properties of natural data.




This article has been cited by other articles:


Home page
Neural Comput.Home page
A. Hyvarinen, P. O. Hoyer, and M. Inki
Topographic Independent Component Analysis
Neural Comput., July 1, 2001; 13(7): 1527 - 1558.
[Abstract] [Full Text]


Home page
Neural Comput.Home page
A. Hyvärinen
Complexity Pursuit: Separating Interesting Components from Time Series
Neural Comput., April 1, 2001; 13(4): 883 - 898.
[Abstract] [Full Text]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 1999 by The MIT Press.