HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Creutzig, F. Articles by Sprekeler, H. Search for Related Content PubMed Articles by Creutzig, F. Articles by Sprekeler, H.

Predictive Coding and the Slowness Principle: An Information-Theoretic Approach

felix{at}creutzig.de Institute for Theoretical Biology, Humboldt-Universität zu Berlin, 10115 Berlin, Germany, and Bernstein Center for Computational Neuroscience, 10115 Berlin, Germany

Henning Sprekeler

h.sprekeler{at}biologie.hu-berlin.de Institute for Theoretical Biology, Humboldt-Universität zu Berlin, 10115 Berlin, Germany, and Bernstein Center for Computational Neuroscience, 10115 Berlin, Germany

Understanding the guiding principles of sensory coding strategies is a main goal in computational neuroscience. Among others, the principles of predictive coding and slowness appear to capture aspects of sensory processing. Predictive coding postulates that sensory systems are adapted to the structure of their input signals such that information about future inputs is encoded. Slow feature analysis (SFA) is a method for extracting slowly varying components from quickly varying input signals, thereby learning temporally invariant features. Here, we use the information bottleneck method to state an information-theoretic objective function for temporally local predictive coding. We then show that the linear case of SFA can be interpreted as a variant of predictive coding that maximizes the mutual information between the current output of the system and the input signal in the next time step. This demonstrates that the slowness principle and predictive coding are intimately related.