HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Senn, W. Articles by Fusi, S. Search for Related Content PubMed PubMed Citation Articles by Senn, W. Articles by Fusi, S.

Learning Only When Necessary: Better Memories of Correlated Patterns in Networks with Bounded Synapses

wsenn{at}cns.unibe.ch, Department of Physiology, University of Bern, CH-30 Bern, Switzerland

Stefano Fusi

fusi{at}cns.unibe.ch, Department of Physiology, University of Bern, CH-30 Bern, Switzerland

Learning in a neuronal network is often thought of as a linear superposition of synaptic modifications induced by individual stimuli. However, since biological synapses are naturally bounded, a linear superposition would cause fast forgetting of previously acquired memories. Here we show that this forgetting can be avoided by introducing additional constraints on the synaptic and neural dynamics. We consider Hebbian plasticity of excitatory synapses. A synapse is modified only if the postsynaptic response does not match the desired output. With this learning rule, the original memory performances with unbounded weights are regained, provided that (1) there is some global inhibition, (2) the learning rate is small, and (3) the neurons can discriminate small differences in the total synaptic input (e.g., by making the neuronal threshold small compared to the total postsynaptic input). We prove in the form of a generalized perceptron convergence theorem that under these constraints, a neuron learns to classify any linearly separable set of patterns, including a wide class of highly correlated random patterns. During the learning process, excitation becomes roughly balanced by inhibition, and the neuron classifies the patterns on the basis of small differences around this balance. The fact that synapses saturate has the additional benefit that nonlinearly separable patterns, such as similar patterns with contradicting outputs, eventually generate a subthreshold response, and therefore silence neurons that cannot provide any information.

This article has been cited by other articles:

				J. M. Brader, W. Senn, and S. Fusi Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics Neural Comput., November 1, 2007; 19(11): 2881 - 2912. [Abstract] [Full Text] [PDF]