Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Rolls, E. T.
Right arrow Articles by Milward, T.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Rolls, E. T.
Right arrow Articles by Milward, T.
(Neural Computation. 2000;12:2547-2572.)
© 2000 The MIT Press


Letter

A Model of Invariant Object Recognition in the Visual System: Learning Rules, Activation Functions, Lateral Inhibition, and Information-Based Performance Measures

Edmund T. Rolls

Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England

T. Milward

Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England

VisNet2 is a model to investigate some aspects of invariant visual object recognition in the primate visual system. It is a four-layer feedforward network with convergence to each part of a layer from a small region of the preceding layer, with competition between the neurons within a layer and with a trace learning rule to help it learn transform invariance. The trace rule is a modified Hebbian rule, which modifies synaptic weights according to both the current firing rates and the firing rates to recently seen stimuli. This enables neurons to learn to respond similarly to the gradually transforming inputs it receives, which over the short term are likely to be about the same object, given the statistics of normal visual inputs. First, we introduce for VisNet2 both single-neuron and multiple-neuron information-theoretic measures of its ability to respond to transformed stimuli. Second, using these measures, we show that quantitatively resetting the trace between stimuli is not necessary for good performance. Third, it is shown that the sigmoid activation functions used in VisNet2, which allow the sparseness of the representation to be controlled, allow good performance when using sparse distributed representations. Fourth, it is shown that VisNet2 operates well with medium-range lateral inhibition with a radius in the same order of size as the region of the preceding layer from which neurons receive inputs. Fifth, in an investigation of different learning rules for learning transform invariance, it is shown that VisNet2 operates better with a trace rule that incorporates in the trace only activity from the preceding presentations of a given stimulus, with no contribution to the trace from the current presentation, and that this is related to temporal difference learning.




This article has been cited by other articles:


Home page
Neural Comput.Home page
J. F. Murray and K. Kreutz-Delgado
Visual recognition and inference using dynamic overcomplete sparse learning.
Neural Comput., September 1, 2007; 19(9): 2301 - 2352.
[Abstract] [Full Text] [PDF]


Home page
J. Cogn. Neurosci.Home page
T. Verguts
How to compare two quantities? A computational model of flutter discrimination.
J. Cogn. Neurosci., March 1, 2007; 19(3): 409 - 419.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
E. T. Rolls and S. M. Stringer
Invariant Global Motion Recognition in the Dorsal Visual System: A Unifying Theory
Neural Comput., January 1, 2006; 19(1): 139 - 169.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
H. Wersing and E. Korner
Learning Optimized Features for Hierarchical Models of Invariant Object Recognition
Neural Comput., July 1, 2003; 15(7): 1559 - 1588.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
S. M. Stringer and E. T. Rolls
Invariant Object Recognition in the Visual System with Novel Views of 3D Objects
Neural Comput., November 1, 2002; 14(11): 2585 - 2596.
[Abstract] [Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2000 by The MIT Press.