|
|
||||||||
Letter |
Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England
Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England
VisNet2 is a model to investigate some aspects of invariant visual object recognition in the primate visual system. It is a four-layer feedforward network with convergence to each part of a layer from a small region of the preceding layer, with competition between the neurons within a layer and with a trace learning rule to help it learn transform invariance. The trace rule is a modified Hebbian rule, which modifies synaptic weights according to both the current firing rates and the firing rates to recently seen stimuli. This enables neurons to learn to respond similarly to the gradually transforming inputs it receives, which over the short term are likely to be about the same object, given the statistics of normal visual inputs. First, we introduce for VisNet2 both single-neuron and multiple-neuron information-theoretic measures of its ability to respond to transformed stimuli. Second, using these measures, we show that quantitatively resetting the trace between stimuli is not necessary for good performance. Third, it is shown that the sigmoid activation functions used in VisNet2, which allow the sparseness of the representation to be controlled, allow good performance when using sparse distributed representations. Fourth, it is shown that VisNet2 operates well with medium-range lateral inhibition with a radius in the same order of size as the region of the preceding layer from which neurons receive inputs. Fifth, in an investigation of different learning rules for learning transform invariance, it is shown that VisNet2 operates better with a trace rule that incorporates in the trace only activity from the preceding presentations of a given stimulus, with no contribution to the trace from the current presentation, and that this is related to temporal difference learning.
This article has been cited by other articles:
![]() |
J. F. Murray and K. Kreutz-Delgado Visual recognition and inference using dynamic overcomplete sparse learning. Neural Comput., September 1, 2007; 19(9): 2301 - 2352. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Verguts How to compare two quantities? A computational model of flutter discrimination. J. Cogn. Neurosci., March 1, 2007; 19(3): 409 - 419. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. T. Rolls and S. M. Stringer Invariant Global Motion Recognition in the Dorsal Visual System: A Unifying Theory Neural Comput., January 1, 2006; 19(1): 139 - 169. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Wersing and E. Korner Learning Optimized Features for Hierarchical Models of Invariant Object Recognition Neural Comput., July 1, 2003; 15(7): 1559 - 1588. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Stringer and E. T. Rolls Invariant Object Recognition in the Visual System with Novel Views of 3D Objects Neural Comput., November 1, 2002; 14(11): 2585 - 2596. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |