| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
Letter |
Department of Computer Science and Engineering, University of Washington, Seattle, WA 98195-2350, U.S.A.
Howard Hughes Medical Institute, The Salk Institute for Biological Studies, La Jolla, CA 92037, U.S.A., and Department of Biology, University of California at San Diego, La Jolla, CA 92037, U.S.A.
A spike-timing-dependent Hebbian mechanism governs the plasticity of recurrent excitatory synapses in the neocortex: synapses that are activated a few milliseconds before a postsynaptic spike are potentiated, while those that are activated a few milliseconds after are depressed. We show that such a mechanism can implement a form of temporal difference learning for prediction of input sequences. Using a biophysical model of a cortical neuron, we show that a temporal difference rule used in conjunction with dendritic backpropagating action potentials reproduces the temporally asymmetric window of Hebbian plasticity observed physiologically. Furthermore, the size and shape of the window vary with the distance of the synapse from the soma. Using a simple example, we show how a spike-timing-based temporal difference learning rule can allow a network of neocortical neurons to predict an input a few milliseconds before the input's expected arrival.
This article has been cited by other articles:
|
|
 |
|
  P. J. Sjostrom, E. A. Rancz, A. Roth, and M. Hausser Dendritic Excitability and Synaptic Plasticity Physiol Rev, April 1, 2008; 88(2): 769 - 840. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Hosaka, O. Araki, and T. Ikeguchi STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns Neural Comput., February 1, 2008; 20(2): 415 - 435. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. A. Farries and A. L. Fairhall Reinforcement Learning With Modulated Spike Timing Dependent Synaptic Plasticity J Neurophysiol, December 1, 2007; 98(6): 3648 - 3665. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Brader, W. Senn, and S. Fusi Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics Neural Comput., November 1, 2007; 19(11): 2881 - 2912. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Baras and R. Meir Reinforcement Learning, Spike-Time-Dependent Plasticity, and the BCM Rule. Neural Comput., August 1, 2007; 19(8): 2245 - 2279. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. V. Florian Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity Neural Comput., June 1, 2007; 19(6): 1468 - 1502. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. M. Bohte and M. C. Mozer Reducing the variability of neural responses: a computational theory of spike-timing-dependent plasticity. Neural Comput., February 1, 2007; 19(2): 371 - 403. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. A. Mossbridge, M. B. Fitzgerald, E. S. O'Connor, and B. A. Wright Perceptual-Learning Evidence for Separate Processing of Asynchrony and Order Tasks J. Neurosci., December 6, 2006; 26(49): 12708 - 12716. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J.-P. Pfister and W. Gerstner Triplets of spikes in a model of spike timing-dependent plasticity. J. Neurosci., September 20, 2006; 26(38): 9673 - 9682. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J.-P. Pfister, T. Toyoizumi, D. Barber, and W. Gerstner Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning. Neural Comput., June 1, 2006; 18(6): 1318 - 1348. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. C. Froemke, I. A. Tsay, M. Raad, J. D. Long, and Y. Dan Contribution of Individual Spikes in Burst-Induced Long-Term Synaptic Modification J Neurophysiol, March 1, 2006; 95(3): 1620 - 1629. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. A. Koene and M. E. Hasselmo An Integrate-and-fire Model of Prefrontal Cortex Neuronal Activity during Performance of Goal-directed Decision Making Cereb Cortex, December 1, 2005; 15(12): 1964 - 1981. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network J. Neurosci., June 29, 2005; 25(26): 6235 - 6242. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. Worgotter and B. Porr Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms Neural Comput., February 1, 2005; 17(2): 245 - 319. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C.-H. Mo, M. Gu, and C. Koch A Learning Rule for Local Synaptic Interactions Between Excitation and Shunting Inhibition Neural Comput., December 1, 2004; 16(12): 2507 - 2532. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. N. Burkitt, H. Meffin, and D. B. Grayden Spike-Timing-Dependent Plasticity: The Relationship to Rate-Based Learning for Models with Weight Dynamics Determined by a Stable Fixed Point Neural Comput., May 1, 2004; 16(5): 885 - 940. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y.-X. Fu, Y. Shen, H. Gao, and Y. Dan Asymmetry in Visual Cortical Circuits Underlying Motion-Induced Perceptual Mislocalization J. Neurosci., March 3, 2004; 24(9): 2165 - 2171. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Saudargiene, B. Porr, and F. Worgotter How the Shape of Pre- and Postsynaptic Signals Can Influence STDP: A Biophysical Model Neural Comput., March 1, 2004; 16(3): 595 - 625. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Masuda and K. Aihara Self-Organizing Dual Coding Based on Spike-Time-Dependent Plasticity Neural Comput., March 1, 2004; 16(3): 627 - 663. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. J. Hopfield and C. D. Brody Learning rules and network repair in spike-timing-based computation networks PNAS, January 6, 2004; 101(1): 337 - 342. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Nowotny, V. P. Zhigulin, A. I. Selverston, H. D. I. Abarbanel, and M. I. Rabinovich Enhancement of Synchronization in a Hybrid Neural Circuit by Spike-Timing Dependent Plasticity J. Neurosci., October 29, 2003; 23(30): 9776 - 9785. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Gutig, R. Aharonov, S. Rotter, and H. Sompolinsky Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity J. Neurosci., May 1, 2003; 23(9): 3697 - 3714. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. Porr and F. Worgotter Isotropic Sequence Order Learning Neural Comput., April 1, 2003; 15(4): 831 - 864. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Scarpetta, L. Zhaoping, and J. Hertz Hebbian Imprinting and Retrieval in Oscillatory Neural Networks Neural Comput., October 1, 2002; 14(10): 2371 - 2396. [Abstract] [Full Text]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |
