| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
INFN Sezione RM1, University of Rome "La Sapienza," 00185, Roma, Italy
Physics Department, University of Pisa, 56100 Pisa, Italy
INFN, Sezione RM2, University of Rome "Tor Vergata," 00133, Roma, Italy
Physics Department, University of Rome "La Sapienza," 00185, Roma, Italy
INFN Sezione RM1, University of Rome "La Sapienza," 00185, Roma, Italy, and Racah Institute of Physics, Hebrew University, Jerusalem
We present a model for spike-driven dynamics of a plastic synapse, suited for aVLSI implementation. The synaptic device behaves as a capacitor on short timescales and preserves the memory of two stable states (efficacies) on long timescales. The transitions (LTP/LTD) are stochastic because both the number and the distribution of neural spikes in any finite (stimulation) interval fluctuate, even at fixed pre- and postsynaptic spike rates. The dynamics of the single synapse is studied analytically by extending the solution to a classic problem in queuing theory (Takàcs process). The model of the synapse is implemented in aVLSI and consists of only 18 transistors. It is also directly simulated. The simulations indicate that LTP/LTD probabilities versus rates are robust to fluctuations of the electronic parameters in a wide range of rates. The solutions for these probabilities are in very good agreement with both the simulations and measurements. Moreover, the probabilities are readily manipulable by variations of the chip's parameters, even in ranges where they are very small. The tests of the electronic device cover the range from spontaneous activity (3–4 Hz) to stimulus-driven rates (50 Hz). Low transition probabilities can be maintained in all ranges, even though the intrinsic time constants of the device are short (
100 ms).
Synaptic transitions are triggered by elevated presynaptic rates: for low presynaptic rates, there are essentially no transitions. The synaptic device can preserve its memory for years in the absence of stimulation. Stochasticity of learning is a result of the variability of interspike intervals; noise is a feature of the distributed dynamics of the network. The fact that the synapse is binary on long timescales solves the stability problem of synaptic efficacies in the absence of stimulation. Yet stochastic learning theory ensures that it does not affect the collective behavior of the network, if the transition probabilities are low and LTP is balanced against LTD.
This article has been cited by other articles:
|
|
 |
|
  T. Elliott Temporal Dynamics of Rate-Based Synaptic Plasticity Rules in a Stochastic Model of Spike-Timing-Dependent Plasticity Neural Comput., September 1, 2008; 20(9): 2253 - 2307. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Romani, D. J. Amit, and Y. Amit Optimizing One-Shot Learning with Binary Synapses Neural Comput., August 1, 2008; 20(8): 1928 - 1950. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 V. Yakovlev, D. J. Amit, S. Romani, and S. Hochstein Universal Memory Mechanism for Familiarity Recognition and Identification J. Neurosci., January 2, 2008; 28(1): 239 - 248. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Brader, W. Senn, and S. Fusi Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics Neural Comput., November 1, 2007; 19(11): 2881 - 2912. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Bartolozzi and G. Indiveri Synaptic Dynamics in Analog VLSI Neural Comput., October 1, 2007; 19(10): 2581 - 2603. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Toyoizumi, J.-P. Pfister, K. Aihara, and W. Gerstner Optimality Model of Unsupervised Spike-Timing-Dependent Plasticity: Synaptic Memory and Weight Distribution. Neural Comput., March 1, 2007; 19(3): 639 - 671. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Bernacchia and D. J. Amit Impact of spatiotemporally correlated images on the structure of memory PNAS, February 27, 2007; 104(9): 3544 - 3549. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. A. Appleby and T. Elliott Synaptic and Temporal Ensemble Interpretation of Spike-Timing-Dependent Plasticity Neural Comput., November 1, 2005; 17(11): 2316 - 2336. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. Senn and S. Fusi Learning Only When Necessary: Better Memories of Correlated Patterns in Networks with Bounded Synapses Neural Comput., October 1, 2005; 17(10): 2106 - 2138. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. D. Cohen and M. A. Castro-Alamancos Skilled Motor Learning Does Not Enhance Long-Term Depression in the Motor Cortex In Vivo J Neurophysiol, March 1, 2005; 93(3): 1486 - 1497. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Reutimann, V. Yakovlev, S. Fusi, and W. Senn Climbing Neuronal Activity as an Event-Based Cortical Representation of Time J. Neurosci., March 31, 2004; 24(13): 3295 - 3303. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. J. Amit and G. Mongillo Selective Delay Activity in the Cortex: Phenomena and Interpretation Cereb Cortex, November 1, 2003; 13(11): 1139 - 1150. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. J. Amit and G. Mongillo Spike-Driven Synaptic Dynamics Generating Working Memory States Neural Comput., March 1, 2003; 15(3): 565 - 596. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Z. Shouval, M. F. Bear, and L. N Cooper A unified model of NMDA receptor-dependent bidirectional synaptic plasticity PNAS, August 6, 2002; 99(16): 10831 - 10836. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Mattia and P. Del Giudice Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses Neural Comput., October 1, 2000; 12(10): 2305 - 2329. [Abstract] [Full Text]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |
