Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Suri, R. E.
Right arrow Articles by Schultz, W.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Suri, R. E.
Right arrow Articles by Schultz, W.
(Neural Computation. 2001;13:841-862.)
© 2001 The MIT Press


Letter

Temporal Difference Model Reproduces Anticipatory Neural Activity

Roland E. Suri

Institut de Physiologie, 1700 Fribourg, Switzerland

Wolfram Schultz

Institut de Physiologie, 1700 Fribourg, Switzerland

Anticipatory neural activity preceding behaviorally important events has been reported in cortex, striatum, and midbrain dopamine neurons. Whereas dopamine neurons are phasically activated by reward-predictive stimuli, anticipatory activity of cortical and striatal neurons is increased during delay periods before important events. Characteristics of dopamine neuron activity resemble those of the prediction error signal of the temporal difference (TD) model of Pavlovian learning (Sutton & Barto, 1990). This study demonstrates that the prediction signal of the TD model reproduces characteristics of cortical and striatal anticipatory neural activity. This finding suggests that tonic anticipatory activities may reflect prediction signals that are involved in the processing of dopamine neuron activity.




This article has been cited by other articles:


Home page
J. Neurophysiol.Home page
P. Praamstra and P. Pope
Slow Brain Potential and Oscillatory EEG Manifestations of Impaired Temporal Preparation in Parkinson's Disease
J Neurophysiol, November 1, 2007; 98(5): 2848 - 2857.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
B. Porr and F. Worgotter
Learning with "Relevance": Using a Third Factor to Stabilize Hebbian Learning
Neural Comput., October 1, 2007; 19(10): 2694 - 2719.
[Abstract] [Full Text] [PDF]


Home page
Cereb CortexHome page
E. M. Izhikevich
Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Cereb Cortex, October 1, 2007; 17(10): 2443 - 2452.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
B. Porr and F. Worgotter
Strongly improved stability and faster convergence of temporal sequence learning by using input correlations only.
Neural Comput., June 1, 2006; 18(6): 1380 - 1412.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
P. Praamstra, D. Kourtis, H. Fei Kwok, and R. Oostenveld
Neurophysiology of implicit timing in serial choice reaction-time performance.
J. Neurosci., May 17, 2006; 26(20): 5448 - 5455.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
P. R. Roelfsema and A. van Ooyen
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Neural Comput., October 1, 2005; 17(10): 2176 - 2214.
[Abstract] [Full Text] [PDF]


Home page
J. Neurosci.Home page
W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland
Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network
J. Neurosci., June 29, 2005; 25(26): 6235 - 6242.
[Abstract] [Full Text] [PDF]


Home page
Adaptive BehaviorHome page
M. Khamassi, L. Lacheze, B. Girard, A. Berthoz, and A. Guillot
Actor-Critic Models of Reinforcement Learning in the Basal Ganglia: From Natural to Artificial Rats
Adaptive Behavior, June 1, 2005; 13(2): 131 - 148.
[Abstract] [PDF]


Home page
Neural Comput.Home page
F. Worgotter and B. Porr
Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms
Neural Comput., February 1, 2005; 17(2): 245 - 319.
[Abstract] [Full Text] [PDF]


Home page
Learn. Mem.Home page
K. Kitano and T. Fukai
Temporal Characteristics of the Predictive Synchronous Firing Modeled by Spike-Timing-Dependent Plasticity
Learn. Mem., May 1, 2004; 11(3): 267 - 276.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
B. Porr and F. Worgotter
Isotropic Sequence Order Learning
Neural Comput., April 1, 2003; 15(4): 831 - 864.
[Abstract] [Full Text] [PDF]


Home page
J. Cogn. Neurosci.Home page
J.-C. Dreher, E. Guigon, and Y. Burnod
A Model of Prefrontal Cortex Dopaminergic Modulation during the Delayed Alternation Task
J. Cogn. Neurosci., August 1, 2002; 14(6): 853 - 865.
[Abstract] [Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2001 by The MIT Press.