|
|
||||||||
Letter |
Institut de Physiologie, 1700 Fribourg, Switzerland
Institut de Physiologie, 1700 Fribourg, Switzerland
Anticipatory neural activity preceding behaviorally important events has been reported in cortex, striatum, and midbrain dopamine neurons. Whereas dopamine neurons are phasically activated by reward-predictive stimuli, anticipatory activity of cortical and striatal neurons is increased during delay periods before important events. Characteristics of dopamine neuron activity resemble those of the prediction error signal of the temporal difference (TD) model of Pavlovian learning (Sutton & Barto, 1990). This study demonstrates that the prediction signal of the TD model reproduces characteristics of cortical and striatal anticipatory neural activity. This finding suggests that tonic anticipatory activities may reflect prediction signals that are involved in the processing of dopamine neuron activity.
This article has been cited by other articles:
![]() |
P. Praamstra and P. Pope Slow Brain Potential and Oscillatory EEG Manifestations of Impaired Temporal Preparation in Parkinson's Disease J Neurophysiol, November 1, 2007; 98(5): 2848 - 2857. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Porr and F. Worgotter Learning with "Relevance": Using a Third Factor to Stabilize Hebbian Learning Neural Comput., October 1, 2007; 19(10): 2694 - 2719. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. M. Izhikevich Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling Cereb Cortex, October 1, 2007; 17(10): 2443 - 2452. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Porr and F. Worgotter Strongly improved stability and faster convergence of temporal sequence learning by using input correlations only. Neural Comput., June 1, 2006; 18(6): 1380 - 1412. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Praamstra, D. Kourtis, H. Fei Kwok, and R. Oostenveld Neurophysiology of implicit timing in serial choice reaction-time performance. J. Neurosci., May 17, 2006; 26(20): 5448 - 5455. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. R. Roelfsema and A. van Ooyen Attention-Gated Reinforcement Learning of Internal Representations for Classification Neural Comput., October 1, 2005; 17(10): 2176 - 2214. [Abstract] [Full Text] [PDF] |
||||
![]() |
W.-X. Pan, R. Schmidt, J. R. Wickens, and B. I. Hyland Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network J. Neurosci., June 29, 2005; 25(26): 6235 - 6242. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Khamassi, L. Lacheze, B. Girard, A. Berthoz, and A. Guillot Actor-Critic Models of Reinforcement Learning in the Basal Ganglia: From Natural to Artificial Rats Adaptive Behavior, June 1, 2005; 13(2): 131 - 148. [Abstract] [PDF] |
||||
![]() |
F. Worgotter and B. Porr Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms Neural Comput., February 1, 2005; 17(2): 245 - 319. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Kitano and T. Fukai Temporal Characteristics of the Predictive Synchronous Firing Modeled by Spike-Timing-Dependent Plasticity Learn. Mem., May 1, 2004; 11(3): 267 - 276. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Porr and F. Worgotter Isotropic Sequence Order Learning Neural Comput., April 1, 2003; 15(4): 831 - 864. [Abstract] [Full Text] [PDF] |
||||
![]() |
J.-C. Dreher, E. Guigon, and Y. Burnod A Model of Prefrontal Cortex Dopaminergic Modulation during the Delayed Alternation Task J. Cogn. Neurosci., August 1, 2002; 14(6): 853 - 865. [Abstract] [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |