| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
|
|||||||
|
|||||||||
maass{at}igi.tu-graz.ac.at, Institute for Theoretical Computer Science, Technische Universität Graz; A-8010 Graz, Austria
tnatschl{at}igi.tu-graz.ac.at, Institute for Theoretical Computer Science, Technische Universität Graz; A-8010 Graz, Austria
henry.markram{at}epfl.ch, Brain Mind Institute, Ecole Polytechnique Federale de Lausanne, CH-1015 Lausanne, Switzerland
A key challenge for neural modeling is to explain how a continuous stream of multimodal input from a rapidly changing environment can be processed by stereotypical recurrent circuits of integrate-and-fire neurons in real time. We propose a new computational model for real-time computing on time-varying input that provides an alternative to paradigms based on Turing machines or attractor neural networks. It does not require a task-dependent construction of neural circuits. Instead, it is based on principles of high-dimensional dynamical systems in combination with statistical learning theory and can be implemented on generic evolved or found recurrent circuitry. It is shown that the inherent transient dynamics of the high-dimensional dynamical system formed by a sufficiently large and heterogeneous neural circuit may serve as universal analog fading memory. Readout neurons can learn to extract in real time from the current state of such recurrent neural circuit information about current and past inputs that may be needed for diverse tasks. Stable internal states are not required for giving a stable output, since transient internal states can be transformed by readout neurons into stable target outputs due to the high dimensionality of the dynamical system. Our approach is based on a rigorous computational model, the liquid state machine, that, unlike Turing machines, does not require sequential transitions between well-defined discrete internal states. It is supported, as the Turing machine is, by rigorous mathematical results that predict universal computational power under idealized conditions, but for the biologically more realistic scenario of real-time processing of time-varying inputs. Our approach provides new perspectives for the interpretation of neural coding, the design of experiments and data analysis in neurophysiology, and the solution of problems in robotics and neurotechnology.
This article has been cited by other articles:
|
|
 |
|
  K. Thurley, C. Leibold, A. Gundlfinger, D. Schmitz, and R. Kempter Phase Precession Through Synaptic Facilitation Neural Comput., May 1, 2008; 20(5): 1285 - 1324. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. A. Chestek, A. P. Batista, G. Santhanam, B. M. Yu, A. Afshar, J. P. Cunningham, V. Gilja, S. I. Ryu, M. M. Churchland, and K. V. Shenoy Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex J. Neurosci., October 3, 2007; 27(40): 10742 - 10750. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 B. Tripp and C. Eliasmith Neural Populations Can Induce Reliable Postsynaptic Currents without Observable Spike Rate Changes or Precise Spike Timing Cereb Cortex, August 1, 2007; 17(8): 1830 - 1840. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. C. Muresan and C. Savin Resonance or Integration? Self-Sustained Dynamics and Excitability of Neural Microcircuits J Neurophysiol, March 1, 2007; 97(3): 1911 - 1930. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Haeusler and W. Maass A Statistical Analysis of Information-Processing Properties of Lamina-Specific Cortical Microcircuit Models Cereb Cortex, January 1, 2007; 17(1): 149 - 162. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Tino and A. J. S. Mills Learning beyond finite memory in recurrent networks of spiking neurons. Neural Comput., March 1, 2006; 18(3): 591 - 613. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. C. Ozturk, D. Xu, and J. C. Principe Analysis and Design of Echo State Networks Neural Comput., January 1, 2006; 19(1): 111 - 138. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Carmena, M. A. Lebedev, C. S. Henriquez, and M. A. L. Nicolelis Stable Ensemble Performance with Single-Neuron Variability during Reaching Movements in Primates J. Neurosci., November 16, 2005; 25(46): 10712 - 10716. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Joshi and W. Maass Movement Generation with Circuits of Spiking Neurons Neural Comput., August 1, 2005; 17(8): 1715 - 1738. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. C. Wiest, N. Bentley, and M. A. L. Nicolelis Heterogeneous Integration of Bilateral Whisker Signals by Neurons in Primary Somatosensory Cortex of Awake Rats J Neurophysiol, May 1, 2005; 93(5): 2966 - 2973. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. M. Izhikevich Polychronization: Computation with Spikes Neural Comput., February 1, 2005; 18(2): 245 - 282. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Knusel, R. Wyss, P. Konig, and P. F.M.J. Verschure Decoding a Temporal Population Code Neural Comput., October 1, 2004; 16(10): 2079 - 2100. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. Bertschinger and T. Natschlager Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks Neural Comput., July 1, 2004; 16(7): 1413 - 1436. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. Jaeger and H. Haas Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication Science, April 2, 2004; 304(5667): 78 - 80. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Herzog, U. A. Ernst, A. Etzold, and C. W. Eurich Local Interactions in Neural Networks Explain Global Effects in Gestalt Processing and Masking Neural Comput., September 1, 2003; 15(9): 2091 - 2113. [Abstract] [Full Text]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |
