HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Todorov, E. Search for Related Content PubMed PubMed Citation Articles by Todorov, E.

Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System

todorov{at}cogsci.ucsd.edu, Department of Cognitive Science, University of California San Diego, La Jolla CA 92093-0515.

Optimality principles of biological movement are conceptually appealing and straightforward to formulate. Testing them empirically, however, requires the solution to stochastic optimal control and estimation problems for reasonably realistic models of the motor task and the sensorimotor periphery. Recent studies have highlighted the importance of incorporating biologically plausible noise into such models. Here we extend the linear-quadratic-gaussian framework—currently the only framework where such problems can be solved efficiently—to include control-dependent, state-dependent, and internal noise. Under this extended noise model, we derive a coordinate-descent algorithm guaranteed to converge to a feedback control law and a nonadaptive linear estimator optimal with respect to each other. Numerical simulations indicate that convergence is exponential, local minima do not exist, and the restriction to nonadaptive linear estimators has negligible effects in the control problems of interest. The application of the algorithm is illustrated in the context of reaching movements. A Matlab implementation is available at www.cogsci.ucsd.edu/todorov.

This article has been cited by other articles:

				H. Chen-Harris, W. M. Joiner, V. Ethier, D. S. Zee, and R. Shadmehr Adaptive Control of Saccades via Internal Feedback J. Neurosci., March 12, 2008; 28(11): 2804 - 2813. [Abstract] [Full Text] [PDF]

				J. Izawa, T. Rane, O. Donchin, and R. Shadmehr Motor Adaptation as a Process of Reoptimization J. Neurosci., March 12, 2008; 28(11): 2883 - 2891. [Abstract] [Full Text] [PDF]

				D. Liu and E. Todorov Evidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control J. Neurosci., August 29, 2007; 27(35): 9354 - 9368. [Abstract] [Full Text] [PDF]

				K. E. Jones, C. T. Moritz, B. K. Barry, M. A. Pascoe, and R. M. Enoka Motor unit firing statistics and the Fuglevand model J Neurophysiol, September 1, 2005; 94(3): 2255 - 2257. [Full Text] [PDF]