Neural Comp. NEW Faster Access
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Olsson, R. K.
Right arrow Articles by Lehn-Schiøler, T.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Olsson, R. K.
Right arrow Articles by Lehn-Schiøler, T.
(Neural Computation. 2007;19:1097-1111.)
© 2007 The MIT Press


Letter

State-Space Models: From the EM Algorithm to a Gradient Approach

Rasmus Kongsgaard Olsson

rko{at}imm.dtu.dk

Kaare Brandt Petersen

kbp{at}epital.dk

Tue Lehn-Schiøler

tls{at}imm.dtu.dk Technical University of Denmark, 2800 Kongens Lyngby, Denmark

Slow convergence is observed in the EM algorithm for linear state-space models. We propose to circumvent the problem by applying any off-the-shelf quasi-Newton-type optimizer, which operates on the gradient of the log-likelihood function. Such an algorithm is a practical alternative due to the fact that the exact gradient of the log-likelihood function can be computed by recycling components of the expectation-maximization (EM) algorithm. We demonstrate the efficiency of the proposed method in three relevant instances of the linear state-space model. In high signal-to-noise ratios, where EM is particularly prone to converge slowly, we show that gradient-based learning results in a sizable reduction of computation time.







HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2007 by The MIT Press.