Neural Comp. NEW Faster Access
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Jiang, W.
Right arrow Articles by Tanner, M. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jiang, W.
Right arrow Articles by Tanner, M. A.
(Neural Computation. 1999;11:1183-1198.)
© 1999 The MIT Press


Letter

On the Approximation Rate of Hierarchical Mixtures-of-Experts for Generalized Linear Models

Wenxin Jiang

Department of Statistics, Northwestern University, Evanston, IL 60208, U.S.A.

Martin A. Tanner

Department of Statistics, Northwestern University, Evanston, IL 60208, U.S.A.

We investigate a class of hierarchical mixtures-of-experts (HME) models where generalized linear models with nonlinear mean functions of the form {psi}({alpha} + xT ß) are mixed. Here {psi}(·) is the inverse link function. It is shown that mixtures of such mean functions can approximate a class of smooth functions of the form {psi}(h(x)), where h(·) {varepsilon} W2;K{infty} (a Sobolev class over [0,1]s), as the number of experts m in the network increases. An upper bound of the approximation rate is given as O(m-2/s) in Lp norm. This rate can be achieved within the family of HME structures with no more than s-layers, where s is the dimension of the predictor x.




This article has been cited by other articles:


Home page
Neural Comput.Home page
Y. Ge and W. Jiang
On Consistency of Bayesian Inference with Mixtures of Logistic Regression
Neural Comput., January 1, 2005; 18(1): 224 - 243.
[Abstract] [Full Text] [PDF]


Home page
Neural Comput.Home page
W. Jiang
The VC Dimension for Mixtures of Binary Classifiers
Neural Comput., June 1, 2000; 12(6): 1293 - 1301.
[Abstract] [Full Text]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 1999 by The MIT Press.