|
|
||||||||
Letter |
Department of Statistics, Northwestern University, Evanston, IL 60208, U.S.A.
Department of Statistics, Northwestern University, Evanston, IL 60208, U.S.A.
We investigate a class of hierarchical mixtures-of-experts (HME) models where generalized linear models with nonlinear mean functions of the form
(
+ xT ß) are mixed. Here
(·) is the inverse link function. It is shown that mixtures of such mean functions can approximate a class of smooth functions of the form
(h(x)), where h(·)
W2;K
(a Sobolev class over [0,1]s), as the number of experts m in the network increases. An upper bound of the approximation rate is given as O(m-2/s) in Lp norm. This rate can be achieved within the family of HME structures with no more than s-layers, where s is the dimension of the predictor x.
This article has been cited by other articles:
![]() |
Y. Ge and W. Jiang On Consistency of Bayesian Inference with Mixtures of Logistic Regression Neural Comput., January 1, 2005; 18(1): 224 - 243. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. Jiang The VC Dimension for Mixtures of Binary Classifiers Neural Comput., June 1, 2000; 12(6): 1293 - 1301. [Abstract] [Full Text] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |