HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Sollich, P. Articles by Halees, A. Search for Related Content PubMed PubMed Citation Articles by Sollich, P. Articles by Halees, A.

Learning Curves for Gaussian Process Regression: Approximations and Bounds

peter.sollich{at}kcl.ac.uk, Department of Mathematics, King's College London, London WC2R 2LS, U.K.

Anason Halees

ahalees{at}kfshrc.edu.sa, Department of Mathematics, King's College London, London WC2R 2LS, U.K.

We consider the problem of calculating learning curves (i.e., average generalization performance) of gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue decomposition of the covariance function, we derive a number of approximation schemes. We identify where these become exact and compare with existing bounds on learning curves; the new approximations, which can be used for any input space dimension, generally get substantially closer to the truth. We also study possible improvements to our approximations. Finally, we use a simple exactly solvable learning scenario to show that there are limits of principle on the quality of approximations and bounds expressible solely in terms of the eigenvalue spectrum of the covariance function.