Neural Comp. NEW Faster Access
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kanamori, T.
Right arrow Articles by Murata, N.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Kanamori, T.
Right arrow Articles by Murata, N.
(Neural Computation. 2007;19:2183-2244.)
© 2007 The MIT Press


Letter

Robust Loss Functions for Boosting

Takafumi Kanamori

kanamori{at}is.titech.ac.jp Department of Mathematical and Computing Sciences, Tokyo Institute of Technology, Tokyo 152-8552, Japan

Takashi Takenouchi

ttakashi{at}is.naist.jp Nara Institute of Science and Technology, Ikoma, Nara 630-0192, Japan

Shinto Eguchi

eguchi{at}ism.ac.jp Institute of Statistical Mathematics, and Department of Statistical Science, Graduate University of Advanced Studies, Minato-ku, Tokyo 106-8569, Japan

Noboru Murata

noboru.murata{at}eb.waseda.ac.jp School of Science and Engineering, Waseda University, Shinjuku, Tokyo 169-8555, Japan

Boosting is known as a gradient descent algorithm over loss functions. It is often pointed out that the typical boosting algorithm, Adaboost, is highly affected by outliers. In this letter, loss functions for robust boosting are studied. Based on the concept of robust statistics, we propose a transformation of loss functions that makes boosting algorithms robust against extreme outliers. Next, the truncation of loss functions is applied to contamination models that describe the occurrence of mislabels near decision boundaries. Numerical experiments illustrate that the proposed loss functions derived from the contamination models are useful for handling highly noisy data in comparison with other loss functions.







HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2007 by The MIT Press.