HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Takeuchi, I. Articles by Kanamori, T. Search for Related Content PubMed PubMed Citation Articles by Takeuchi, I. Articles by Kanamori, T.

Robust Regression with Asymmetric Heavy-Tail Noise Distributions

takeuchi{at}pa.info.mie-u.ac.jp, Department of Information Engineering, Mie University, Tsu 514-8507, Japan

Yoshua Bengio

bengioy{at}iro.umontreal.ca, Université de Montréal, DIRO, Montréal, Québec, Canada

Takafumi Kanamori

kanamori{at}is.titech.ac.jp, Department of Mathematical and Computing Sciences, Tokyo Institute of Technology, Meguro-ku, Tokyo 152-8552, Japan

In the presence of a heavy-tail noise distribution, regression becomes much more difficult. Traditional robust regression methods assume that the noise distribution is symmetric, and they downweight the influence of so-called outliers. When the noise distribution is asymmetric, these methods yield biased regression estimators. Motivated by data-mining problems for the insurance industry, we propose a new approach to robust regression tailored to deal with asymmetric noise distribution. The main idea is to learn most of the parameters of the model using conditional quantile estimators (which are biased but robust estimators of the regression) and to learn a few remaining parameters to combine and correct these estimators, to minimize the average squared error in an unbiased way. Theoretical analysis and experiments show the clear advantages of the approach. Results are on artificial data as well as insurance data, using both linear and neural network predictors.