HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Fushiki, T. Articles by Tsuchiya, T. Search for Related Content PubMed PubMed Citation Articles by Fushiki, T. Articles by Tsuchiya, T.

A Maximum Likelihood Approach to Density Estimation with Semidefinite Programming

fushiki{at}ism.ac.jp Institute of Statistical Mathematics, Minato-ku, Tokyo 106-8569, Japan

Shingo Horiuchi

hor{at}ansl.ntt.co.jp Access Network Service Systems Laboratories, NTT Corp., Makuhari, Chiba, 261-0023, Japan

Takashi Tsuchiya

tsuchiya{at}sun312.ism.ac.jp Institute of Statistical Mathematics, Minato-ku, Tokyo 106-8569, Japan

Density estimation plays an important and fundamental role in pattern recognition, machine learning, and statistics. In this article, we develop a parametric approach to univariate (or low-dimensional) density estimation based on semidefinite programming (SDP). Our density model is expressed as the product of a nonnegative polynomial and a base density such as normal distribution, exponential distribution, and uniform distribution. When the base density is specified, the maximum likelihood estimation of the polynomial is formulated as a variant of SDP that is solved in polynomial time with the interior point methods. Since the base density typically contains just one or two parameters, computation of the maximum likelihood estimate reduces to a one- or two-dimensional easy optimization problem with this use of SDP. Thus, the rigorous maximum likelihood estimate can be computed in our approach. Furthermore, such conditions as symmetry and unimodality of the density function can be easily handled within this framework. AIC is used to choose the best model. Through applications to several instances, we demonstrate flexibility of the model and performance of the proposed procedure. Combination with a mixture approach is also presented. The proposed approach has possible other applications beyond density estimation. This point is clarified through an application to the maximum likelihood estimation of the intensity function of a nonstationary Poisson process.