HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Van Hulle, M. M. Search for Related Content PubMed PubMed Citation Articles by Van Hulle, M. M.

Joint Entropy Maximization in Kernel-Based Topographic Maps

marc{at}neuro.kuleuven.ac.be, K. U. Leuven, Laboratorium voor Neuro-en Psychofysiologie Campus Gasthuisberg, B-3000 Leuven, Belgium

A new learning algorithm for kernel-based topographic map formation is introduced. The kernel parameters are adjusted individually so as to maximize the joint entropy of the kernel outputs. This is done by maximizing the differential entropies of the individual kernel outputs, given that the map's output redundancy, due to the kernel overlap, needs to be minimized. The latter is achieved by minimizing the mutual information between the kernel outputs. As a kernel, the (radial) incomplete gamma distribution is taken since, for a gaussian input density, the differential entropy of the kernel output will be maximal. Since the theoretically optimal joint entropy performance can be derived for the case of nonoverlapping gaussian mixture densities, a new clustering algorithm is suggested that uses this optimum as its "null" distribution. Finally, it is shown that the learning algorithm is similar to one that performs stochastic gradient descent on the Kullback-Leibler divergence for a heteroskedastic gaussian mixture density model.

This article has been cited by other articles:

				M. M. Van Hulle Maximum Likelihood Topographic Map Formation Neural Comput., March 1, 2005; 17(3): 503 - 513. [Abstract] [Full Text] [PDF]