HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Kwok, T. Articles by Smith, K. A. Search for Related Content PubMed PubMed Citation Articles by Kwok, T. Articles by Smith, K. A.

Optimization via Intermittency with a Self-Organizing Neural Network

terence.kwok{at}infotech.monash.edu.au, School of Business Systems, Faculty of Information Technology, Monash University, Clayton, Victoria 3168, Australia

Kate A. Smith

kate.smith{at}infotech.monash.edu.au, School of Business Systems, Faculty of Information Technology, Monash University, Clayton, Victoria 3168, Australia

One of the major obstacles in using neural networks to solve combinatorial optimization problems is the convergence toward one of the many local minima instead of the global minima. In this letter, we propose a technique that enables a self-organizing neural network to escape from local minima by virtue of the intermittency phenomenon. It gives rise to novel search dynamics that allow the system to visit multiple global minima as meta-stable states. Numerical experiments performed suggest that the phenomenon is a combined effect of Kohonen-type competitive learning and the iterated softmax function operating near bifurcation. The resultant intermittent search exhibits fractal characteristics when the optimization performance is at its peak in the form of 1/f signals in the time evolution of the cost, as well as power law distributions in the meta-stable solution states. The N-Queens problem is used as an example to illustrate the meta-stable convergence process that sequentially generates, in a single run, 92 solutions to the 8-Queens problem and 4024 solutions to the 17-Queens problem.

This article has been cited by other articles:

				P. Tino Equilibria of iterative softmax and critical temperatures for intermittent search in self-organizing neural networks. Neural Comput., April 1, 2007; 19(4): 1056 - 1081. [Abstract] [Full Text] [PDF]