Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Oohori, T.
Right arrow Articles by Watanabe, K.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Oohori, T.
Right arrow Articles by Watanabe, K.
(Neural Computation. 2007;19:1422-1435.)
© 2007 The MIT Press


Letter

A New Backpropagation Learning Algorithm for Layered Neural Networks with Nondifferentiable Units

Takahumi Oohori

oohori{at}hit.ac.jp Department of Information Design, Hokkaido Institute of Technology, Sapporo 006-8585, Japan

Hidenori Naganuma

q04305{at}hit.ac.jp Division of Electrical Engineering, Graduate School of Engineering, Hokkaido Institute of Technology, Sapporo 006-8585, Japan

Kazuhisa Watanabe

nabek{at}hit.ac.jp Department of Information Network Engineering, Hokkaido Institute of Technology, Sapporo 006-8585, Japan

We propose a digital version of the backpropagation algorithm (DBP) for three-layered neural networks with nondifferentiable binary units. This approach feeds teacher signals to both the middle and output layers, whereas with a simple perceptron, they are given only to the output layer. The additional teacher signals enable the DBP to update the coupling weights not only between the middle and output layers but also between the input and middle layers. A neural network based on DBP learning is fast and easy to implement in hardware. Simulation results for several linearly nonseparable problems such as XOR demonstrate that the DBP performs favorably when compared to the conventional approaches. Furthermore, in large-scale networks, simulation results indicate that the DBP provides high performance.







HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2007 by The MIT Press.