(Neural Computation. 2006;18:2813-2853.)
© 2006 The MIT Press
Piecewise-Linear Neural Networks and Their Relationship to Rule Extraction from Data
Martin Hole
a
martin{at}cs.cas.cz Institute of Computer Science, Academy of Sciences of the Czech Republic, Pod vodárenskou v
í 2, CZ-18207 Praha 8, Czech Republic
This article addresses the topic of extracting logical rules from data by means of artificial neural networks. The approach based on piecewise-linear neural networks is revisited, which has already been used for the extraction of Boolean rules in the past, and it is shown that this approach can be important also for the extraction of fuzzy rules. Two important theoretical properties of piecewise-linear neural networks are proved, allowing an elaboration of the basic ideas of the approach into several variants of an algorithm for the extraction of Boolean rules. That algorithm has already been used in two real-world applications. Finally, a connection to the extraction of rules of the
ukasiewicz logic is established, relying on recent results about rational McNaughton functions. Based on one of the constructive proofs of the McNaughton theorem, an algorithm is formulated that in principle allows extracting a particular kind of formulas of the
ukasiewicz predicate logic from piecewise-linear neural networks trained with rational data.
Copyright © 2006 by The MIT Press.