Extracting Formulae in Many-Valued Logic From Deep Neural Networks
Year: 2025
Type: article
Abstract: We propose a new perspective on deep rectified linear unit (ReLU) networks, namely as circuit counterparts of Łukasiewicz infinite-valued logic—a many-valued (MV) generalization of Boolean logic. An algorithm1for extracting formulae in MV logic from (trained) deep ReLU networks is presented. The algorithm respects the network topology, in particular compositionality, thereby honoring algebraic information present in the training data. While the two existing methods for turning truth functions in MV logic into formulae are for the univariate case only, the algorithm we propose applies to multivariate functions. Moreover, it is demonstrated—through numerical results and in one specific case analytically—that our algorithm, in the univariate case, can deliver shorter formulae than the other two methods. We also establish the representation benefits of deep networks from a mathematical logic perspective.
Authors: Yani Zhang, Helmut Bölcskei
Institution: ETH Zurich
Language: English
Topic: Advanced Algebra and Logic
Subfield: Computational Theory and Mathematics
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,645
OpenAlex ID: W7084070768