Work

High performance associative memory models and symmetric connections

Year: 2000
Type: conference-paper
Abstract: Two existing high capacity training rules for the standard Hopfield architecture associative memory are examined. Both rules, based on the perceptron learning rule produce asymmetric weight matrices, for which the simple dynamics (only point attractors) of a symmetric network can no longer be guaranteed. This paper examines the consequences of imposing a symmetry constraint in learning. The mean size of attractor basins of trained patterns and the mean time for learning convergence are analysed for the networks that arise from these learning rules, in both the asymmetric and symmetric instantiations. It is concluded that a symmetry constraint does not have any adverse affect on performance but that it does offer benefits in learning time and in network dynamics. 1 Introduction Due to the low capacity of the original Hopfield associative memory model, several other, more recent, models, have been developed that have a higher performance [Diederich and Opper 1987, Krauth and Meza...
Authors: N. Davey, R.G. Adams, Stephen P. Hunt
Language: English
Open Access status: green
OpenAlex ID: W1562193976
FWCI: 0.949
Cites: 9
Cited by: 7
Related to: 10