Associative memory design using overlapping decompositions

Abstract

This paper discusses the use of decomposition techniques in the design of associative memories via artificial neural networks. In particular, a disjoint decomposition which allows an independent design of lower-dimensional subnetworks and an overlapping decomposition which allows subnetworks to share common parts, are analyzed. It is shown by a simple example that overlapping decompositions may help in certain cases where design by disjoint decompositions fails. With this motivation, an algorithm is provided to synthesize neural networks using the concept of overlapping decompositions. Applications of the proposed design procedure to a benchmark example from the literature and to a pattern recognition problem indicate that it may improve the effectiveness of the existing methods.