Labelling Recursive Auto-associative Memory
- 1 January 1994
- journal article
- research article
- Published by Taylor & Francis in Connection Science
- Vol. 6 (4) , 429-459
- https://doi.org/10.1080/09540099408915733
Abstract
In this paper, we propose an extension to the recursive auto-associative memory (RAAM) by Pollack. This extension, the labelling RAAM (LRAAM), can encode labelled graphs with cycles by representing pointers explicitly. Some technical problems encountered in the RAAM, such as the termination problem in the learning and decoding processes, are solved more naturally in the LRAAM framework. The representations developed for the pointers seem to be robust to recurrent decoding along a cycle. Theoretical and experimental results show that the performances of the proposed learning scheme depend on the way the graphs are represented in the training set. Critical features for the representation are cycles and confluent pointers. Data encoded in a LRAAM can be accessed by a pointer as well as by content. Direct access by content can be achieved by transforming the encoder network of the LRAAM into a particular bidirectional associative memory (BAM). Statistics performed on different instances of LRAAM show a strict connection between the associated BAM and a standard BAM. Different access procedures can be defined depending on the access key. The access procedures are not wholly reliable; however, they seem to have a good success rate. The generalization test for the RAAM is no longer complete for the LRAAM. Some suggestions on how to solve this problem are given. Some results on modular LRAAM, stability and application to neural dynamics control are summarized.Keywords
This publication has 16 references indexed in Scilit:
- Encoding pyramids by Labeling RAAMPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- An analog feedback associative memoryIEEE Transactions on Neural Networks, 1993
- Connectionist technique for on-line parsingNetwork: Computation in Neural Systems, 1992
- Learning Recursive Distributed Representations for Holistic ComputationConnection Science, 1991
- Mapping part-whole hierarchies into connectionist networksArtificial Intelligence, 1990
- Recursive distributed representationsArtificial Intelligence, 1990
- Inversion of neural networks by gradient descentParallel Computing, 1990
- Unification: a multidisciplinary surveyACM Computing Surveys, 1989
- Neural networks and principal component analysis: Learning from examples without local minimaNeural Networks, 1989
- Auto-association by multilayer perceptrons and singular value decompositionBiological Cybernetics, 1988