Phase Transitions in Connectionist Models Having Rapidly Varying Connection Strengths
- 1 December 1990
- journal article
- Published by MIT Press in Neural Computation
- Vol. 2 (4) , 523-535
- https://doi.org/10.1162/neco.1990.2.4.523
Abstract
A phase transition in a connectionist model refers to a qualitative change in the model's behavior as parameters determining the spread of activation (gain, decay rate, etc.) pass through certain critical values. As connectionist methods have been increasingly adopted to model various problems in neuroscience, artificial intelligence, and cognitive science, there has been an increased need to understand and predict these phase transitions to assure meaningful model behavior. This paper extends previous results on phase transitions to encompass a class of connectionist models having rapidly varying connection strengths (“fast weights”). Phase transitions are predicted theoretically and then verified through a series of computer simulations. These results broaden the range of connectionist models for which phase transitions are identified and lay the foundation for future studies comparing models with rapidly varying and slowly varying connection strengths.Keywords
This publication has 9 references indexed in Scilit:
- A connectionist model for dynamic controlTelematics and Informatics, 1989
- Generating plausible diagnostic hypotheses with self-processing causal networksJournal of Experimental & Theoretical Artificial Intelligence, 1989
- A connectionist model for diagnostic problem solvingIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Optimal scheduling by competitive activation: application to the satellite antennae scheduling problemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Phase transitions and metastability in neural netsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- A general-purpose simulation environment for developing connectionist modelsSIMULATION, 1988
- Artificial intelligence and large scale computation: A physics perspectivePhysics Reports, 1987
- Phase transitions in artificial intelligence systemsArtificial Intelligence, 1987
- Observation of Phase Transitions in Spreading Activation NetworksScience, 1987