“Neural” computation of decisions in optimization problems
- 1 July 1985
- journal article
- research article
- Published by Springer Nature in Biological Cybernetics
- Vol. 52 (3) , 141-152
- https://doi.org/10.1007/bf00339943
Abstract
Highly-interconnected networks of nonlinear analog neurons are shown to be extremely effective in computing. The networks can rapidly provide a collectively-computed solution (a digital output) to a problem on the basis of analog input information. The problems to be solved must be formulated in terms of desired optima, often subject to constraints. The general principles involved in constructing networks to solve specific problems are discussed. Results of computer simulations of a network designed to solve a difficult but well-defined optimization problem-the Traveling-Salesman Problem-are presented and used to illustrate the computational power of the networks. Good solutions to this problem are collectively computed within an elapsed time of only a few neural time constants. The effectiveness of the computation involves both the nonlinear analog response of the neurons and the large connectivity among them. Dedicated networks of biological or microelectronic neurons could provide the computational capabilities described for a wide class of problems having combinatorial complexity. The power and speed naturally displayed by such collective networks may contribute to the effectiveness of biological information processing.Keywords
This publication has 15 references indexed in Scilit:
- Cortical connections and parallel processing: Structure and functionBehavioral and Brain Sciences, 1986
- Modular organization of prefrontal cortexTrends in Neurosciences, 1984
- The simplest spin glassNuclear Physics B, 1984
- Neurons with graded response have collective computational properties like those of two-state neurons.Proceedings of the National Academy of Sciences, 1984
- Parallel visual computationNature, 1983
- Optimization by Simulated AnnealingScience, 1983
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- Numerical shape from shading and occluding boundariesArtificial Intelligence, 1981
- Textons, the elements of texture perception, and their interactionsNature, 1981
- Solution of 'Solvable model of a spin glass'Philosophical Magazine, 1977