Statistical Physics Algorithms That Converge
- 1 May 1994
- journal article
- Published by MIT Press in Neural Computation
- Vol. 6 (3) , 341-356
- https://doi.org/10.1162/neco.1994.6.3.341
Abstract
In recent years there has been significant interest in adapting techniques from statistical physics, in particular mean field theory, to provide deterministic heuristic algorithms for obtaining approximate solutions to optimization problems. Although these algorithms have been shown experimentally to be successful there has been little theoretical analysis of them. In this paper we demonstrate connections between mean field theory methods and other approaches, in particular, barrier function and interior point methods. As an explicit example, we summarize our work on the linear assignment problem. In this previous work we defined a number of algorithms, including deterministic annealing, for solving the assignment problem. We proved convergence, gave bounds on the convergence times, and showed relations to other optimization algorithms.Keywords
This publication has 20 references indexed in Scilit:
- Mean-field phase transitions and correlation functions for Gibbs random fieldsJournal of Mathematical Imaging and Vision, 1993
- Track finding with deformable templates — the elastic arms approachComputer Physics Communications, 1992
- Parallel and deterministic algorithms from MRFs: surface reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Parallel Distributed Approaches to Combinatorial Optimization: Benchmark Studies on Traveling Salesman ProblemNeural Computation, 1990
- A theoretical investigation into the performance of the Hopfield modelIEEE Transactions on Neural Networks, 1990
- Generalized Deformable Models, Statistical Physics, and Matching ProblemsNeural Computation, 1990
- An Analysis of the Elastic Net Approach to the Traveling Salesman ProblemNeural Computation, 1989
- Separating Figure from Ground with a Parallel NetworkPerception, 1986
- Optimization by Simulated AnnealingScience, 1983
- A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic MatricesThe Annals of Mathematical Statistics, 1964