A D.C. Optimization Algorithm for Solving the Trust-Region Subproblem
- 1 May 1998
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 8 (2) , 476-505
- https://doi.org/10.1137/s1052623494274313
Abstract
This paper is devoted to difference of convex functions (d.c.) optimization: d. c. duality, local and global optimality conditions in d. c. programming, the d. c. algorithm (DCA), and its application to solving the trust-region problem. The DCA is an iterative method that is quite different from well-known related algorithms. Thanks to the particular structure of the trust-region problem, the DCA is very simple (requiring only matrix-vector products) and, in practice, converges to the global solution. The inexpensive implicitly restarted Lanczos method of Sorensen is used to check the optimality of solutions provided by the DCA. When a nonglobal solution is found, a simple numerical procedure is introduced both to find a feasible point having a smaller objective value and to restart the DCA at this point. It is shown that in the nonconvex case, the DCA converges to the global solution of the trust-region problem, using only matrix-vector products and requiring at most 2m+2 restarts, where m is the number of distinct negative eigenvalues of the coefficient matrix that defines the problem. Numerical simulations establish the robustness and efficiency of the DCA compared to standard related methods, especially for large-scale problems.Keywords
This publication has 17 references indexed in Scilit:
- On Some Properties of Quadratic Programs with a Convex Quadratic ConstraintSIAM Journal on Optimization, 1998
- Proximal Decomposition on the Graph of a Maximal Monotone OperatorSIAM Journal on Optimization, 1995
- Local Minimizers of Quadratic Functions on Euclidean Balls and SpheresSIAM Journal on Optimization, 1994
- Quadratically constrained least squares and quadratic problemsNumerische Mathematik, 1991
- Analysis of plane and axisymmetric flows of incompressible fluids with the stream tube method: Numerical simulation by trust-region optimization algorithmInternational Journal for Numerical Methods in Fluids, 1991
- A constrained eigenvalue problemLinear Algebra and its Applications, 1989
- Convergence of a subgradient method for computing the bound norm of matricesLinear Algebra and its Applications, 1984
- Computing a Trust Region StepSIAM Journal on Scientific and Statistical Computing, 1983
- Computing Optimal Locally Constrained StepsSIAM Journal on Scientific and Statistical Computing, 1981
- On the Stationary Values of a Second-Degree Polynomial on the Unit SphereJournal of the Society for Industrial and Applied Mathematics, 1965