Robust Solutions to Least-Squares Problems with Uncertain Data
- 1 October 1997
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 18 (4) , 1035-1064
- https://doi.org/10.1137/s0895479896298130
Abstract
We consider least-squares problems where the coefficient matrices A,b are unknown but bounded. We minimize the worst-case residual error using (convex) second-order cone programming, yielding an algorithm with complexity similar to one singular value decomposition of A. The method can be interpreted as a Tikhonov regularization procedure, with the advantage that it provides an exact bound on the robustness of solution and a rigorous way to compute the regularization parameter. When the perturbation has a known (e.g., Toeplitz) structure, the same problem can be solved in polynomial-time using semidefinite programming (SDP). We also consider the case when A,b are rational functions of an unknown-but-bounded perturbation vector. We show how to minimize (via SDP) upper bounds on the optimal worst-case residual. We provide numerical examples, including one from robust identification and one from robust interpolation.Keywords
This publication has 29 references indexed in Scilit:
- An Efficient Newton Barrier Method for Minimizing a Sum of Euclidean NormsSIAM Journal on Optimization, 1996
- Collinearity and Total Least SquaresSIAM Journal on Matrix Analysis and Applications, 1994
- Linear Matrix Inequalities in System and Control TheoryPublished by Society for Industrial & Applied Mathematics (SIAM) ,1994
- Structured total least squares and L2 approximation problemsLinear Algebra and its Applications, 1993
- The robust generalized least-squares estimatorSignal Processing, 1992
- Quadratically constrained least squares and quadratic problemsNumerische Mathematik, 1991
- Robustness in the presence of mixed parametric uncertainty and unmodeled dynamicsIEEE Transactions on Automatic Control, 1991
- Image reconstruction and restoration: overview of common estimation structures and problemsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- An Analysis of the Total Least Squares ProblemSIAM Journal on Numerical Analysis, 1980
- Algorithms for the regularization of ill-conditioned least squares problemsBIT Numerical Mathematics, 1977