Technical Note: Review of methods for linear least-squares fitting of data and application to atmospheric chemistry problems
Top Cited Papers
Open Access
- 12 September 2008
- journal article
- review article
- Published by Copernicus GmbH in Atmospheric Chemistry and Physics
- Vol. 8 (17) , 5477-5487
- https://doi.org/10.5194/acp-8-5477-2008
Abstract
The representation of data, whether geophysical observations, numerical model output or laboratory results, by a best fit straight line is a routine practice in the geosciences and other fields. While the literature is full of detailed analyses of procedures for fitting straight lines to values with uncertainties, a surprising number of scientists blindly use the standard least-squares method, such as found on calculators and in spreadsheet programs, that assumes no uncertainties in the x values. Here, the available procedures for estimating the best fit straight line to data, including those applicable to situations for uncertainties present in both the x and y variables, are reviewed. Representative methods that are presented in the literature for bivariate weighted fits are compared using several sample data sets, and guidance is presented as to when the somewhat more involved iterative methods are required, or when the standard least-squares procedure would be expected to be satisfactory. A spreadsheet-based template is made available that employs one method for bivariate fitting.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Peroxy radical behavior during the Transport and Chemical Evolution over the Pacific (TRACE‐P) campaign as measured aboard the NASA P‐3B aircraftJournal of Geophysical Research: Atmospheres, 2003
- Assessment of upper tropospheric HOx sources over the tropical Pacific based on NASA GTE/PEM data: Net effect on HOx and other photochemical parametersJournal of Geophysical Research: Atmospheres, 1999
- When errors in both coordinates make a difference in the fitting of straight lines by least squaresMeasurement Science and Technology, 1998
- Analysis of relative rate measurementsInternational Journal of Chemical Kinetics, 1997
- Least squares fitting of a straight line to a set of data pointsEuropean Journal of Physics, 1995
- On the Use of Least Squares To Fit Data in Linear FormJournal of Chemical Education, 1994
- Error analysis of the parameters of a least-squares determined curve when both variables have uncertaintiesMeasurement Science and Technology, 1991
- Comment on ‘‘Linear least-squares fits with errors in both coordinates,’’ by B. C. Reed [Am. J. Phys. 5 7, 642–646 (1989)]American Journal of Physics, 1991
- Simple Method for Fitting Data when Both Variables Have UncertaintiesAmerican Journal of Physics, 1974
- Simplified Statistics for Small Numbers of ObservationsAnalytical Chemistry, 1951