Improved Prediction Error Estimates for Multivariate Calibration by Correcting for the Measurement Error in the Reference Values
- 1 May 1997
- journal article
- research article
- Published by SAGE Publications in Applied Spectroscopy
- Vol. 51 (5) , 660-665
- https://doi.org/10.1366/0003702971941061
Abstract
The validation of multivariate calibration models using measured reference values leads to a so-called apparent prediction error estimate, which is systematically larger than the true prediction error. The reason for this difference is clear: the measured reference values contain an irrelevant random component, the measurement error, which cannot be predicted by any model, not even the “true” one. However, the contribution of the measurement error in the reference values to the apparent prediction error estimate is interpreted as an inadequacy of the calibration model rather than an inadequacy of the reference values themselves. This phenomenon of confounding has been pointed out recently by several researchers, but no generally applicable solution was given. In this paper we propose a simple correction procedure that yields a more realistic estimate of the true prediction error. A large potential improvement over the conventional estimate is demonstrated for a variety of applications taken from the literature.Keywords
This publication has 10 references indexed in Scilit:
- Enzymatic browning of vegetables. Calibration and analysis of variance by multiway methodsChemometrics and Intelligent Laboratory Systems, 1996
- Near-Infrared Spectroscopic Determination of Acetate, Ammonium, Biomass, and Glycerol in an Industrial Escherichia Coli FermentationApplied Spectroscopy, 1996
- Modeling of Property Prediction from Multicomponent Analytical Data Using Different Neural NetworksAnalytical Chemistry, 1995
- Examination of Some Misconceptions about Near-Infrared AnalysisApplied Spectroscopy, 1995
- Octane number prediction based on gas chromatographic analysis with non-linear regression techniquesChemometrics and Intelligent Laboratory Systems, 1994
- Assessment of the Quality of Latent Variable Calibrations Based on Monte Carlo SimulationsAnalytical Chemistry, 1994
- On the Effect of Calibration and the Accuracy of NIR Spectroscopy with High Levels of Noise in the Reference ValuesApplied Spectroscopy, 1991
- Prediction of molecular weight and density of distillation fractions from gas chromatographic—mass spectrometric detection and multivariate calibrationChemometrics and Intelligent Laboratory Systems, 1988
- Multivariate calibration of diffuse reflectance infrared spectra of coals as an alternative to rank determination by vitrinite reflectanceChemometrics and Intelligent Laboratory Systems, 1987
- A Misuse of Ridge Regression in the Calibration of a Near Infrared Reflectance InstrumentJournal of the Royal Statistical Society Series C: Applied Statistics, 1983