Choosing a Model Selection Strategy
- 28 February 2003
- journal article
- Published by Wiley in Scandinavian Journal of Statistics
- Vol. 30 (1) , 113-128
- https://doi.org/10.1111/1467-9469.00321
Abstract
An important problem in statistical practice is the selection of a suitable statistical model. Several model selection strategies are available in the literature, having different asymptotic and small sample properties, depending on the characteristics of the data generating mechanism. These characteristics are difficult to check in practice and there is a need for a data‐driven adaptive procedure to identify an appropriate model selection strategy for the data at hand. We call such an identification a model metaselection, and we base it on the analysis of recursive prediction residuals obtained from each strategy with increasing sample sizes. Graphical tools are proposed in order to study these recursive residuals. Their use is illustrated on real and simulated data sets. When necessary, an automatic metaselection can be performed by simply accumulating predictive losses. Asymptotic and small sample results are presented.Keywords
This publication has 33 references indexed in Scilit:
- Model Selection and the Principle of Minimum Description LengthJournal of the American Statistical Association, 2001
- MDL denoisingIEEE Transactions on Information Theory, 2000
- On efficient probability forecasting systemsBiometrika, 1999
- An Improvement of Akaike's FPE Criterion to Reduce its VariabilityJournal of Time Series Analysis, 1998
- Prequential data analysisPublished by Institute of Mathematical Statistics ,1992
- Diagnostics for Use With Regression Recursive ResidualsTechnometrics, 1991
- Finite sample selection criteria for multinomial modelsStatistische Hefte, 1986
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Some Comments on C PTechnometrics, 1973