Autoregressive model order selection by a finite sample estimator for the Kullback-Leibler discrepancy
- 1 July 1998
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 46 (7) , 2058-2061
- https://doi.org/10.1109/78.700984
Abstract
The finite sample information criterion (FSIC) is introduced as an estimator for the Kullback-Leibler discrepancy of an autoregressive time series. It is derived especially for order selection in finite samples, where model orders are greater than one tenth of the sample size. It uses a theoretical expression for the ratio between the squared prediction error and the residual variance its the penalty factor for additional parameters in a model. This ratio can be found with the finite sample theory for autoregressive estimation, which is based on empirical approximations for the variance of parameters. It takes into account the different number of degrees of freedom that are available effectively in the various algorithms for autoregressive parameter estimation. The performance of FSIC has been compared with existing order selection criteria in simulation experiments using four different estimation methods. In finite samples, the FSIC selects model orders with a better objective quality for all estimation methods.Keywords
This publication has 8 references indexed in Scilit:
- On the penalty factor for autoregressive order selection in finite samplesIEEE Transactions on Signal Processing, 1996
- On Finite Sample Theory for Autoregressive Model Order SelectionIEEE Transactions on Signal Processing, 1993
- Time Series: Theory and MethodsPublished by Springer Nature ,1991
- New lattice realisation of the predictive least-squares order selection criterionIEE Proceedings F Radar and Signal Processing, 1991
- Regression and time series model selection in small samplesBiometrika, 1989
- The determination of optimum structures for the state space representation of multivariate stochastic processesIEEE Transactions on Automatic Control, 1982
- Modeling by shortest data descriptionAutomatica, 1978
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978