Estimation in the presence of incidental parameters
- 1 June 1982
- journal article
- Published by Wiley in The Canadian Journal of Statistics / La Revue Canadienne de Statistique
- Vol. 10 (2) , 121-132
- https://doi.org/10.2307/3314904
Abstract
This paper considers the estimation of “structural” parameters when the number of unknown parameters increases with the sample size. Neyman and Scott (1948) had demonstrated that maximum likelihood estimators (MLE) of structural parameters may be inconsistent in this case. Patefield (1977) further observed that the asymptotic covariance matrix of the MLE is not equal to the inverse of the information matrix. In this paper we establish asymptotic properties of estimators (which include in particular the MLE) obtained via the usual likelihood approach when the incidental parameters are first replaced by their estimates (which are allowed to depend on the structural parameters). Conditions for consistency and asymptotic normality together with a proper formula for the asymptotic covariance matrix are given. The results are illustrated and applied to the problem of estimating linear functional relationships, and mild conditions on the incidental parameters for the MLE (or an adjusted MLE) to be consistent and asymptotically normal are obtained. These conditions are weaker than those imposed by previous authors.Keywords
This publication has 27 references indexed in Scilit:
- Vec and vech operators for matrices, with some uses in jacobians and multivariate statisticsThe Canadian Journal of Statistics / La Revue Canadienne de Statistique, 1979
- On the Unique Consistent Solution to the Likelihood EquationsJournal of the American Statistical Association, 1977
- The Asymptotic Distribution of the Likelihood Ratio in Some Nonstandard CasesJournal of the American Statistical Association, 1975
- Asymptotic Properties of Maximum Likelihood Estimators in Some Nonstandard Cases, IIJournal of the American Statistical Association, 1973
- Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed CaseThe Annals of Mathematical Statistics, 1971
- Asymptotic Properties of Maximum Likelihood Estimators in Some Nonstandard CasesJournal of the American Statistical Association, 1971
- Fitting Straight Lines-The Linear Functional Relationship with Replicated ObservationsJournal of the Royal Statistical Society Series C: Applied Statistics, 1970
- Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix ProductsJournal of the American Statistical Association, 1969
- On Optimal Asymptotic Tests of Composite Statistical HypothesesThe Annals of Mathematical Statistics, 1967