A Study of Algorithms for Covariance Structure Analysis with Specific Comparisons using Factor Analysis
- 1 March 1979
- journal article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 44 (1) , 99-113
- https://doi.org/10.1007/bf02293789
Abstract
Several algorithms for covariance structure analysis are considered in addition to the Fletcher-Powell algorithm. These include the Gauss-Newton, Newton-Raphson, Fisher Scoring, and Fletcher-Reeves algorithms. Two methods of estimation are considered, maximum likelihood and weighted least squares. It is shown that the Gauss-Newton algorithm which in standard form produces weighted least squares estimates can, in iteratively reweighted form, produce maximum likelihood estimates as well. Previously unavailable standard error estimates to be used in conjunction with the Fletcher-Reeves algorithm are derived. Finally all the algorithms are applied to a number of maximum likelihood and weighted least squares factor analysis problems to compare the estimates and the standard errors produced. The algorithms appear to give satisfactory estimates but there are serious discrepancies in the standard errors. Because it is robust to poor starting values, converges rapidly and conveniently produces consistent standard errors for both maximum likelihood and weighted least squares problems, the Gauss-Newton algorithm represents an attractive alternative for at least some covariance structure analyses.Keywords
This publication has 11 references indexed in Scilit:
- Rotational Equivalence of Factor Loading Matrices with Specified ValuesPsychometrika, 1978
- SIMPLIFIED FORMULAE FOR STANDARD ERRORS IN MAXIMUM‐LIKELIHOOD FACTOR ANALYSISBritish Journal of Mathematical and Statistical Psychology, 1974
- Analysis of Covariance StructuresPublished by Elsevier ,1973
- Factor Analysis by Generalized Least SquaresPsychometrika, 1972
- A RAPIDLY CONVERGENT METHOD FOR MAXIMUM‐LIKELIHOOD FACTOR ANALYSISBritish Journal of Mathematical and Statistical Psychology, 1970
- A General Approach to Confirmatory Maximum Likelihood Factor AnalysisPsychometrika, 1969
- Some Contributions to Maximum Likelihood Factor AnalysisPsychometrika, 1967
- Function minimization by conjugate gradientsThe Computer Journal, 1964
- A Rapidly Convergent Descent Method for MinimizationThe Computer Journal, 1963
- FACTOR ANALYSIS BY LAWLEY'S METHOD OF MAXIMUM LIKELIHOODBritish Journal of Statistical Psychology, 1949