A Comparison of Neural Network and Expert Systems Algorithms with Common Multivariate Procedures for Analysis of Social Science Data
- 1 October 1991
- journal article
- research article
- Published by SAGE Publications in Social Science Computer Review
- Vol. 9 (3) , 399-434
- https://doi.org/10.1177/089443939100900304
Abstract
New computer techniques for data analysis, notably the algorithms associated with neural networks and with expert systems, have not caught on to a significant extent in social science. To appraise these developments, an empirical assessment is conducted in which expert systems and neural network approaches are compared with multiple linear regression, logistic regression, effects analysis, path analysis, and discriminant analysis. A simple method of partitioning neural network output layer connections in terms of input nodes (corresponding to independent variables) is also presented, allowing neural net analysis for modeling as well as classification purposes. It is concluded that back-propagation (neural networks) is more effective than other procedures, sometimes strikingly so, in correctly classifying the dependent, even when the amount of noise in the model is high. Back-propagation was of less help, however, in causal inference. None of the techniques performed well by this important criterion. The ID3 algorithm is found to provide a useful mode of knowledge representation quite different from other procedures. While this may be preferred by some analysts for certain types of research, ID3 is not consistently superior to procedures in the multiple linear general model (MLGH) family in terms of effectiveness, either for classification or for causal inference. Keywords: statistical inference, computers, modeling, simulation, regression, discriminant analysis, effects analysis, path analysis, expert systems, ID3, neural networks, back-propagation.Keywords
This publication has 17 references indexed in Scilit:
- Inductive Learning Methods for Knowledge-Based Decision Support: A Comparative AnalysisComputational Economics, 1990
- The Role of Inductive Expert Systems Generators in the Social Science Research ProcessSocial Science Microcomputer Review, 1987
- Computer-Intensive Methods in StatisticsScientific American, 1983
- LEARNING EFFICIENT CLASSIFICATION PROCEDURES AND THEIR APPLICATION TO CHESS END GAMESPublished by Elsevier ,1983
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- Consequences and Detection of Misspecified Nonlinear Regression ModelsJournal of the American Statistical Association, 1981
- Robustness in Regression AnalysisSociological Methodology, 1971
- An Appraisal of Least Squares Programs for the Electronic Computer from the Point of View of the UserJournal of the American Statistical Association, 1967
- Prediction and Entropy of Printed EnglishBell System Technical Journal, 1951
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948