Assessing Research Methodology
- 1 August 1977
- journal article
- Published by SAGE Publications in Sociological Methods & Research
- Vol. 6 (1) , 3-44
- https://doi.org/10.1177/004912417700600101
Abstract
This paper reports the development and application of a method for evaluating the methodology of social science research. In this study, 11 social scientists rated the methodology of 126 federally sponsored, social science research projects. Written documentation from each research project was divided into three packets, representing three stages of the research process: proposal, interim report, and completed research. Each project was independently rated at each of the three stages by two different reviewers, using a comprehensive methodology review instrument created for this purpose. A series of factor analyses of the ratingsfor 75 evaluative methodological features reveals a multidimensional structure underlying the evaluations. This structure appears to become more elaborate as research progresses toward completion. The implications of the structuring of methodological assessments are discussed for research funding procedures, research monitoring, the conduct of research, and the training of social scientists.Keywords
This publication has 11 references indexed in Scilit:
- The Difference That Quality MakesSociological Methods & Research, 1976
- Evaluation ResearchAnnual Review of Sociology, 1975
- Theta Reliability and Factor ScalingSociological Methodology, 1973
- The Structure of Scientific Fields and the Functioning of University Graduate DepartmentsAmerican Sociological Review, 1972
- Accumulating Evidence: Procedures for Resolving Contradictions among Different Research StudiesHarvard Educational Review, 1971
- A Note on Lower Bounds for the Number of Common FactorsPsychometrika, 1968
- A Monte Carlo Approach to the Number of Factors ProblemPsychometrika, 1968
- Scientific Output and Recognition: A Study in the Operation of the Reward System in ScienceAmerican Sociological Review, 1967
- The Scree Test For The Number Of FactorsMultivariate Behavioral Research, 1966
- The Application of Electronic Computers to Factor AnalysisEducational and Psychological Measurement, 1960