INDIVIDUAL DIFFERENCES IN INTERVIEWER RATINGS: THE IMPACT OF STANDARDIZATION, CONSENSUS DISCUSSION, AND SAMPLING ERROR ON THE VALIDITY OF A STRUCTURED INTERVIEW
- 1 March 1996
- journal article
- Published by Wiley in Personnel Psychology
- Vol. 49 (1) , 85-102
- https://doi.org/10.1111/j.1744-6570.1996.tb01792.x
Abstract
This research investigated empirical issues regarding the validity of individual interviewers’(N= 62) ratings collected after a structured interview. Each interviewer rated an average of 25 interviewees. One hypothesis examined but not supported was that systematic interviewer errors will attenuate interview validity when data are aggregated across interviewers. Also investigated was the validity of ratings averaged across interviewers compared to consensus ratings; consensus ratings were shown to have significantly but probably not practically higher validities. Third, a meta‐analysis of individual interviewer validities revealed that all of the variance in validities could be attributed to sampling error. Results and implications are discussed.Keywords
This publication has 29 references indexed in Scilit:
- Confirming first impressions in the employment interview: A field study of interviewer behavior.Journal of Applied Psychology, 1994
- The validity of employment interviews: A comprehensive review and meta-analysis.Journal of Applied Psychology, 1994
- Studies of the structured behavioral interview.Journal of Applied Psychology, 1992
- Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe.Journal of Applied Psychology, 1990
- Examination of race and sex effects on performance ratings.Journal of Applied Psychology, 1989
- A meta‐analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview*Journal of Occupational Psychology, 1988
- Policy capturing in the employment interview.Journal of Applied Psychology, 1986
- Factors affecting the consensus judgment process in managerial assessment centers.Journal of Applied Psychology, 1982
- Initial comparisons of patterned behavior description interviews versus unstructured interviews.Journal of Applied Psychology, 1982
- Interviewer validity as a function of interview structure, biographical data, and interviewee order.Journal of Applied Psychology, 1975