Cluster Analyzing Profile Data Confounded with Interrater Differences: A Comparison of Profile Association Measures

Publisher Website
Google Scholar
Abstract
Seven association measures were compared for their effectiveness in relating and clustering data profiles confounded with interrater differences. Among these association indices were three distance measures, two measures of angular separation, and two measures of profile overlap. The objects of analysis were 50 jobs that had been rated by differ ent analysts on the items comprising the Occupa tion Analysis Inventory (OAI). Factor scores based on the OAI job ratings provided the profile data. Each of the seven association measures was applied to all pairwise combinations of factor-score profiles in the job sample, and the seven resultant 50 x 50 job proximity matrices were each subjected to hier archical cluster analysis. The job proximity ma trices and cluster structures based on the different association measures were then compared, re spectively, with a criterion proximity matrix and a criterion cluster structure. In relation to these two criteria, the angular measures (product-moment correlation and cosine) performed better than the distance and overlap measures. The results demon strate the importance of the choice of a profile as sociation measure in cluster analysis. The research er should be especially cautious when clustering en tities that have been rated by different judges. Un der such circumstances, it might be advisable to cluster analyze a data set using more than one as sociation measure and then to compare the alterna tive solutions for clarity and stability.

This publication has 7 references indexed in Scilit: