Scoring Divergent Thinking Tests Using Total Ideational Output and a Creativity Index

Abstract
There are several problems with the scoring techniques currently used with tests of ideational creativity. The present investigation tested two possible improvements in scoring procedures. The first potential improvement involved ratings of total ideational output, or "ideational sets." This procedure is in direct contrast to the conventional scoring of single ideas. The second improvement was to score ideational sets specifically for creativity rather than the conventional indices (e.g., originality, flexibility, and fluency). The utility of these potential improvements was determined by calculating the reliability and discriminant validity of scores based on examinees' total ideational output. Ideational output was judged by 30 college students (mean age of 27 years). The ideas that were rated were given by 24 adolescents who had received two Uses tests (shoe and tire) and two Instances tests (strong things and things on wheels). Results indicated that the ratings of total output had high inter-rater reliabilities and moderate interitem reliabilities. There was, however, poor discriminant validity between judges' ratings of creativity and ratings of intelligence. The use of ideational sets is recommended, although judges should probably be given an explicit definition of creativity.

This publication has 8 references indexed in Scilit: