Intraclass correlation as a reliability check on nominal data

Jim Mintz, Carl Wiedemann

Research output: Contribution to journalArticlepeer-review


The procedure described yields estimates of the reliability with which judges employ nominal categories, when such categorical assignment has been sequentially dichotomized into a series of orthogonal contrasts. The program is written in Fortran IV for the CDC-6600. The user must specify k - 1 sets of weights for contrasts among the k categories. The program then assigns these weights as scores to each subject, and computes a one-way analysis of variance for each of the k - 1 sets of scores. Output from the program includes the scores assigned to each subject for each of the contrasts, the analysis of variance for each contrast, the intraclass correlation, and the weights for each contrast. Current limits are 20 categories, 100 subjects, and 10 judges, but these can be enlarged by the user. Program and sample data are available from the authors on request. Comment cards in the program indicate required input.

Original languageEnglish (US)
Pages (from-to)801-804
Number of pages4
JournalEducational and Psychological Measurement
Issue number3
StatePublished - Oct 1972
Externally publishedYes

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Applied Mathematics


Dive into the research topics of 'Intraclass correlation as a reliability check on nominal data'. Together they form a unique fingerprint.

Cite this