Using ratings of resident competence to evaluate NBME examination passing standards

B. J. Turner, M. Hojat, J. S. Gonnella

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

The passing standards of the National Board of Medical Examiners (NBME) examinations were empirically evaluated by analyzing the distributions of examination scores received by 1,994 graduates of one medical school in relation to the clinical competence ratings given to the graduates by their first-year residency directors. A significant association was found between the NBME examination scores and ratings in the cognitive areas of clinical competence. The graduates who scored 420 or less on the NBME Part I or the Part II examination received significantly lower medical knowledge ratings than did the total group of graduates. A similar analysis of NBME Part III examination scores was less clear-cut but also suggested that a score of 420 or less could identify those graduates at significant risk of receiving low knowledge ratings. When low ratings were used as an outcome measure, analysis showed that the NBME Part II examination was not sensitive in detecting such graduates. Based on these data, the authors do not propose changes in the passing standards for the NBME examinations but recommend that these standards continue to be reassessed and further measures be taken to strengthen the internal evaluation methods in medical schools.

Original languageEnglish (US)
Pages (from-to)572-581
Number of pages10
JournalJournal of Medical Education
Volume62
Issue number7
StatePublished - 1987
Externally publishedYes

Fingerprint

Coroners and Medical Examiners
medical examiner
Mental Competency
rating
resident
graduate
examination
Clinical Competence
Medical Schools
Internship and Residency
school
director
Outcome Assessment (Health Care)
evaluation

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Using ratings of resident competence to evaluate NBME examination passing standards. / Turner, B. J.; Hojat, M.; Gonnella, J. S.

In: Journal of Medical Education, Vol. 62, No. 7, 1987, p. 572-581.

Research output: Contribution to journalArticle

Turner, BJ, Hojat, M & Gonnella, JS 1987, 'Using ratings of resident competence to evaluate NBME examination passing standards', Journal of Medical Education, vol. 62, no. 7, pp. 572-581.
Turner, B. J. ; Hojat, M. ; Gonnella, J. S. / Using ratings of resident competence to evaluate NBME examination passing standards. In: Journal of Medical Education. 1987 ; Vol. 62, No. 7. pp. 572-581.
@article{14e9ccb8e4914e69bbd8b06afba879b9,
title = "Using ratings of resident competence to evaluate NBME examination passing standards",
abstract = "The passing standards of the National Board of Medical Examiners (NBME) examinations were empirically evaluated by analyzing the distributions of examination scores received by 1,994 graduates of one medical school in relation to the clinical competence ratings given to the graduates by their first-year residency directors. A significant association was found between the NBME examination scores and ratings in the cognitive areas of clinical competence. The graduates who scored 420 or less on the NBME Part I or the Part II examination received significantly lower medical knowledge ratings than did the total group of graduates. A similar analysis of NBME Part III examination scores was less clear-cut but also suggested that a score of 420 or less could identify those graduates at significant risk of receiving low knowledge ratings. When low ratings were used as an outcome measure, analysis showed that the NBME Part II examination was not sensitive in detecting such graduates. Based on these data, the authors do not propose changes in the passing standards for the NBME examinations but recommend that these standards continue to be reassessed and further measures be taken to strengthen the internal evaluation methods in medical schools.",
author = "Turner, {B. J.} and M. Hojat and Gonnella, {J. S.}",
year = "1987",
language = "English (US)",
volume = "62",
pages = "572--581",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "7",

}

TY - JOUR

T1 - Using ratings of resident competence to evaluate NBME examination passing standards

AU - Turner, B. J.

AU - Hojat, M.

AU - Gonnella, J. S.

PY - 1987

Y1 - 1987

N2 - The passing standards of the National Board of Medical Examiners (NBME) examinations were empirically evaluated by analyzing the distributions of examination scores received by 1,994 graduates of one medical school in relation to the clinical competence ratings given to the graduates by their first-year residency directors. A significant association was found between the NBME examination scores and ratings in the cognitive areas of clinical competence. The graduates who scored 420 or less on the NBME Part I or the Part II examination received significantly lower medical knowledge ratings than did the total group of graduates. A similar analysis of NBME Part III examination scores was less clear-cut but also suggested that a score of 420 or less could identify those graduates at significant risk of receiving low knowledge ratings. When low ratings were used as an outcome measure, analysis showed that the NBME Part II examination was not sensitive in detecting such graduates. Based on these data, the authors do not propose changes in the passing standards for the NBME examinations but recommend that these standards continue to be reassessed and further measures be taken to strengthen the internal evaluation methods in medical schools.

AB - The passing standards of the National Board of Medical Examiners (NBME) examinations were empirically evaluated by analyzing the distributions of examination scores received by 1,994 graduates of one medical school in relation to the clinical competence ratings given to the graduates by their first-year residency directors. A significant association was found between the NBME examination scores and ratings in the cognitive areas of clinical competence. The graduates who scored 420 or less on the NBME Part I or the Part II examination received significantly lower medical knowledge ratings than did the total group of graduates. A similar analysis of NBME Part III examination scores was less clear-cut but also suggested that a score of 420 or less could identify those graduates at significant risk of receiving low knowledge ratings. When low ratings were used as an outcome measure, analysis showed that the NBME Part II examination was not sensitive in detecting such graduates. Based on these data, the authors do not propose changes in the passing standards for the NBME examinations but recommend that these standards continue to be reassessed and further measures be taken to strengthen the internal evaluation methods in medical schools.

UR - http://www.scopus.com/inward/record.url?scp=0023224959&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0023224959&partnerID=8YFLogxK

M3 - Article

C2 - 3599053

AN - SCOPUS:0023224959

VL - 62

SP - 572

EP - 581

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 7

ER -