Can family medicine residents predict their performance on the in-training examination?

Robert W Parker, Cindy Alford, Cindy Passmore

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Background and Objectives: Evaluation of residents 'competence is of great importance in the training of physicians, yet the evaluation process is largely subjective. Faculty and residents frequently rely on self-assessments to make decisions regarding curriculum design and electives. The In-training Examination (ITE), the only widely available objective measure of residents 'medical knowledge, provides an opportunity to test the reliability of self-assessments. This study's objective was to determine if family medicine residents are able to self-assess their medical knowledge by predicting their performance on the ITE. Methods: A survey asking the residents to estimate their performance on the ITE in each of the nine content areas was administered at 13 examination sites just prior to the ITE. Correlation coefficients were calculated for corresponding predicted and actual scores for each resident in each content area. Predictions were also compared to performance according to quartile. Results: Residents showed little ability to predict their scores in any of the content areas. Residents scoring in either the lowest or highest quartile were least able to predict accurately, with correct predictions ranging from 3% to 23%. Conclusions: Residents cannot reliably predict their performance on the ITE. Of special concern are residents scoring in the lowest quartile, since these residents greatly overestimated their performance.

Original languageEnglish (US)
Pages (from-to)705-709
Number of pages5
JournalFamily Medicine
Volume36
Issue number10
StatePublished - Nov 2004

Fingerprint

Medicine
Aptitude
Curriculum
Mental Competency
Physicians
Self-Assessment
Surveys and Questionnaires

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Parker, R. W., Alford, C., & Passmore, C. (2004). Can family medicine residents predict their performance on the in-training examination? Family Medicine, 36(10), 705-709.

Can family medicine residents predict their performance on the in-training examination? / Parker, Robert W; Alford, Cindy; Passmore, Cindy.

In: Family Medicine, Vol. 36, No. 10, 11.2004, p. 705-709.

Research output: Contribution to journalArticle

Parker, RW, Alford, C & Passmore, C 2004, 'Can family medicine residents predict their performance on the in-training examination?', Family Medicine, vol. 36, no. 10, pp. 705-709.
Parker, Robert W ; Alford, Cindy ; Passmore, Cindy. / Can family medicine residents predict their performance on the in-training examination?. In: Family Medicine. 2004 ; Vol. 36, No. 10. pp. 705-709.
@article{93a7fed614f5494abad300987dfaec42,
title = "Can family medicine residents predict their performance on the in-training examination?",
abstract = "Background and Objectives: Evaluation of residents 'competence is of great importance in the training of physicians, yet the evaluation process is largely subjective. Faculty and residents frequently rely on self-assessments to make decisions regarding curriculum design and electives. The In-training Examination (ITE), the only widely available objective measure of residents 'medical knowledge, provides an opportunity to test the reliability of self-assessments. This study's objective was to determine if family medicine residents are able to self-assess their medical knowledge by predicting their performance on the ITE. Methods: A survey asking the residents to estimate their performance on the ITE in each of the nine content areas was administered at 13 examination sites just prior to the ITE. Correlation coefficients were calculated for corresponding predicted and actual scores for each resident in each content area. Predictions were also compared to performance according to quartile. Results: Residents showed little ability to predict their scores in any of the content areas. Residents scoring in either the lowest or highest quartile were least able to predict accurately, with correct predictions ranging from 3{\%} to 23{\%}. Conclusions: Residents cannot reliably predict their performance on the ITE. Of special concern are residents scoring in the lowest quartile, since these residents greatly overestimated their performance.",
author = "Parker, {Robert W} and Cindy Alford and Cindy Passmore",
year = "2004",
month = "11",
language = "English (US)",
volume = "36",
pages = "705--709",
journal = "Family Medicine",
issn = "0742-3225",
publisher = "Society of Teachers of Family Medicine",
number = "10",

}

TY - JOUR

T1 - Can family medicine residents predict their performance on the in-training examination?

AU - Parker, Robert W

AU - Alford, Cindy

AU - Passmore, Cindy

PY - 2004/11

Y1 - 2004/11

N2 - Background and Objectives: Evaluation of residents 'competence is of great importance in the training of physicians, yet the evaluation process is largely subjective. Faculty and residents frequently rely on self-assessments to make decisions regarding curriculum design and electives. The In-training Examination (ITE), the only widely available objective measure of residents 'medical knowledge, provides an opportunity to test the reliability of self-assessments. This study's objective was to determine if family medicine residents are able to self-assess their medical knowledge by predicting their performance on the ITE. Methods: A survey asking the residents to estimate their performance on the ITE in each of the nine content areas was administered at 13 examination sites just prior to the ITE. Correlation coefficients were calculated for corresponding predicted and actual scores for each resident in each content area. Predictions were also compared to performance according to quartile. Results: Residents showed little ability to predict their scores in any of the content areas. Residents scoring in either the lowest or highest quartile were least able to predict accurately, with correct predictions ranging from 3% to 23%. Conclusions: Residents cannot reliably predict their performance on the ITE. Of special concern are residents scoring in the lowest quartile, since these residents greatly overestimated their performance.

AB - Background and Objectives: Evaluation of residents 'competence is of great importance in the training of physicians, yet the evaluation process is largely subjective. Faculty and residents frequently rely on self-assessments to make decisions regarding curriculum design and electives. The In-training Examination (ITE), the only widely available objective measure of residents 'medical knowledge, provides an opportunity to test the reliability of self-assessments. This study's objective was to determine if family medicine residents are able to self-assess their medical knowledge by predicting their performance on the ITE. Methods: A survey asking the residents to estimate their performance on the ITE in each of the nine content areas was administered at 13 examination sites just prior to the ITE. Correlation coefficients were calculated for corresponding predicted and actual scores for each resident in each content area. Predictions were also compared to performance according to quartile. Results: Residents showed little ability to predict their scores in any of the content areas. Residents scoring in either the lowest or highest quartile were least able to predict accurately, with correct predictions ranging from 3% to 23%. Conclusions: Residents cannot reliably predict their performance on the ITE. Of special concern are residents scoring in the lowest quartile, since these residents greatly overestimated their performance.

UR - http://www.scopus.com/inward/record.url?scp=7744226267&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=7744226267&partnerID=8YFLogxK

M3 - Article

C2 - 15531984

AN - SCOPUS:7744226267

VL - 36

SP - 705

EP - 709

JO - Family Medicine

JF - Family Medicine

SN - 0742-3225

IS - 10

ER -