Performance on brief practice examination identifies residents at risk for poor ABSITE and ABS qualifying examination performance

Michael G. Corneille, Ross Willis, Ronald M Stewart, Daniel L Dent

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Objective: Performance on the American Board of Surgery (ABS) Qualifying Exam (QE) correlates well with chief resident American Board of Surgery In-Training Exam (ABSITE) scores. Yearly ABSITE performance is a useful gauge of resident fund of knowledge and can identify residents at risk of QE failure. We hypothesize that a brief practice exam administered 1-3 times each academic year can identify residents at risk of poor ABSITE performance and also identify early in the chief resident year those at risk for poor QE performance. Methods: In 2005 we began administering 2-3 times/year an approximately 50 question exam consisting of questions authored by residents and edited by faculty based on the ABSITE exam keywords. The exam was considered mandatory and educational time was allotted. Data were analyzed by determining an individual's score deviation from the mean within PGY class. The standard deviation was then compared to the corresponding years ABSITE percentile and in the final year, QE performance using the Spearman rank correlation test. Results: A total of 710 individual practice exams were offered and 462 (65.1%) were completed in 9 sessions. Two hundred sixty-three residents completed both a practice examination and ABSITE in the year preceding the administration of the ABSITE. Twenty-six chief residents completed a practice examination in the year immediately preceding the ABS QE. Correlations between practice exam scores and ABSITE score percentile were statistically significant (p= 0.01-0.05) for each year the test was administered. The correlation between the practice exam score for chief residents preceding the QE and first attempt QE score was also significant (r =0.416, p<0.05). Conclusions: A resident's performance on a brief practice exam administered throughout the year is significantly correlated with both ABSITE performance and ABS QE performance. Such a test can be a useful adjunct for identifying residents at risk for poor ABSITE performance as well as identify prior to return of ABSITE scores those residents at risk for poor ABS QE performance.

Original languageEnglish (US)
Pages (from-to)246-249
Number of pages4
JournalJournal of Surgical Education
Volume68
Issue number3
DOIs
StatePublished - May 2011

Fingerprint

surgery
resident
examination
performance
Financial Management

Keywords

  • American Board of Surgery In-Training Exam (ABSITE)
  • curriculum problem based learning
  • qualifying examination
  • resident remediation
  • surgery training
  • surgical education

ASJC Scopus subject areas

  • Surgery
  • Education

Cite this

Performance on brief practice examination identifies residents at risk for poor ABSITE and ABS qualifying examination performance. / Corneille, Michael G.; Willis, Ross; Stewart, Ronald M; Dent, Daniel L.

In: Journal of Surgical Education, Vol. 68, No. 3, 05.2011, p. 246-249.

Research output: Contribution to journalArticle

@article{4baa954e037e45219b6df4a1e296b0d3,
title = "Performance on brief practice examination identifies residents at risk for poor ABSITE and ABS qualifying examination performance",
abstract = "Objective: Performance on the American Board of Surgery (ABS) Qualifying Exam (QE) correlates well with chief resident American Board of Surgery In-Training Exam (ABSITE) scores. Yearly ABSITE performance is a useful gauge of resident fund of knowledge and can identify residents at risk of QE failure. We hypothesize that a brief practice exam administered 1-3 times each academic year can identify residents at risk of poor ABSITE performance and also identify early in the chief resident year those at risk for poor QE performance. Methods: In 2005 we began administering 2-3 times/year an approximately 50 question exam consisting of questions authored by residents and edited by faculty based on the ABSITE exam keywords. The exam was considered mandatory and educational time was allotted. Data were analyzed by determining an individual's score deviation from the mean within PGY class. The standard deviation was then compared to the corresponding years ABSITE percentile and in the final year, QE performance using the Spearman rank correlation test. Results: A total of 710 individual practice exams were offered and 462 (65.1{\%}) were completed in 9 sessions. Two hundred sixty-three residents completed both a practice examination and ABSITE in the year preceding the administration of the ABSITE. Twenty-six chief residents completed a practice examination in the year immediately preceding the ABS QE. Correlations between practice exam scores and ABSITE score percentile were statistically significant (p= 0.01-0.05) for each year the test was administered. The correlation between the practice exam score for chief residents preceding the QE and first attempt QE score was also significant (r =0.416, p<0.05). Conclusions: A resident's performance on a brief practice exam administered throughout the year is significantly correlated with both ABSITE performance and ABS QE performance. Such a test can be a useful adjunct for identifying residents at risk for poor ABSITE performance as well as identify prior to return of ABSITE scores those residents at risk for poor ABS QE performance.",
keywords = "American Board of Surgery In-Training Exam (ABSITE), curriculum problem based learning, qualifying examination, resident remediation, surgery training, surgical education",
author = "Corneille, {Michael G.} and Ross Willis and Stewart, {Ronald M} and Dent, {Daniel L}",
year = "2011",
month = "5",
doi = "10.1016/j.jsurg.2010.12.009",
language = "English (US)",
volume = "68",
pages = "246--249",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Performance on brief practice examination identifies residents at risk for poor ABSITE and ABS qualifying examination performance

AU - Corneille, Michael G.

AU - Willis, Ross

AU - Stewart, Ronald M

AU - Dent, Daniel L

PY - 2011/5

Y1 - 2011/5

N2 - Objective: Performance on the American Board of Surgery (ABS) Qualifying Exam (QE) correlates well with chief resident American Board of Surgery In-Training Exam (ABSITE) scores. Yearly ABSITE performance is a useful gauge of resident fund of knowledge and can identify residents at risk of QE failure. We hypothesize that a brief practice exam administered 1-3 times each academic year can identify residents at risk of poor ABSITE performance and also identify early in the chief resident year those at risk for poor QE performance. Methods: In 2005 we began administering 2-3 times/year an approximately 50 question exam consisting of questions authored by residents and edited by faculty based on the ABSITE exam keywords. The exam was considered mandatory and educational time was allotted. Data were analyzed by determining an individual's score deviation from the mean within PGY class. The standard deviation was then compared to the corresponding years ABSITE percentile and in the final year, QE performance using the Spearman rank correlation test. Results: A total of 710 individual practice exams were offered and 462 (65.1%) were completed in 9 sessions. Two hundred sixty-three residents completed both a practice examination and ABSITE in the year preceding the administration of the ABSITE. Twenty-six chief residents completed a practice examination in the year immediately preceding the ABS QE. Correlations between practice exam scores and ABSITE score percentile were statistically significant (p= 0.01-0.05) for each year the test was administered. The correlation between the practice exam score for chief residents preceding the QE and first attempt QE score was also significant (r =0.416, p<0.05). Conclusions: A resident's performance on a brief practice exam administered throughout the year is significantly correlated with both ABSITE performance and ABS QE performance. Such a test can be a useful adjunct for identifying residents at risk for poor ABSITE performance as well as identify prior to return of ABSITE scores those residents at risk for poor ABS QE performance.

AB - Objective: Performance on the American Board of Surgery (ABS) Qualifying Exam (QE) correlates well with chief resident American Board of Surgery In-Training Exam (ABSITE) scores. Yearly ABSITE performance is a useful gauge of resident fund of knowledge and can identify residents at risk of QE failure. We hypothesize that a brief practice exam administered 1-3 times each academic year can identify residents at risk of poor ABSITE performance and also identify early in the chief resident year those at risk for poor QE performance. Methods: In 2005 we began administering 2-3 times/year an approximately 50 question exam consisting of questions authored by residents and edited by faculty based on the ABSITE exam keywords. The exam was considered mandatory and educational time was allotted. Data were analyzed by determining an individual's score deviation from the mean within PGY class. The standard deviation was then compared to the corresponding years ABSITE percentile and in the final year, QE performance using the Spearman rank correlation test. Results: A total of 710 individual practice exams were offered and 462 (65.1%) were completed in 9 sessions. Two hundred sixty-three residents completed both a practice examination and ABSITE in the year preceding the administration of the ABSITE. Twenty-six chief residents completed a practice examination in the year immediately preceding the ABS QE. Correlations between practice exam scores and ABSITE score percentile were statistically significant (p= 0.01-0.05) for each year the test was administered. The correlation between the practice exam score for chief residents preceding the QE and first attempt QE score was also significant (r =0.416, p<0.05). Conclusions: A resident's performance on a brief practice exam administered throughout the year is significantly correlated with both ABSITE performance and ABS QE performance. Such a test can be a useful adjunct for identifying residents at risk for poor ABSITE performance as well as identify prior to return of ABSITE scores those residents at risk for poor ABS QE performance.

KW - American Board of Surgery In-Training Exam (ABSITE)

KW - curriculum problem based learning

KW - qualifying examination

KW - resident remediation

KW - surgery training

KW - surgical education

UR - http://www.scopus.com/inward/record.url?scp=79953898723&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79953898723&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2010.12.009

DO - 10.1016/j.jsurg.2010.12.009

M3 - Article

C2 - 21481811

AN - SCOPUS:79953898723

VL - 68

SP - 246

EP - 249

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

IS - 3

ER -