Proficiency-based preparation significantly improves FES certification performance

Angela A. Guzzetta, Joshua J. Weis, Sara A. Hennessy, Ross Willis, Victor Wilcox, Brian J. Dunkin, Deborah C. Hogg, Daniel J. Scott

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: The Fundamentals of Endoscopic Surgery (FES) certification has recently been mandated by the American Board of Surgery but best methods for preparing for the exam are lacking. Our previous work demonstrated a 40% pass rate for PGY5 residents in our program. The purpose of this study was to determine the effectiveness of a proficiency-based skills and cognitive curriculum for FES certification. Methods: Residents who agreed to participate (n = 15) underwent an orientation session, followed by skills pre-testing using three previously described models (Trus, Operation targeting task, and Kyoto) as well as the actual FES skills exam (vouchers provided by the FES committee). Participants then trained to proficiency on all three models for the skills curriculum and completed the FES online didactic material for the cognitive curriculum. Finally, participants post-tested on the models and took the actual FES certification exam. Values are mean ± SD; p < 0.05 was considered significant. Results: Of 15 residents who participated, 8 (53%) passed the FES skills exam at baseline. Participants required 2.7 ± 1.3 h to achieve proficiency on the models and approximately 3 h to complete the cognitive curriculum. At post-test, 14 (93%, vs. pre-test 53%, p = 0.041) passed the FES skills exam. 14 (93%) passed the FES cognitive exam and 13/15 (87%) passed both the skills and cognitive exam and achieved FES certification. Conclusions: Our traditional clinical endoscopy curricula were not sufficient for senior residents to pass the FES exam. Implementation of a proficiency-based flexible endoscopy curriculum using bench-top models and the FES online materials was feasible and effective for the majority of learners. Importantly, with a modest amount of additional training, 87% of our trainees were able to pass the FES examination, which represents a significant improvement for our program. We expect that additional refinements of this curriculum may yield even better results for preparing future residents for the FES examination.

Original languageEnglish (US)
Pages (from-to)4451-4457
Number of pages7
JournalSurgical Endoscopy
Volume32
Issue number11
DOIs
StatePublished - Nov 1 2018

Fingerprint

Certification
Curriculum
Endoscopy

Keywords

  • Endoscopy simulation
  • FES
  • Fundamentals of Endoscopic Surgery
  • Resident endoscopy training

ASJC Scopus subject areas

  • Surgery

Cite this

Guzzetta, A. A., Weis, J. J., Hennessy, S. A., Willis, R., Wilcox, V., Dunkin, B. J., ... Scott, D. J. (2018). Proficiency-based preparation significantly improves FES certification performance. Surgical Endoscopy, 32(11), 4451-4457. https://doi.org/10.1007/s00464-018-6190-4

Proficiency-based preparation significantly improves FES certification performance. / Guzzetta, Angela A.; Weis, Joshua J.; Hennessy, Sara A.; Willis, Ross; Wilcox, Victor; Dunkin, Brian J.; Hogg, Deborah C.; Scott, Daniel J.

In: Surgical Endoscopy, Vol. 32, No. 11, 01.11.2018, p. 4451-4457.

Research output: Contribution to journalArticle

Guzzetta, AA, Weis, JJ, Hennessy, SA, Willis, R, Wilcox, V, Dunkin, BJ, Hogg, DC & Scott, DJ 2018, 'Proficiency-based preparation significantly improves FES certification performance', Surgical Endoscopy, vol. 32, no. 11, pp. 4451-4457. https://doi.org/10.1007/s00464-018-6190-4
Guzzetta AA, Weis JJ, Hennessy SA, Willis R, Wilcox V, Dunkin BJ et al. Proficiency-based preparation significantly improves FES certification performance. Surgical Endoscopy. 2018 Nov 1;32(11):4451-4457. https://doi.org/10.1007/s00464-018-6190-4
Guzzetta, Angela A. ; Weis, Joshua J. ; Hennessy, Sara A. ; Willis, Ross ; Wilcox, Victor ; Dunkin, Brian J. ; Hogg, Deborah C. ; Scott, Daniel J. / Proficiency-based preparation significantly improves FES certification performance. In: Surgical Endoscopy. 2018 ; Vol. 32, No. 11. pp. 4451-4457.
@article{ef2dd6c7e7cc4f9cbeb53e112718998e,
title = "Proficiency-based preparation significantly improves FES certification performance",
abstract = "Background: The Fundamentals of Endoscopic Surgery (FES) certification has recently been mandated by the American Board of Surgery but best methods for preparing for the exam are lacking. Our previous work demonstrated a 40{\%} pass rate for PGY5 residents in our program. The purpose of this study was to determine the effectiveness of a proficiency-based skills and cognitive curriculum for FES certification. Methods: Residents who agreed to participate (n = 15) underwent an orientation session, followed by skills pre-testing using three previously described models (Trus, Operation targeting task, and Kyoto) as well as the actual FES skills exam (vouchers provided by the FES committee). Participants then trained to proficiency on all three models for the skills curriculum and completed the FES online didactic material for the cognitive curriculum. Finally, participants post-tested on the models and took the actual FES certification exam. Values are mean ± SD; p < 0.05 was considered significant. Results: Of 15 residents who participated, 8 (53{\%}) passed the FES skills exam at baseline. Participants required 2.7 ± 1.3 h to achieve proficiency on the models and approximately 3 h to complete the cognitive curriculum. At post-test, 14 (93{\%}, vs. pre-test 53{\%}, p = 0.041) passed the FES skills exam. 14 (93{\%}) passed the FES cognitive exam and 13/15 (87{\%}) passed both the skills and cognitive exam and achieved FES certification. Conclusions: Our traditional clinical endoscopy curricula were not sufficient for senior residents to pass the FES exam. Implementation of a proficiency-based flexible endoscopy curriculum using bench-top models and the FES online materials was feasible and effective for the majority of learners. Importantly, with a modest amount of additional training, 87{\%} of our trainees were able to pass the FES examination, which represents a significant improvement for our program. We expect that additional refinements of this curriculum may yield even better results for preparing future residents for the FES examination.",
keywords = "Endoscopy simulation, FES, Fundamentals of Endoscopic Surgery, Resident endoscopy training",
author = "Guzzetta, {Angela A.} and Weis, {Joshua J.} and Hennessy, {Sara A.} and Ross Willis and Victor Wilcox and Dunkin, {Brian J.} and Hogg, {Deborah C.} and Scott, {Daniel J.}",
year = "2018",
month = "11",
day = "1",
doi = "10.1007/s00464-018-6190-4",
language = "English (US)",
volume = "32",
pages = "4451--4457",
journal = "Surgical Endoscopy and Other Interventional Techniques",
issn = "0930-2794",
publisher = "Springer New York",
number = "11",

}

TY - JOUR

T1 - Proficiency-based preparation significantly improves FES certification performance

AU - Guzzetta, Angela A.

AU - Weis, Joshua J.

AU - Hennessy, Sara A.

AU - Willis, Ross

AU - Wilcox, Victor

AU - Dunkin, Brian J.

AU - Hogg, Deborah C.

AU - Scott, Daniel J.

PY - 2018/11/1

Y1 - 2018/11/1

N2 - Background: The Fundamentals of Endoscopic Surgery (FES) certification has recently been mandated by the American Board of Surgery but best methods for preparing for the exam are lacking. Our previous work demonstrated a 40% pass rate for PGY5 residents in our program. The purpose of this study was to determine the effectiveness of a proficiency-based skills and cognitive curriculum for FES certification. Methods: Residents who agreed to participate (n = 15) underwent an orientation session, followed by skills pre-testing using three previously described models (Trus, Operation targeting task, and Kyoto) as well as the actual FES skills exam (vouchers provided by the FES committee). Participants then trained to proficiency on all three models for the skills curriculum and completed the FES online didactic material for the cognitive curriculum. Finally, participants post-tested on the models and took the actual FES certification exam. Values are mean ± SD; p < 0.05 was considered significant. Results: Of 15 residents who participated, 8 (53%) passed the FES skills exam at baseline. Participants required 2.7 ± 1.3 h to achieve proficiency on the models and approximately 3 h to complete the cognitive curriculum. At post-test, 14 (93%, vs. pre-test 53%, p = 0.041) passed the FES skills exam. 14 (93%) passed the FES cognitive exam and 13/15 (87%) passed both the skills and cognitive exam and achieved FES certification. Conclusions: Our traditional clinical endoscopy curricula were not sufficient for senior residents to pass the FES exam. Implementation of a proficiency-based flexible endoscopy curriculum using bench-top models and the FES online materials was feasible and effective for the majority of learners. Importantly, with a modest amount of additional training, 87% of our trainees were able to pass the FES examination, which represents a significant improvement for our program. We expect that additional refinements of this curriculum may yield even better results for preparing future residents for the FES examination.

AB - Background: The Fundamentals of Endoscopic Surgery (FES) certification has recently been mandated by the American Board of Surgery but best methods for preparing for the exam are lacking. Our previous work demonstrated a 40% pass rate for PGY5 residents in our program. The purpose of this study was to determine the effectiveness of a proficiency-based skills and cognitive curriculum for FES certification. Methods: Residents who agreed to participate (n = 15) underwent an orientation session, followed by skills pre-testing using three previously described models (Trus, Operation targeting task, and Kyoto) as well as the actual FES skills exam (vouchers provided by the FES committee). Participants then trained to proficiency on all three models for the skills curriculum and completed the FES online didactic material for the cognitive curriculum. Finally, participants post-tested on the models and took the actual FES certification exam. Values are mean ± SD; p < 0.05 was considered significant. Results: Of 15 residents who participated, 8 (53%) passed the FES skills exam at baseline. Participants required 2.7 ± 1.3 h to achieve proficiency on the models and approximately 3 h to complete the cognitive curriculum. At post-test, 14 (93%, vs. pre-test 53%, p = 0.041) passed the FES skills exam. 14 (93%) passed the FES cognitive exam and 13/15 (87%) passed both the skills and cognitive exam and achieved FES certification. Conclusions: Our traditional clinical endoscopy curricula were not sufficient for senior residents to pass the FES exam. Implementation of a proficiency-based flexible endoscopy curriculum using bench-top models and the FES online materials was feasible and effective for the majority of learners. Importantly, with a modest amount of additional training, 87% of our trainees were able to pass the FES examination, which represents a significant improvement for our program. We expect that additional refinements of this curriculum may yield even better results for preparing future residents for the FES examination.

KW - Endoscopy simulation

KW - FES

KW - Fundamentals of Endoscopic Surgery

KW - Resident endoscopy training

UR - http://www.scopus.com/inward/record.url?scp=85054100863&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054100863&partnerID=8YFLogxK

U2 - 10.1007/s00464-018-6190-4

DO - 10.1007/s00464-018-6190-4

M3 - Article

C2 - 29644467

AN - SCOPUS:85054100863

VL - 32

SP - 4451

EP - 4457

JO - Surgical Endoscopy and Other Interventional Techniques

JF - Surgical Endoscopy and Other Interventional Techniques

SN - 0930-2794

IS - 11

ER -