The Facilitator Instrument for Team-Based Learning (FIT)

Ruth E. Levine, Peggy Hsieh, P. Adam Kelly, Lisa Carchedi, Jennifer Gibson, Paul Haidet, Paul Koles, Lindsey Pershern, Dawnelle Schatte, Brenda J Talley, Dwight Wolf, Britta Thompson

Research output: Contribution to journalArticle

Abstract

Construct: We sought to evaluate the quality of Team-Based Learning facilitation in both large and small group settings. Background: Team Based Learning (TBL) is an increasingly popular small group instructional strategy in health science education. TBL facilitation skills are unique and differ from those needed to lecture or facilitate other types of small groups. Measuring facilitation skills and providing feedback to TBL instructors is important, yet to date no valid instrument has been developed and published for this purpose. Approach: We created an 11-item instrument (ratings of each item on a 7-point scale) designed to assess TBL facilitation skills, considering major sources of validity. Twelve experts in TBL facilitation and training developed the content of the FIT. To ensure response processes were valid, we used an immediate retrospective probing technique with 4th year medical students who were not part of the study. The Facilitator Instrument for Team-Based Learning (FIT) was piloted with 2,840 medical students in 7 schools in large (year 1 and 2) and small (year 3) courses. The internal structure of the FIT was analyzed. Results: In total, 1,559 and 1,281 medical students in large and small TBL classes, respectively (response rate 88%) rated 33 TBL facilitators. The composite mean score for the FIT was 6.19 (SD = 1.10). Exploratory factor analysis and Cronbach’s alpha indicated that all items loaded on 1 factor, accounting for 77% of the item variance. Cronbach’s alpha for the 11 items was 0.97. Analysis of facilitator variables and course context indicated that FIT scores were statistically significantly correlated with type of class (pre-clinical or clinical) and size of class as well as the facilitator enjoyment in using TBL as a method. Gender and the amount that facilitators used TBL each year was weakly correlated, with other factors not correlated (years facilitating TBL, confidence in facilitating TBL, and age). Conclusions: Analysis of FIT scores from 2,840 medical students across multiple institutions and teaching settings suggests the utility of the FIT in determining the quality of TBL facilitation across a range of medical education settings. Future research is needed to further analyze course contexts and facilitator variables that may influence FIT scores with additional facilitators. Additionally, FIT scores should be correlated with additional measures of TBL facilitator quality, such as direct observations, especially if these data are used for summative decision-making purposes.

Original languageEnglish (US)
JournalTeaching and Learning in Medicine
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

learning
medical student
small group
health science
factor analysis
education
instructor
confidence
rating
expert
decision making
gender

Keywords

  • assessment
  • faculty development
  • TBL
  • Team-based learning

ASJC Scopus subject areas

  • Education

Cite this

Levine, R. E., Hsieh, P., Kelly, P. A., Carchedi, L., Gibson, J., Haidet, P., ... Thompson, B. (Accepted/In press). The Facilitator Instrument for Team-Based Learning (FIT). Teaching and Learning in Medicine. https://doi.org/10.1080/10401334.2019.1646653

The Facilitator Instrument for Team-Based Learning (FIT). / Levine, Ruth E.; Hsieh, Peggy; Kelly, P. Adam; Carchedi, Lisa; Gibson, Jennifer; Haidet, Paul; Koles, Paul; Pershern, Lindsey; Schatte, Dawnelle; Talley, Brenda J; Wolf, Dwight; Thompson, Britta.

In: Teaching and Learning in Medicine, 01.01.2019.

Research output: Contribution to journalArticle

Levine, RE, Hsieh, P, Kelly, PA, Carchedi, L, Gibson, J, Haidet, P, Koles, P, Pershern, L, Schatte, D, Talley, BJ, Wolf, D & Thompson, B 2019, 'The Facilitator Instrument for Team-Based Learning (FIT)', Teaching and Learning in Medicine. https://doi.org/10.1080/10401334.2019.1646653
Levine, Ruth E. ; Hsieh, Peggy ; Kelly, P. Adam ; Carchedi, Lisa ; Gibson, Jennifer ; Haidet, Paul ; Koles, Paul ; Pershern, Lindsey ; Schatte, Dawnelle ; Talley, Brenda J ; Wolf, Dwight ; Thompson, Britta. / The Facilitator Instrument for Team-Based Learning (FIT). In: Teaching and Learning in Medicine. 2019.
@article{379a709e516a4f8586fd232fb8b2789c,
title = "The Facilitator Instrument for Team-Based Learning (FIT)",
abstract = "Construct: We sought to evaluate the quality of Team-Based Learning facilitation in both large and small group settings. Background: Team Based Learning (TBL) is an increasingly popular small group instructional strategy in health science education. TBL facilitation skills are unique and differ from those needed to lecture or facilitate other types of small groups. Measuring facilitation skills and providing feedback to TBL instructors is important, yet to date no valid instrument has been developed and published for this purpose. Approach: We created an 11-item instrument (ratings of each item on a 7-point scale) designed to assess TBL facilitation skills, considering major sources of validity. Twelve experts in TBL facilitation and training developed the content of the FIT. To ensure response processes were valid, we used an immediate retrospective probing technique with 4th year medical students who were not part of the study. The Facilitator Instrument for Team-Based Learning (FIT) was piloted with 2,840 medical students in 7 schools in large (year 1 and 2) and small (year 3) courses. The internal structure of the FIT was analyzed. Results: In total, 1,559 and 1,281 medical students in large and small TBL classes, respectively (response rate 88{\%}) rated 33 TBL facilitators. The composite mean score for the FIT was 6.19 (SD = 1.10). Exploratory factor analysis and Cronbach’s alpha indicated that all items loaded on 1 factor, accounting for 77{\%} of the item variance. Cronbach’s alpha for the 11 items was 0.97. Analysis of facilitator variables and course context indicated that FIT scores were statistically significantly correlated with type of class (pre-clinical or clinical) and size of class as well as the facilitator enjoyment in using TBL as a method. Gender and the amount that facilitators used TBL each year was weakly correlated, with other factors not correlated (years facilitating TBL, confidence in facilitating TBL, and age). Conclusions: Analysis of FIT scores from 2,840 medical students across multiple institutions and teaching settings suggests the utility of the FIT in determining the quality of TBL facilitation across a range of medical education settings. Future research is needed to further analyze course contexts and facilitator variables that may influence FIT scores with additional facilitators. Additionally, FIT scores should be correlated with additional measures of TBL facilitator quality, such as direct observations, especially if these data are used for summative decision-making purposes.",
keywords = "assessment, faculty development, TBL, Team-based learning",
author = "Levine, {Ruth E.} and Peggy Hsieh and Kelly, {P. Adam} and Lisa Carchedi and Jennifer Gibson and Paul Haidet and Paul Koles and Lindsey Pershern and Dawnelle Schatte and Talley, {Brenda J} and Dwight Wolf and Britta Thompson",
year = "2019",
month = "1",
day = "1",
doi = "10.1080/10401334.2019.1646653",
language = "English (US)",
journal = "Teaching and Learning in Medicine",
issn = "1040-1334",
publisher = "Routledge",

}

TY - JOUR

T1 - The Facilitator Instrument for Team-Based Learning (FIT)

AU - Levine, Ruth E.

AU - Hsieh, Peggy

AU - Kelly, P. Adam

AU - Carchedi, Lisa

AU - Gibson, Jennifer

AU - Haidet, Paul

AU - Koles, Paul

AU - Pershern, Lindsey

AU - Schatte, Dawnelle

AU - Talley, Brenda J

AU - Wolf, Dwight

AU - Thompson, Britta

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Construct: We sought to evaluate the quality of Team-Based Learning facilitation in both large and small group settings. Background: Team Based Learning (TBL) is an increasingly popular small group instructional strategy in health science education. TBL facilitation skills are unique and differ from those needed to lecture or facilitate other types of small groups. Measuring facilitation skills and providing feedback to TBL instructors is important, yet to date no valid instrument has been developed and published for this purpose. Approach: We created an 11-item instrument (ratings of each item on a 7-point scale) designed to assess TBL facilitation skills, considering major sources of validity. Twelve experts in TBL facilitation and training developed the content of the FIT. To ensure response processes were valid, we used an immediate retrospective probing technique with 4th year medical students who were not part of the study. The Facilitator Instrument for Team-Based Learning (FIT) was piloted with 2,840 medical students in 7 schools in large (year 1 and 2) and small (year 3) courses. The internal structure of the FIT was analyzed. Results: In total, 1,559 and 1,281 medical students in large and small TBL classes, respectively (response rate 88%) rated 33 TBL facilitators. The composite mean score for the FIT was 6.19 (SD = 1.10). Exploratory factor analysis and Cronbach’s alpha indicated that all items loaded on 1 factor, accounting for 77% of the item variance. Cronbach’s alpha for the 11 items was 0.97. Analysis of facilitator variables and course context indicated that FIT scores were statistically significantly correlated with type of class (pre-clinical or clinical) and size of class as well as the facilitator enjoyment in using TBL as a method. Gender and the amount that facilitators used TBL each year was weakly correlated, with other factors not correlated (years facilitating TBL, confidence in facilitating TBL, and age). Conclusions: Analysis of FIT scores from 2,840 medical students across multiple institutions and teaching settings suggests the utility of the FIT in determining the quality of TBL facilitation across a range of medical education settings. Future research is needed to further analyze course contexts and facilitator variables that may influence FIT scores with additional facilitators. Additionally, FIT scores should be correlated with additional measures of TBL facilitator quality, such as direct observations, especially if these data are used for summative decision-making purposes.

AB - Construct: We sought to evaluate the quality of Team-Based Learning facilitation in both large and small group settings. Background: Team Based Learning (TBL) is an increasingly popular small group instructional strategy in health science education. TBL facilitation skills are unique and differ from those needed to lecture or facilitate other types of small groups. Measuring facilitation skills and providing feedback to TBL instructors is important, yet to date no valid instrument has been developed and published for this purpose. Approach: We created an 11-item instrument (ratings of each item on a 7-point scale) designed to assess TBL facilitation skills, considering major sources of validity. Twelve experts in TBL facilitation and training developed the content of the FIT. To ensure response processes were valid, we used an immediate retrospective probing technique with 4th year medical students who were not part of the study. The Facilitator Instrument for Team-Based Learning (FIT) was piloted with 2,840 medical students in 7 schools in large (year 1 and 2) and small (year 3) courses. The internal structure of the FIT was analyzed. Results: In total, 1,559 and 1,281 medical students in large and small TBL classes, respectively (response rate 88%) rated 33 TBL facilitators. The composite mean score for the FIT was 6.19 (SD = 1.10). Exploratory factor analysis and Cronbach’s alpha indicated that all items loaded on 1 factor, accounting for 77% of the item variance. Cronbach’s alpha for the 11 items was 0.97. Analysis of facilitator variables and course context indicated that FIT scores were statistically significantly correlated with type of class (pre-clinical or clinical) and size of class as well as the facilitator enjoyment in using TBL as a method. Gender and the amount that facilitators used TBL each year was weakly correlated, with other factors not correlated (years facilitating TBL, confidence in facilitating TBL, and age). Conclusions: Analysis of FIT scores from 2,840 medical students across multiple institutions and teaching settings suggests the utility of the FIT in determining the quality of TBL facilitation across a range of medical education settings. Future research is needed to further analyze course contexts and facilitator variables that may influence FIT scores with additional facilitators. Additionally, FIT scores should be correlated with additional measures of TBL facilitator quality, such as direct observations, especially if these data are used for summative decision-making purposes.

KW - assessment

KW - faculty development

KW - TBL

KW - Team-based learning

UR - http://www.scopus.com/inward/record.url?scp=85070516826&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070516826&partnerID=8YFLogxK

U2 - 10.1080/10401334.2019.1646653

DO - 10.1080/10401334.2019.1646653

M3 - Article

JO - Teaching and Learning in Medicine

JF - Teaching and Learning in Medicine

SN - 1040-1334

ER -