Development and Validation of a Family Meeting Assessment Tool (FMAT)

Yuya Hagiwara, Jennifer Healy, Shuko Lee, Jeanette Ross, Dixie Fischer, Sandra E Sanchez-reilly

Research output: Contribution to journalArticle

Abstract

Context A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Objectives Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Methods Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. Results A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Conclusion Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool.

Original languageEnglish (US)
Pages (from-to)89-93
Number of pages5
JournalJournal of Pain and Symptom Management
Volume55
Issue number1
DOIs
StatePublished - Jan 1 2018

Fingerprint

Geriatrics
Aptitude
Medical Students
Physician's Role
Practice Guidelines
Patient Care
Learning
Guidelines
Students
Physicians
Palliative Medicine
Lead

Keywords

  • communication
  • family meetings
  • goals of care
  • medical education
  • Objective structured clinical examination
  • palliative care
  • undergraduate medical education

ASJC Scopus subject areas

  • Nursing(all)
  • Clinical Neurology
  • Anesthesiology and Pain Medicine

Cite this

Hagiwara, Y., Healy, J., Lee, S., Ross, J., Fischer, D., & Sanchez-reilly, S. E. (2018). Development and Validation of a Family Meeting Assessment Tool (FMAT). Journal of Pain and Symptom Management, 55(1), 89-93. https://doi.org/10.1016/j.jpainsymman.2017.07.048

Development and Validation of a Family Meeting Assessment Tool (FMAT). / Hagiwara, Yuya; Healy, Jennifer; Lee, Shuko; Ross, Jeanette; Fischer, Dixie; Sanchez-reilly, Sandra E.

In: Journal of Pain and Symptom Management, Vol. 55, No. 1, 01.01.2018, p. 89-93.

Research output: Contribution to journalArticle

Hagiwara, Y, Healy, J, Lee, S, Ross, J, Fischer, D & Sanchez-reilly, SE 2018, 'Development and Validation of a Family Meeting Assessment Tool (FMAT)', Journal of Pain and Symptom Management, vol. 55, no. 1, pp. 89-93. https://doi.org/10.1016/j.jpainsymman.2017.07.048
Hagiwara, Yuya ; Healy, Jennifer ; Lee, Shuko ; Ross, Jeanette ; Fischer, Dixie ; Sanchez-reilly, Sandra E. / Development and Validation of a Family Meeting Assessment Tool (FMAT). In: Journal of Pain and Symptom Management. 2018 ; Vol. 55, No. 1. pp. 89-93.
@article{6dd6ac9fd50a42568c1b327dc44e8208,
title = "Development and Validation of a Family Meeting Assessment Tool (FMAT)",
abstract = "Context A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Objectives Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Methods Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. Results A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84{\%}. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Conclusion Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool.",
keywords = "communication, family meetings, goals of care, medical education, Objective structured clinical examination, palliative care, undergraduate medical education",
author = "Yuya Hagiwara and Jennifer Healy and Shuko Lee and Jeanette Ross and Dixie Fischer and Sanchez-reilly, {Sandra E}",
year = "2018",
month = "1",
day = "1",
doi = "10.1016/j.jpainsymman.2017.07.048",
language = "English (US)",
volume = "55",
pages = "89--93",
journal = "Journal of Pain and Symptom Management",
issn = "0885-3924",
publisher = "Elsevier Inc.",
number = "1",

}

TY - JOUR

T1 - Development and Validation of a Family Meeting Assessment Tool (FMAT)

AU - Hagiwara, Yuya

AU - Healy, Jennifer

AU - Lee, Shuko

AU - Ross, Jeanette

AU - Fischer, Dixie

AU - Sanchez-reilly, Sandra E

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Context A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Objectives Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Methods Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. Results A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Conclusion Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool.

AB - Context A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Objectives Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Methods Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. Results A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Conclusion Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool.

KW - communication

KW - family meetings

KW - goals of care

KW - medical education

KW - Objective structured clinical examination

KW - palliative care

KW - undergraduate medical education

UR - http://www.scopus.com/inward/record.url?scp=85034443149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034443149&partnerID=8YFLogxK

U2 - 10.1016/j.jpainsymman.2017.07.048

DO - 10.1016/j.jpainsymman.2017.07.048

M3 - Article

C2 - 28843457

AN - SCOPUS:85034443149

VL - 55

SP - 89

EP - 93

JO - Journal of Pain and Symptom Management

JF - Journal of Pain and Symptom Management

SN - 0885-3924

IS - 1

ER -