TY - JOUR
T1 - Cadaveric Biomechanical Laboratory Research Can Be Quantitatively Scored for Quality With the Biomechanics Objective Basic Science Quality Assessment Tool
T2 - The BOBQAT Score
AU - Hohmann, Erik
AU - Paschos, Nikolaos
AU - Keough, Natalie
AU - Erbulut, Deniz
AU - Oberholster, Abrie
AU - Glatt, Vaida
AU - Molepo, Maketo
AU - Tetsworth, Kevin
N1 - Publisher Copyright:
© 2024 Arthroscopy Association of North America
PY - 2024/8
Y1 - 2024/8
N2 - Purpose: To develop a quality appraisal tool for the assessment of cadaveric biomechanical laboratory and other basic science biomechanical studies. Methods: For item identification and development, a systematic review of the literature was performed. The content validity index (CVI) was used either to include or exclude items. The content validity ratio (CVR) was used to determine content validity. Weighting was performed by each panel member; the final weight was either up- or downgraded to the closest of 5% or 10%. Face validity was scored on a Likert scale ranked from 1 to 7. Test-retest reliability was determined using the Fleiss kappa coefficient. Internal consistency was assessed with Cronbach's alpha. Concurrent criterion validity was assessed against the Quality Appraisal for Cadaveric Studies scale. Results: The final Biomechanics Objective Basic science Quality Assessment Tool (BOBQAT) score included 15 items and was shown to be valid, reliable, and consistent. Five items had a CVI of 1.0; 10 items had a CVI of 0.875. For weighting, 5 items received a weight of 10%, and 10 items a weight of 5%. CVR was 1.0 for 6 items and 0.75 for 9 items. For face validity, all items achieved a score above 5. For test-retest reliability, almost-perfect test-retest reliability was observed for 10 items, substantial agreement for 4 items, and moderate agreement for 1 item. For internal consistency, Cronbach's alpha was calculated to be 0.71. For concurrent criterion validity, Pearson's product-moment correlation was 0.56 (95% confidence interval [CI] = 0.38-0.70, P = .0001). Conclusions: Cadaveric biomechanical and laboratory research can be quantitatively scored for quality based on the inclusion of a clear and answerable purpose, demographics, specimen condition, appropriate bone density, reproducible technique, appropriate outcome measures, appropriate loading conditions, appropriate load magnitude, cyclic loading, sample size calculation, proper statistical analysis, results consistent with methods, limitations considered, conclusions based on results, and disclosure of funding and potential conflicts. Clinical Relevance: Study quality assessments are important to evaluate internal and external validity and reliability and to identify methodological flaws and misleading conclusions. The BOBQAT score will help not only in the critical appraisal of cadaveric biomechanical studies but also in guiding the designs of such research endeavors.
AB - Purpose: To develop a quality appraisal tool for the assessment of cadaveric biomechanical laboratory and other basic science biomechanical studies. Methods: For item identification and development, a systematic review of the literature was performed. The content validity index (CVI) was used either to include or exclude items. The content validity ratio (CVR) was used to determine content validity. Weighting was performed by each panel member; the final weight was either up- or downgraded to the closest of 5% or 10%. Face validity was scored on a Likert scale ranked from 1 to 7. Test-retest reliability was determined using the Fleiss kappa coefficient. Internal consistency was assessed with Cronbach's alpha. Concurrent criterion validity was assessed against the Quality Appraisal for Cadaveric Studies scale. Results: The final Biomechanics Objective Basic science Quality Assessment Tool (BOBQAT) score included 15 items and was shown to be valid, reliable, and consistent. Five items had a CVI of 1.0; 10 items had a CVI of 0.875. For weighting, 5 items received a weight of 10%, and 10 items a weight of 5%. CVR was 1.0 for 6 items and 0.75 for 9 items. For face validity, all items achieved a score above 5. For test-retest reliability, almost-perfect test-retest reliability was observed for 10 items, substantial agreement for 4 items, and moderate agreement for 1 item. For internal consistency, Cronbach's alpha was calculated to be 0.71. For concurrent criterion validity, Pearson's product-moment correlation was 0.56 (95% confidence interval [CI] = 0.38-0.70, P = .0001). Conclusions: Cadaveric biomechanical and laboratory research can be quantitatively scored for quality based on the inclusion of a clear and answerable purpose, demographics, specimen condition, appropriate bone density, reproducible technique, appropriate outcome measures, appropriate loading conditions, appropriate load magnitude, cyclic loading, sample size calculation, proper statistical analysis, results consistent with methods, limitations considered, conclusions based on results, and disclosure of funding and potential conflicts. Clinical Relevance: Study quality assessments are important to evaluate internal and external validity and reliability and to identify methodological flaws and misleading conclusions. The BOBQAT score will help not only in the critical appraisal of cadaveric biomechanical studies but also in guiding the designs of such research endeavors.
UR - http://www.scopus.com/inward/record.url?scp=85184605208&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85184605208&partnerID=8YFLogxK
U2 - 10.1016/j.arthro.2024.01.003
DO - 10.1016/j.arthro.2024.01.003
M3 - Article
C2 - 38185184
AN - SCOPUS:85184605208
SN - 0749-8063
VL - 40
SP - 2263-2272.e1
JO - Arthroscopy - Journal of Arthroscopic and Related Surgery
JF - Arthroscopy - Journal of Arthroscopic and Related Surgery
IS - 8
ER -