Lack of grading agreement among international hemostasis external quality assessment programs

John D Olson, Ian Jennings, Piet Meijer, Chantal Bon, Roslyn Bonar, Emmanuel J. Favaloro, Russell Higgins, Michael Keeney, Joy Mammen, Richard A. Marlar, Roland Meley, Sukesh C. Nair, William L. Nichols, Anne Raby, Joan C. Reverter, Alok Srivastava, Isobel Walker

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.

Original languageEnglish (US)
Pages (from-to)111-119
Number of pages9
JournalBlood Coagulation and Fibrinolysis
Volume29
Issue number1
DOIs
StatePublished - Jan 1 2018

Fingerprint

Hemostasis
Partial Thromboplastin Time
Factor VIII
Internal-External Control
Quality Control
Thrombosis
Datasets

Keywords

  • Coagulation
  • External quality assessment
  • Hemostasis
  • Proficiency testing

ASJC Scopus subject areas

  • Hematology

Cite this

Olson, J. D., Jennings, I., Meijer, P., Bon, C., Bonar, R., Favaloro, E. J., ... Walker, I. (2018). Lack of grading agreement among international hemostasis external quality assessment programs. Blood Coagulation and Fibrinolysis, 29(1), 111-119. https://doi.org/10.1097/MBC.0000000000000690

Lack of grading agreement among international hemostasis external quality assessment programs. / Olson, John D; Jennings, Ian; Meijer, Piet; Bon, Chantal; Bonar, Roslyn; Favaloro, Emmanuel J.; Higgins, Russell; Keeney, Michael; Mammen, Joy; Marlar, Richard A.; Meley, Roland; Nair, Sukesh C.; Nichols, William L.; Raby, Anne; Reverter, Joan C.; Srivastava, Alok; Walker, Isobel.

In: Blood Coagulation and Fibrinolysis, Vol. 29, No. 1, 01.01.2018, p. 111-119.

Research output: Contribution to journalArticle

Olson, JD, Jennings, I, Meijer, P, Bon, C, Bonar, R, Favaloro, EJ, Higgins, R, Keeney, M, Mammen, J, Marlar, RA, Meley, R, Nair, SC, Nichols, WL, Raby, A, Reverter, JC, Srivastava, A & Walker, I 2018, 'Lack of grading agreement among international hemostasis external quality assessment programs', Blood Coagulation and Fibrinolysis, vol. 29, no. 1, pp. 111-119. https://doi.org/10.1097/MBC.0000000000000690
Olson, John D ; Jennings, Ian ; Meijer, Piet ; Bon, Chantal ; Bonar, Roslyn ; Favaloro, Emmanuel J. ; Higgins, Russell ; Keeney, Michael ; Mammen, Joy ; Marlar, Richard A. ; Meley, Roland ; Nair, Sukesh C. ; Nichols, William L. ; Raby, Anne ; Reverter, Joan C. ; Srivastava, Alok ; Walker, Isobel. / Lack of grading agreement among international hemostasis external quality assessment programs. In: Blood Coagulation and Fibrinolysis. 2018 ; Vol. 29, No. 1. pp. 111-119.
@article{7f126518ca3040ec9ce8e1aea6cffdfa,
title = "Lack of grading agreement among international hemostasis external quality assessment programs",
abstract = "Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11{\%} of normal and prolonged aPTT results, respectively, and 20.2 and 17.4{\%} of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.",
keywords = "Coagulation, External quality assessment, Hemostasis, Proficiency testing",
author = "Olson, {John D} and Ian Jennings and Piet Meijer and Chantal Bon and Roslyn Bonar and Favaloro, {Emmanuel J.} and Russell Higgins and Michael Keeney and Joy Mammen and Marlar, {Richard A.} and Roland Meley and Nair, {Sukesh C.} and Nichols, {William L.} and Anne Raby and Reverter, {Joan C.} and Alok Srivastava and Isobel Walker",
year = "2018",
month = "1",
day = "1",
doi = "10.1097/MBC.0000000000000690",
language = "English (US)",
volume = "29",
pages = "111--119",
journal = "Blood Coagulation and Fibrinolysis",
issn = "0957-5235",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - Lack of grading agreement among international hemostasis external quality assessment programs

AU - Olson, John D

AU - Jennings, Ian

AU - Meijer, Piet

AU - Bon, Chantal

AU - Bonar, Roslyn

AU - Favaloro, Emmanuel J.

AU - Higgins, Russell

AU - Keeney, Michael

AU - Mammen, Joy

AU - Marlar, Richard A.

AU - Meley, Roland

AU - Nair, Sukesh C.

AU - Nichols, William L.

AU - Raby, Anne

AU - Reverter, Joan C.

AU - Srivastava, Alok

AU - Walker, Isobel

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.

AB - Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.

KW - Coagulation

KW - External quality assessment

KW - Hemostasis

KW - Proficiency testing

UR - http://www.scopus.com/inward/record.url?scp=85041466685&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041466685&partnerID=8YFLogxK

U2 - 10.1097/MBC.0000000000000690

DO - 10.1097/MBC.0000000000000690

M3 - Article

C2 - 29232255

AN - SCOPUS:85041466685

VL - 29

SP - 111

EP - 119

JO - Blood Coagulation and Fibrinolysis

JF - Blood Coagulation and Fibrinolysis

SN - 0957-5235

IS - 1

ER -