TY - JOUR
T1 - Discrimination of GutCheck NEC
T2 - A clinical risk index for necrotizing enterocolitis
AU - Gephart, S. M.
AU - Spitzer, A. R.
AU - Effken, J. A.
AU - Dodd, E.
AU - Halpern, M.
AU - McGrath, J. M.
N1 - Funding Information:
Research was supported by the National Institute of Nursing Research (F31NR012333-A1) and the Friends of Yuma. Content is the sole responsibility of the authors and does not necessarily represent the official views of the National Institute of Nursing Research or the National Institutes of Health. We thank Dr Reece Clark for his comments on the initial manuscript; Dr Paula Meek for her advice related to data analysis; and Drs Pamela Reed and Elaine Jones for participating on the first author’s dissertation committee.
PY - 2014/6
Y1 - 2014/6
N2 - Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95% confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95% CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95% CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.
AB - Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95% confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95% CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95% CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.
UR - http://www.scopus.com/inward/record.url?scp=84901805887&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84901805887&partnerID=8YFLogxK
U2 - 10.1038/jp.2014.37
DO - 10.1038/jp.2014.37
M3 - Article
C2 - 24651734
AN - SCOPUS:84901805887
SN - 0743-8346
VL - 34
SP - 468
EP - 475
JO - Journal of Perinatology
JF - Journal of Perinatology
IS - 6
ER -