Abstract
Background
Respiratory support is crucial for newborns with underdeveloped lung. The clinical outcomes of patients depend on the clinician’s ability to recognize the status underlying the presented symptoms and signs. With the increasing number of high-risk infants, artificial intelligence (AI) should be considered as a tool for personalized neonatal care. Continuous monitoring of vital signs is essential in cardiorespiratory care. In this study, we developed deep learning (DL) prediction models for rapid and accurate detection of mechanical ventilation requirements in neonates using electronic health records (EHR).
Methods
We utilized data from the neonatal intensive care unit in a single center, collected between March 3, 2012, and March 4, 2022, including 1,394 patient records used for model development, consisting of 505 and 889 patients with and without invasive mechanical ventilation (IMV) support, respectively. The proposed model architecture includes feature embedding using feature-wise fully connected (FC) layers, followed by three bidirectional long short-term memory (LSTM) layers.
Results
A mean gestational age (GA) was 36.61 ± 3.25 weeks, and the mean birth weight was 2,734.01 ± 784.98 g. The IMV group had lower GA, birth weight, and longer hospitalization duration than the non-IMV group (P < 0.05). Our proposed model, tested on a dataset from March 4, 2019, to March 4, 2022. The mean AUROC of our proposed model for IMV support prediction performance demonstrated 0.861 (95%CI, 0.853–0.869). It is superior to conventional approaches, such as newborn early warning score systems (NEWS), Random Forest, and eXtreme gradient boosting (XGBoost) with 0.611 (95%CI, 0.600–0.622), 0.837 (95%CI, 0.828–0.845), and 0.0.831 (95%CI, 0.821–0.845), respectively. The highest AUPRC value is shown in the proposed model at 0.327 (95%CI, 0.308–0.347). The proposed model performed more accurate predictions as gestational age decreased. Additionally, the model exhibited the lowest alarm rate while maintaining the same sensitivity level.
Conclusion
Deep learning approaches can help accurately standardize the prediction of invasive mechanical ventilation for neonatal patients and facilitate advanced neonatal care. The results of predictive, recall, and alarm performances of the proposed model outperformed the other models.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Background
Adaptation to the extra-uterine environment is critical for the survival of neonates, and respiratory support is crucial in the neonatal intensive care unit (NICU). Particularly in preterm infants, lung immaturity can cause respiratory failure (RF) [1]. Every patient has various etiologies, symptoms, and progression of lung disease and different types of respiratory support devices used for treatment [2]. In the case of severe RF in neonates, invasive mechanical ventilation has been considered a life-saving treatment [1, 2]. The administration of therapies such as surfactant replacement or corticosteroids differs between NICUs depending on the physician’s experience [3]. Similarly, decisions regarding invasive mechanical ventilation (IMV) use also differ. The clinical outcomes of patients depend on the clinician’s ability to recognize the underlying status of the presented symptoms and signs. Multiple factors influence RF; therefore, accurately identifying neonates at risk for developing RF is a significant challenge for clinicians. Despite clinical advances, newborn morbidity and mortality remain high globally [4].
NICUs continuously monitor the physiological parameters of neonates, and physicians are confronted with plenty of data from many patients stored in electronic health records (EHR). Identifying the most important information required to make care decisions has become increasingly difficult. Furthermore, false-positive alarms can occasionally lead to alarm fatigue, negatively influencing clinicians [5]. The limited ability of humans to process such an enormous amount of data can lead to information overload. Thus, Artificial intelligence (AI) has begun to penetrate the healthcare systems in the NICU [6,7,8,9,10]. AI techniques have been developed over the past few decades [11]. These techniques range from traditional machine learning (ML) classifiers, such as eXtreme gradient boosting (XGBoost), Random Forest, support vector machine (SVM), and linear discriminant analysis (LDA), to deep learning (DL) models, such as artificial neural networks (ANN), convolutional neural networks (CNN), and long short-term models (LSTM) [12]. DL techniques help analyze complex signals with vast amounts of information [13]. Establishing high-quality, valuable, and multidimensional neonatal datasets can provide accurate prediction models. With the increasing number of high-risk infants, AI should be considered as a tool for personalized neonatal care; however, it is not widely used for newborns, and there are only a few DL studies related to neonatal lung disease [10]. Recent studies have investigated the potential of ML in predicting a wide range of neonatal outcomes, including sepsis, morbidity, retinopathy of preterm birth, and neural development [14,15,16,17].
This study sought to develop DL prediction models for the swift and precise detection of mechanical ventilation requirements in neonates using EHR. Moreover, our goal was to create a DL model that can be applied across all hospital tiers using data obtained non-invasively.
Materials and methods
Study design and participants
As shown in Fig. 1, the data used in this study were collected from the NICU of Pusan National University Yangsan Hospital in Korea from March 3, 2012, to March 4, 2022. During this period, data from 1,495 patient data were collected. Three patients discharged before admission and 59 patients with a data record of less than 8 h were excluded from the dataset. In addition, 27 patients who were intubated at admission and 12 patients who had no record for 8 h prior to its occurrence were excluded from the experiment because the model predicted the timing of intubation 8 h in advance. Finally, the data used for the model development consisted of 1,394 patients, including 505 patients in the IMV group and 889 patients who were not.
Risk factor selection
The factors learned by this model are widely used risk factors important for predicting IMV support in neonates [1, 18, 19]. These factors are mainly composed of demographic characteristics and vital data, which can be obtained in a non-invasive manner and are essential for measurement in most NICUs from primary to tertiary hospitals, including gestational age (GA), birth weight, height, head and chest circumference, sex, delivery mode, maternal history, blood pressure (BP), heart rate (HR), pulse rate (PR), respiratory rate (RR), body temperature (BT), and total input and output.
Annotation process
In this study, IMV was defined as occurring in the following two situations based on patient data:
-
Insertion or reinsertion of an endotracheal tube
-
Use of a ventilator
Additionally, because the purpose of this model was to predict intubation 8 h in advance, events up to 8 h prior to the occurrence of intubation were labeled as events in the dataset. We directly annotated the intubation date and time based on the text-type nursing records. Referring to the nursing record, “Intubation was performed,” preprocessing was performed to determine what text meant the application of IMV.
The proposed approach
Data preprocessing
Figure 2 illustrates several data preprocessing techniques, such as artifact removal, forward filling, and data normalization, used in the study. Experimental sciences utilize a theoretical model to represent real-world phenomena, and within particle physics, applying a “5 sigma” criterion is conventional when announcing a discovery. Therefore, any data points not included within the 5-sigma range were deemed anomalies and treated as artifacts, and were thus excluded from the analysis. EHR data often contain missing values that can interfere with the development of AI models. To address this issue, data imputation is commonly used and can effectively improve the quality of the data and enhance the performance of the model [20]. This study used the forward-fill method as the primary imputation method. If no previous data were available, the global median values of the features were inserted. Lastly, data normalization was performed for each feature.
Sequence windowing
Incorporating information from adjacent records can be beneficial and is commonly employed when training with EHR data and learning from records. Therefore, in this experiment, we used a window of 60 records for training. We also considered additional factors, such as the measurement time of each record, the time difference between consecutive measurements, and the variation in values between the previous measurement factors (Additional file 1: Fig. 1).
Data resampling
The class imbalance problem is widely recognized as a significant challenge when training AI models; our NICU data is no exception in this regard. The number of EHRs of 1,394 patients used in the model development was 216,490. Of these, EHRs for IMV accounted for only approximately 3.39% (7,329). We used a data resampling technique to address the problem [21]. Ideally, there would be a 1:1 ratio between event data and normal data. However, in such cases, the number of normal data instances involved in the training process might decrease, leading to potential trade-offs. In our optimization experiments, we introduced the normal-event ratio as a hyperparameter and compared the results to address this issue. The search space for the normal-event ratio was set to 1:1, 2:1, and 4:1. Upon evaluation, the 4:1 ratio demonstrated the best performance; thus, the 4:1 ratio was used.
Model training and validation
Model development
The training, validation, and test datasets were set from March 4, 2012 to March 3, 2016, from March 4, 2016 to March 3, 2019, from March 4, 2019 to March 3, 2022, respectively. Considering the data distribution shift, we validated data from a time close to the test set rather than using cross-validation. The proposed model architecture is as follows (Additional file 1: Table 2). First, feature embedding based on feature-wise fully connected (FC) layers was performed, which was then input into three bidirectional LSTM layers [22]. After passing through the five FC layers, the final RF risk score was obtained using softmax. The detailed model architecture has been described in the Additional file 1: Table 2. Hyperparameter tuning was performed using the random-search method, with experiments conducted over 100 times [23]. For regularization, dropout was applied. The hyperparameter tuning results indicated that the optimal dropout ratio was 0.6 for the FC layer and 0.3 for the LSTM layer without regularizers. The AdamW optimizer was used during model training, and binary cross-entropy was used as the loss function [24, 25].
Comparison with existing methods
In this study, we compared the proposed model with the following methods: First, we used the newborn early warning score system (NEWS), which has been used in clinical settings, and an ML algorithm-based method that has been widely used because of its good performance [26, 27]. For the ML-based method, we used Random Forest for the decision tree series and XGBoost for the boosting series using the same input feature as the proposed model [28, 29]. Additionally, the definition of RF depends on the availability of PaO2 and FiO2. Continuous monitoring of pulse oximetry-derived hemoglobin oxygen saturation (SpO2) can be utilized in the clinical setting to estimate the present value of PaO2 [30, 31]. From this perspective, RF can be predicted solely by using SpO2 and FiO2. Therefore, we compared XGBoost using only two features: SpO2 and FiO2 [32].
Evaluation methods
To compare predictive performance, we used the area under the receiver operating characteristic (AUROC) and the area under the precision-recall curve (AUPRC) metrics and compared the sensitivity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (LHR)+, and negative likelihood ratio (LHR-) at the same specificity as the NEWS value. To compare the alarm performance, we calculated the mean alarm count per day (MACPD) per 100 beds and calculated MACPD at the same sensitivity for all methods.
Software
EHR entries were extracted and pre-processed using the NumPy (version 1.20.3) and Pandas (version 1.5.2) libraries of the Python programming language, specifically version 3.8.13 (Python Software Foundation, Fredericksburg, VA, USA). Statistical analyses between groups were performed using the SciPy package version 1.10.0. Random Forest was implemented during model training using Scikit-learn (Scikit-learn Contributors, version 1.2.0). The XGB algorithm was applied using the XGBoost package (version 1.7.3). The evaluation was conducted using the Scikit-learn package along with the Shapley Additive exPlanations (SHAP) values (version 0.41.0).
Results
Baseline characteristics
A total of 1,394 neonatal patients were included in this study, with a mean GA of 36.61±3.25 weeks (Table 1). The mean birth weight and height were 2,734.01 ± 784.98 g and 46.93±4.33 cm, respectively. Intrauterine growth restriction (IUGR) in the 10th percentile was 12.3%, and that in the 3rd percentile was 5.6%. Vaginal delivery was performed in 67.0% of the patients, and 59.7% were male. The IMV group was more likely to have a lower GA, birth weight, and height and a higher clinical risk index for babies (CRIP II) score than the non-IMV group (P <0.05). The duration of hospitalization was notably longer in the IMV group (32.06±31.93 vs. 8.98±7.91 days) than in the non-IMV group. Respiratory distress syndrome (RDS), patent ductus arteriosus (PDA), bronchopulmonary dysplasia (BPD), premature retinopathy of prematurity (ROP), and necrotizing enterocolitis (NEC) were more frequently observed in the IMV group (P<0.05). The overall mortality rate was 3.1%.
Predictive performance
Our first experiment compared the predictive performances of various approaches. Fig. 3a shows the receiver operating characteristic (ROC) curves for different models. The proposed model achieved the highest AUROC (0.861) compared with the other models. Random Forest and XGBoost had similar performances, with AUROCs of 0.837 and 0.831, respectively. The XGBoost model, which utilized only two features (SpO2 and FiO2), also demonstrated an AUROC of 0.742. Although this value was lower than the AUROC achieved by the model incorporating all the selected features, it outperformed NEWS (AUROC: 0.611). In Fig. 3b, the precision-recall curves are compared. The developed model exhibited the highest AUPRC (0.327). Unlike the AUROC results, XGBoost had a better AUPRC than Random Forest (0.257 vs. 0.176). The XGBoost model, which utilized only two features, had a lower performance (AUPRC: 0.090) than the model that incorporated all selected features; it outperformed NEWS (AUPRC: 0.019).
Significant differences were observed in the terms of GA and birth weight between the IMV and non-IMV groups (Table 1). Based on these factors, we performed a subgroup analysis. In Additional file 1: Fig. 2 (a), We compared the AUROC of all models for each group according to the GA. The proposed model performed better for all groups and provided more accurate predictions as GA decreased. However, the proposed model and Random Forest showed similar performances in the group with a gestation period of 35 weeks. Additionally, as shown in Additional file 1: Fig. 2 (b), we analyzed group-specific AUROC according to birth weight. In this case, the proposed model also showed the highest performance, and we found that it had a strong performance regardless of the group. The proposed model showed similar performance to Random Forest and XGBoost in the group with birth weight ≤1.75 kg and ≥4.25 kg, respectively. However, the p-values are 0.295 and 0.014, respectively, indicating that the results are not significant.
In Table 2, of the 5 parameters in the widely used NEWS, comparisons were made using 2, 3, 4, and 5 or more parameters to assess the performance of all models corresponding to the same specificity. The proposed model stands out as it achieved the highest sensitivity, LHR+, and the lowest LHR-. Specificity relates to the number of alarms; when the number of alarms is consistent, the proposed model delivers the best performance.
Alarming performance
We compared MACPD using the same sensitivity level for all methods. From Fig. 4a and Table 3, it can be observed that the proposed method has the lowest alarm rate compared to all other methods at the same sensitivity level. This result indicates that the proposed method can detect the same number of high-risk patients with fewer alarms, significantly reducing the burden on the medical staff. In addition, the calibration level of the model is crucial when setting a threshold for the alarms for each model. We analyzed the reliability, as shown in Fig. 4b, and found that the proposed method had the best calibration level.
Inspection of model features
The overall importance of the predictor variables of the proposed model showed SpO2 as the most important feature, and the second most important feature was the total output, including urine and feces (Fig. 5). Heart and respiratory rates per minute were the third- and fourth-most important features, respectively.
Discussion
In this study, we demonstrated DL to support clinical decision-making concerning applying IMV among neonates using non-invasive methods such as monitoring vital signs and demographic information. RF is a critical condition commonly observed in newborns admitted to the NICU, leading to an increased mortality rate [33]. Repeated or prolonged episodes of desaturation and tachypnea, including hypoxia, neurodevelopmental impairment, persistent pulmonary hypertension, and cardiac arrest, may worsen the prognosis. The rapid and accurate decision of intubation is vital to increase survival [1, 32].
Among the articles published to date, an accurate tool for predicting intubation has yet to be established. Several neonatal severity scoring systems have been developed to predict the prognosis of critically ill neonates, including the Clinical Risk Index for Babies II (CRIB II), Neonatal Therapeutic Intervention Scoring System (NTISS), Score for Neonatal Acute Physiology II (SNAP II), Score for Neonatal Acute Physiology with Perinatal Extension II (SNAPPE-II), and Modified Sick Neonatal Score (MSNS). These scores accurately predicted mortality in the NICU, and the AUCs were approximately 0.86–0.91 [34, 35]. However, these scores were originally designed to assess the worst clinical status found in the first 24 h after admission [36]. The proposed model achieved the highest predictive accuracy for respiratory deterioration requiring IMV. Both Random Forest and XGBoost exhibited similar performances. The XGBoost model that utilized only two features (SpO2 and FiO2) had a lower AUROC compare to the model that incorporated all selected features. We also found that the proposed model performed better for all groups and tended to make more accurate predictions for lower GA.
We also compared MACPD using the same sensitivity level for all methods. Poncette et al. [37] described that in one of the most digitized hospitals with an increasing number of novel medical devices with their own alarms, the sheer number of alarms frequently overwhelms clinicians. Kierra Jones [38] documented that Johns Hopkins reported an average of 350 alerts per bed per day, and one intensive care unit’s (ICU) average was 771 daily. This can cause alarm fatigue, and caregivers are more likely to ignore or have trouble distinguishing between the alarms. In this study, the proposed method had the lowest alarm rate compared to all other methods at the same sensitivity level. This result indicates that the proposed method can detect the same number of high-risk patients with fewer alarms, which can help reduce alarm fatigue and workload. It also improves the selection of alarms requiring immediate intervention, provides earlier recognition of treatment, and directs care toward more efficient and individualized situations.
The strengths of our study were two-fold. First, there were no restrictions on the equipment or human resources required to use the proposed model. We developed a model that makes accurate predictions with minimal key features: GA, birth weight, corrected age, gravida, head circumference, body weight, height, chest circumference at birth, sex, FiO2, SpO2, BT, systolic, diastolic, and mean BP, HR, PR, and RR, which can be obtained non-invasively. The model is versatile and can be used in primary to tertiary hospitals, even in situations with limited laboratory equipment or a shortage of specialists. If the risk of IMV application in a primary hospital is high, a transfer to a tertiary hospital can be promptly considered. Secondly, the proposed model is valuable for determining whether IMV is necessary for a patient hospitalized for several hours or days. Immediately after birth, the need for IMV support becomes conspicuously evident within the framework of the neonatal resuscitation program. This encompasses indicators such as apnea, gasping, desaturation, and bradycardia. Attention may wane several hours or days into hospitalization, even though close monitoring and accurate judgment by medical staff remain necessary throughout the hospitalization period. By developing the proposed model, intubation and mechanical ventilation support can be initiated without delay due to early detection with a reduced alarm burden.
The current study has some limitations that should be addressed in future studies. First, it was limited to a single hospital, which could have affected the generalizability of the model. This is because clinicians use different criteria to determine the necessity for intubation. The application of the proposed model requires further external validation in other institutions, and a bias in therapeutic strategies is inevitable. Second, patients who were intubated before admission were excluded, and most of them were extremely low birth weight infants (ELBWI). Data pertaining to the application of IMV in cases of extreme immaturity are crucial. The ELBWI exhibited insufficient self-respiration and decreased physical activity immediately after birth. Moreover, ELBWI generally received prophylactic surfactants via an endotracheal tube. In the future, we aim to monitor and evaluate each patient from the delivery room to the NICU. Third, outborn patients did not have sufficient information regarding their maternal history, such as prenatal ultrasound or laboratory test results, which are critical factors affecting neonatal lung disease. This prospective study aimed to collect various types of maternal data.
Conclusion
Using non-invasive data, we demonstrated the performance of a DL-based approach in predicting the need for mechanical ventilation in neonates in the NICU. The results of the predictive and alarm performances were superior for the proposed model compared to the other models. DL approaches offer an accurate and standardized way to predict applying IMV in neonatal patients, enabling advanced bedside neonatal care and the utilization of more sophisticated techniques.
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article and its additional files. Further inquiries can be directed to the corresponding author.
Abbreviations
- AI:
-
Artificial intelligence
- ANN:
-
Artificial neural networks
- AUPRC:
-
Area under the precision-recall curve
- AUROC:
-
Area under the receiver operating characteristic
- BP:
-
Blood pressure
- BPD:
-
Bronchopulmonary dysplasia
- BT:
-
Body temperature
- CNN:
-
Convolutional neural networks
- DL:
-
Deep learning
- EHR:
-
Electronic health records
- ELBWI:
-
Extreme low birthweight infant
- FC:
-
Fully connected
- GA:
-
Gestational age
- GDM:
-
Gestational diabetes mellitus
- HR:
-
Heart rate
- ICU:
-
Intensive care unit
- IMV:
-
Invasive mechanical ventilation
- IUGR:
-
Intrauterine growth restriction
- LDA:
-
Linear discriminant analysis
- LHR:
-
Likelihood ratio
- LSTM:
-
Long short-term models
- MACPD:
-
Mean alarm count per day
- MAE:
-
Mean absolute error
- ML:
-
Machine learning
- MSNS:
-
Modified Sick Neonatal Score
- NEC:
-
Necrotizing enterocolitis
- NEWS:
-
Newborn early warning score system
- NICU:
-
Neonatal intensive care unit
- NPV:
-
Negative predictive value
- NTISS:
-
Neonatal Therapeutic Intervention Scoring System
- PDA:
-
Patent ductus arteriosus
- PPV:
-
Positive predictive value
- PR:
-
Pulse rate
- RDS:
-
Respiratory distress syndrome
- RF:
-
Respiratory failure
- ROC:
-
Receiver operating characteristic
- ROP:
-
Retinopathy of prematurity
- RR:
-
Respiratory rate
- SHAP:
-
Shapley Additive exPlanations
- SNAP:
-
Score for Neonatal Acute Physiology
- SNAPPE:
-
Score for Neonatal Acute Physiology with Perinatal Extension
- SVM:
-
Support vector machine
- XGBoost:
-
Extreme gradient boosting
References
Ding S, Xu Y, Wang H, Yue H, Pan Z, Sun B. Outcome of neonatal hypoxemic respiratory failure: a livebirth population-based retrospective survey. BMC pediatr. 2022;22(1):1–13.
Anne RP, Murki S. Noninvasive respiratory support in neonates: a review of current evidence and practices. Indian J Pediatr. 2021;88:670–8.
Rojas-Reyes MX, Morley CJ, Soll R. Prophylactic versus selective use of surfactant in preventing morbidity and mortality in preterm infants. Cochrane Database Syst Rev. 2012;2012:CD000510.
Sewal N. Predictive Analysis of common risk factors in Neonates using Machine Learning. Turk J Comput Math Educ (TURCOMAT). 2021;12:2870–8.
Ostojic D, et al. Reducing false alarm rates in neonatal intensive care: a new machine learning approach. Oxygen Transp Tissue. 2020;XLI:285–90.
Lyra S, Rixen J, Heimann K, Karthik S, Joseph J, Jayaraman K, et al. Camera fusion for real-time temperature monitoring of neonates using deep learning. Med Biol Eng Comput. 2022;60:1787–800.
Chen JV, Chaudhari G, Hess CP, Glenn OA, Sugrue LP, Rauschecker AM, et al. Deep learning to predict neonatal and infant brain age from myelination on brain MRI scans. Radiology. 2022;305:678–87.
Liang YC, Wijaya I, Yang MT, Cuevas Juarez JR, Chang HT. Deep learning for infant cry recognition. Int J Environ Res Public Health. 2022;19(10):6311.
Sahoo NN, Murugesan B, Das A, Karthik S, Ram K, Leonhardt S, et al. Deep learning based non-contact physiological monitoring in Neonatal Intensive Care Unit. Annu Int Conf IEEE Eng Med Biol Soc. 2022;2022:1327–30 IEEE Publications.
Kwok TC, Henry C, Saffaran S, Meeus M, Bates D, Van Laere D, et al. Application and potential of artificial intelligence in neonatal medicine In. Semin Fetal Neonatal Med. 2022;27.
Hamet P, Tremblay J. Artificial intelligence in medicine. Metabolism. 2017;69S:S36-40.
Sitaula C, Grooby E, Kwok TC, Sharkey D, Marzbanrad F, Malhotra A. Artificial intelligence-driven wearable technologies for neonatal cardiorespiratory monitoring. Part 2: Artificial intelligence. Pediatr Res. 2023;93:426–36.
Hyland SL, Faltys M, Hüser M, Lyu X, Gumbsch T, Esteban C, et al. Early prediction of circulatory failure in the intensive care unit using machine learning. Nat Med. 2020;26:364–73.
Lee YJ, Cho KJ, Kwon O, Park H, Lee Y, Kwon JM, et al. A multicentre validation study of the deep learning-based early warning score for predicting in-hospital cardiac arrest in patients admitted to general wards. Resuscitation. 2021;163:78–85.
Feng J, Lee J, Vesoulis ZA, Li F. Predicting mortality risk for preterm infants using deep learning models with time-series vital sign data. npj Digit Med. 2021;4:108.
Ramachandran S, Niyas P, Vinekar A, John R. A deep learning framework for the detection of Plus disease in retinal fundus images of preterm infants. Biocybern Biomed Eng. 2021;41:362–75.
Shin HI, Shin HI, Bang MS, Kim DK, Shin SH, Kim EK, et al. Deep learning-based quantitative analyses of spontaneous movements and their association with early neurological development in preterm infants. Sci Rep. 2022;12:3138.
Reuter S, Moser C, Baack M. Respiratory distress in the newborn. Pediatr Rev. 2014;35:417–28 quiz 429.
Kommawar A, Borkar R, Vagha J, Lakhkar B, Meshram R, Taksandae A. Study of respiratory distress in newborn. Int J Contemp Pediatr. 2017;4:490–4.
Gorunescu F. Data Mining: Concepts, models and techniques, vol. 12. Springer Science & Business Media. 2011. p. 319–330.
Johnson JM, Khoshgoftaar TM. Survey on deep learning with class imbalance. J Big Data. 2019;6:1–54.
Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9:1735–80.
Bergstra J, Bengio Y. Random search for hyper-parameter optimization. J Mach Learn Res. 2012;13:2.
Loshchilov I, Hutter F. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. https://doi.org/10.48550/arXiv.1711.05101
Goodfellow I, Bengio Y, Courville A. Deep learning. MIT Press. 2016. p. 373–423.
El Amouri S, Qadir M, Jose E, Simon T, Khan J. Implementation of newborn early warning system in government hospital. United Arab Emirates J Clin Neonatol. 2020;9:182–8.
Roland D, Madar J, Connolly G. The newborn early warning (NEW) system: development of an at-risk infant intervention system. Infant. 2010;6:116.
Breiman L. Random forest. Mach Learn. 2001;45:1.
Chen T, Guestrin C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 2016. p. 785–94.
Severinghaus JW. Simple, accurate equations for human blood O2 dissociation computations. J Appl Physiol Respir Environ Exerc Physiol. 1979;46:599–602.
Brown SM, Duggal A, Hou PC, Tidswell M, Khan A, Exline M, et al. Non-linear imputation of PaO2/FIO2 from SpO2/FIO2 among mechanically ventilated patients in the intensive care unit: a prospective, observational study. Crit Care Med. 2017;45:1317–24.
Hüser M, Faltys M, Lyu X, Barber C, Hyland SL, Merz TM, et al. Early prediction of respiratory failure in the intensive care unit. arXiv preprint arXiv:2105.05728. 2021. https://doi.org/10.48550/arXiv.2105.05728
Lakshminrusimha S. The pulmonary circulation in neonatal respiratory failure. Clin Perinatol. 2012;39:655–83.
Harsha SS, Archana BR. SNAPPE-II (Score for Neonatal Acute Physiology with Perinatal Extension-II) in Predicting Mortality and Morbidity in NICU. J Clin Diagn Res. 2015;9:SC10–2.
Muktan D, Singh RR, Bhatta NK, Shah D. Neonatal mortality risk assessment using SNAPPE- II score in a neonatal intensive care unit. BMC Pediatr. 2019;19:279.
Hsu JF, Chang YF, Cheng HJ, Yang C, Lin CY, Chu SM, et al. Machine learning approaches to predict in-hospital mortality among neonates with clinically suspected sepsis in the neonatal intensive care unit. J Pers Med. 2021;11:695.
Poncette AS, Wunderlich MM, Spies C, Heeren P, Vorderwülbecke G, Salgado E, et al. Patient monitoring alarms in an intensive care unit: observational study with do-it-yourself instructions. J Med Internet Res. 2021;23: e26494.
Jones K. Alarm fatigue a top patient safety hazard. Can Med Assoc. 2014;186(3):178.
Acknowledgements
Not applicable
Funding
This study was supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI) funded by the Ministry of Health and Welfare (HI21C1074).
Author information
Authors and Affiliations
Contributions
Younga Kim, Hyeongsub Kim, and Narae Lee had full access to the data, and created the concept, design, interpretation, and critical revision of the manuscript for important intellectual content. Jaewoo Choi, Kyungjae Cho, Dongjoon Yoo, and Yeha Lee created a deep-learning model to verify their results. Su Jeong Park, Mun Hui Jeong, Seong Hee Jeong, Kyung Hee Park, and Shin-Yun Byun analyzed the data. Taehwa Kim, Sung-Ho Ahn, and Woo Hyun Cho laid the foundation for the application of artificial intelligence in the intensive care unit. All the authors approved the final version of the manuscript and agreed to be accountable for all aspects of the work, ensuring that questions related to the accuracy or integrity of any part of the work were appropriately investigated and resolved.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The authors are accountable for all aspects of the work and ensure that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. This study was approved by the Institutional Review Board of Pusan National University Yangsan Hospital (PNUYH) Institutional Review Board (IRB No. 05–2022-006). The requirement for informed consent was waived due to the minimal risk associated with a standard-of-care observational study with no interventions. Informed consent in this study was not deemed necessary by the institutional review board of PNUYH. The procedures were followed in accordance with the ethical standards of the responsible committee of each hospital on human experimentation and the Helsinki Declaration of 1975.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Table 1
. The percentage of missing data. Table 2. The proposed model architecture. hidden_dim=32, input_dim=83. Table 3. Significance testing of proposed model and existing models. Fig. 1. Sequence windowing. Yellow box means current EHR data and blue box means sequence of recodes to support model training and prediction when sequence length is L. Red box is target label according to sequence window. Fig. 2. Sub-group analysis. (a) Area under the curve (AUC) according to gestational age and (b) AUC according to birth weight.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kim, Y., Kim, H., Choi, J. et al. Early prediction of need for invasive mechanical ventilation in the neonatal intensive care unit using artificial intelligence and electronic health records: a clinical study. BMC Pediatr 23, 525 (2023). https://doi.org/10.1186/s12887-023-04350-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12887-023-04350-1