🧑🏼‍💻 Research - June 11, 2025

Prospective external validation of a deep-learning-based early-warning system for major adverse events in general wards in South Korea.

🌟 Stay Updated!
Join AI Health Hub to receive the latest insights in health and AI.

⚡ Quick Summary

A recent study validated the VitalCare – Major Adverse Event Score (VC-MAES), an AI-based early warning system, demonstrating its superior predictive accuracy for major adverse events (MAEs) in general wards compared to traditional early warning scores. The VC-MAES achieved an impressive AUROC of 0.918, significantly reducing false positives by up to 71%.

🔍 Key Details

  • 📊 Dataset: 6,039 patient encounters
  • 🧩 Patient Groups: Internal Medicine (IM) and Obstetrics and Gynecology (OBGYN)
  • ⚙️ Technology: Deep learning-based early warning system (VC-MAES)
  • 🏆 Performance: VC-MAES: AUROC 0.918, AUPRC 0.352; NEWS: AUROC 0.797, MEWS: AUROC 0.722

🔑 Key Takeaways

  • 🚑 VC-MAES significantly outperformed traditional early warning scores in predicting MAEs.
  • 📉 False positives were reduced by up to 71%, enhancing clinical efficiency.
  • 🩺 The study included a diverse patient population, including OBGYN, which is often underrepresented in AI studies.
  • 📈 VC-MAES achieved an AUROC of 0.918 six hours prior to MAEs.
  • 🔍 The AUPRC for VC-MAES was 0.352, indicating a strong predictive capability.
  • 💡 Strong association between baseline VC-MAES scores and MAEs (P<0.001).
  • 🌍 Conducted at a tertiary medical center in South Korea.
  • 📅 Published in Acute Critical Care, 2025.

📚 Background

The acute deterioration of patients in general wards can lead to serious consequences, including unplanned transfers to intensive care units, cardiac arrests, or even death. Traditional early warning scores (EWSs) have struggled with predictive accuracy, often resulting in frequent false positives. This study aimed to address these limitations by validating an AI-based early warning system, the VC-MAES, to enhance patient safety and clinical outcomes.

🗒️ Study

This prospective observational study included adult patients from general wards, specifically focusing on internal medicine and obstetrics and gynecology. The researchers compared the predictions made by VC-MAES against those from the National Early Warning Score (NEWS) and Modified Early Warning Score (MEWS) using various statistical metrics, including the area under the receiver operating characteristic curve (AUROC) and area under the precision-recall curve (AUPRC).

📈 Results

Out of 6,039 patient encounters, 217 (3.6%) experienced major adverse events, with a notably higher rate in internal medicine (9.5%) compared to obstetrics and gynecology (0.26%). The VC-MAES demonstrated a remarkable AUROC of 0.918 and an AUPRC of 0.352, significantly outperforming both NEWS and MEWS. The reduction in false positives per true positive (FPpTP) was substantial, indicating a more reliable predictive model.

🌍 Impact and Implications

The findings from this study suggest that the VC-MAES could greatly enhance clinical efficiency and resource allocation in general wards. By adopting this AI-based early warning system, healthcare providers may improve patient outcomes and reduce the burden on healthcare resources. The robust performance of VC-MAES, particularly in the OBGYN subgroup, highlights its potential for broader application across various medical fields.

🔮 Conclusion

The validation of the VC-MAES marks a significant advancement in the use of artificial intelligence for patient monitoring in general wards. Its superior predictive capabilities and reduced false positive rates present a promising opportunity for improving patient safety and clinical decision-making. As we move forward, further research and implementation of such technologies could transform the landscape of patient care.

💬 Your comments

What are your thoughts on the integration of AI in early warning systems for patient care? We would love to hear your insights! 💬 Share your comments below or connect with us on social media:

Prospective external validation of a deep-learning-based early-warning system for major adverse events in general wards in South Korea.

Abstract

BACKGROUND: Acute deterioration of patients in general wards often leads to major adverse events (MAEs), including unplanned intensive care unit transfers, cardiac arrest, or death. Traditional early warning scores (EWSs) have shown limited predictive accuracy, with frequent false positives. We conducted a prospective observational external validation study of an artificial intelligence (AI)-based EWS, the VitalCare – Major Adverse Event Score (VC-MAES), at a tertiary medical center in the Republic of Korea.
METHODS: Adult patients from general wards, including internal medicine (IM) and obstetrics and gynecology (OBGYN)-the latter were rarely investigated in prior AI-based EWS studies-were included. The VC-MAES predictions were compared with National Early Warning Score (NEWS) and Modified Early Warning Score (MEWS) predictions using the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), and logistic regression for baseline EWS values. False-positives per true positive (FPpTP) were assessed based on the power threshold.
RESULTS: Of 6,039 encounters, 217 (3.6%) had MAEs (IM: 9.5%, OBGYN: 0.26%). Six hours prior to MAEs, the VC-MAES achieved an AUROC of 0.918 and an AUPRC of 0.352, including the OBGYN subgroup (AUROC, 0.964; AUPRC, 0.388), outperforming the NEWS (0.797 and 0.124) and MEWS (0.722 and 0.079). The FPpTP was reduced by up to 71%. Baseline VC-MAES was strongly associated with MAEs (P<0.001). CONCLUSIONS: The VC-MAES significantly outperformed traditional EWSs in predicting adverse events in general ward patients. The robust performance and lower FPpTP suggest that broader adoption of the VC-MAES may improve clinical efficiency and resource allocation in general wards.

Author: [‘Sim T’, ‘Cho EY’, ‘Kim JH’, ‘Lee KH’, ‘Kim KJ’, ‘Hahn S’, ‘Ha EY’, ‘Yun E’, ‘Kim IC’, ‘Park SH’, ‘Cho CH’, ‘Yu GI’, ‘Ahn BE’, ‘Jeong Y’, ‘Won JY’, ‘Cho H’, ‘Lee KB’]

Journal: Acute Crit Care

Citation: Sim T, et al. Prospective external validation of a deep-learning-based early-warning system for major adverse events in general wards in South Korea. Prospective external validation of a deep-learning-based early-warning system for major adverse events in general wards in South Korea. 2025; 40:197-208. doi: 10.4266/acc.000525

Share on facebook
Facebook
Share on twitter
Twitter
Share on linkedin
LinkedIn
Share on whatsapp
WhatsApp

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.