Federated learning model for predicting major postoperative complications

Read original: arXiv:2404.06641 - Published 4/11/2024 by Yonggi Park, Yuanfang Ren, Benjamin Shickel, Ziyuan Guan, Ayush Patela, Yingbo Ma, Zhenhong Hu, Tyler J. Loftus, Parisa Rashidi, Tezcan Ozrazgat-Baslanti and 1 other
Total Score

0

📈

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This study explores the use of federated learning, a machine learning technique, to predict postoperative complications in surgical patients using electronic health records (EHR) data from multiple hospitals.
  • Federated learning allows for the training of AI models without directly sharing sensitive patient data across institutions, addressing challenges around medical data privacy.
  • The researchers compared the performance of federated learning models with local models trained on data from a single hospital and central models trained on pooled data from multiple hospitals.

Plain English Explanation

Predicting the risk of complications after surgery is an important task for doctors. Federated learning is a technique that allows different hospitals to train an AI model together without having to share their patients' private medical information. In this study, the researchers used federated learning to develop models that can predict nine major complications, such as prolonged stay in the intensive care unit (ICU) or the need for mechanical ventilation, based on data from patients' medical records.

The researchers compared the performance of these federated learning models to models trained using data from a single hospital (local models) and models trained on data pooled from multiple hospitals (central models). They found that the federated learning models achieved similar or even slightly better performance than the central models in some cases, demonstrating that federated learning can be a useful tool for training robust and generalizable models while protecting patient privacy.

Technical Explanation

This retrospective cohort study used EHR data from two University of Florida Health (UFH) hospitals in Gainesville (GNV) and Jacksonville (JAX) to develop federated learning models to predict nine major postoperative complications. The researchers trained these federated learning models using perioperative and intraoperative features from a total of 108,486 adult patients who underwent inpatient surgical procedures.

The performance of the federated learning models was compared to local learning models trained on a single site and central learning models trained on the pooled dataset from both centers. The federated learning models achieved AUROC (area under the receiver operating characteristics curve) values ranging from 0.81 for wound complications to 0.92 for prolonged ICU stay at the GNV center, and 0.73-0.74 for wound complications to 0.92-0.93 for hospital mortality at the JAX center.

The federated learning models performed comparably to the central learning models, except for prolonged ICU stay, where the federated learning models slightly outperformed the central models at the GNV center but slightly underperformed at the JAX center. Additionally, the federated learning models achieved similar performance to the best local learning models at each center, demonstrating strong generalizability.

Critical Analysis

The researchers acknowledge that their study has several limitations. First, the data used in the study was limited to two UFH hospitals, and the performance of the federated learning models may vary when applied to data from other healthcare systems. Further research involving a more diverse set of hospitals and medical centers would be necessary to assess the broader applicability of the federated learning approach.

Additionally, the study did not explore the impact of different federated learning strategies, such as federated multimodal learning or global contrastive training, on the model performance. Investigating the use of more advanced federated learning techniques could potentially lead to further improvements in the accuracy and robustness of the models.

Conclusion

This study demonstrates the potential of federated learning as a valuable tool for training accurate and generalizable AI models for predicting postoperative complications using EHR data, while maintaining patient privacy. The performance of the federated learning models was comparable to or better than models trained on pooled data from multiple hospitals, showcasing the feasibility of this approach in real-world clinical settings where data sharing may be challenging. Further research is needed to explore the scalability and broader applicability of federated learning in healthcare, but this study provides a promising foundation for the continued development of privacy-preserving AI solutions in the medical domain.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

📈

Total Score

0

Federated learning model for predicting major postoperative complications

Yonggi Park, Yuanfang Ren, Benjamin Shickel, Ziyuan Guan, Ayush Patela, Yingbo Ma, Zhenhong Hu, Tyler J. Loftus, Parisa Rashidi, Tezcan Ozrazgat-Baslanti, Azra Bihorac

Background: The accurate prediction of postoperative complication risk using Electronic Health Records (EHR) and artificial intelligence shows great potential. Training a robust artificial intelligence model typically requires large-scale and diverse datasets. In reality, collecting medical data often encounters challenges surrounding privacy protection. Methods: This retrospective cohort study includes adult patients who were admitted to UFH Gainesville (GNV) (n = 79,850) and Jacksonville (JAX) (n = 28,636) for any type of inpatient surgical procedure. Using perioperative and intraoperative features, we developed federated learning models to predict nine major postoperative complications (i.e., prolonged intensive care unit stay and mechanical ventilation). We compared federated learning models with local learning models trained on a single site and central learning models trained on pooled dataset from two centers. Results: Our federated learning models achieved the area under the receiver operating characteristics curve (AUROC) values ranged from 0.81 for wound complications to 0.92 for prolonged ICU stay at UFH GNV center. At UFH JAX center, these values ranged from 0.73-0.74 for wound complications to 0.92-0.93 for hospital mortality. Federated learning models achieved comparable AUROC performance to central learning models, except for prolonged ICU stay, where the performance of federated learning models was slightly higher than central learning models at UFH GNV center, but slightly lower at UFH JAX center. In addition, our federated learning model obtained comparable performance to the best local learning model at each center, demonstrating strong generalizability. Conclusion: Federated learning is shown to be a useful tool to train robust and generalizable models from large scale data across multiple institutions where data protection barriers are high.

Read more

4/11/2024

🔮

Total Score

0

Privacy-preserving federated prediction of pain intensity change based on multi-center survey data

Supratim Das, Mahdie Rafie, Paula Kammer, S{o}ren T. Skou, Dorte T. Gr{o}nne, Ewa M. Roos, Andr'e Hajek, Hans-Helmut Konig, Md Shihab Ullaha, Niklas Probul, Jan Baumbacha, Linda Baumbach

Background: Patient-reported survey data are used to train prognostic models aimed at improving healthcare. However, such data are typically available multi-centric and, for privacy reasons, cannot easily be centralized in one data repository. Models trained locally are less accurate, robust, and generalizable. We present and apply privacy-preserving federated machine learning techniques for prognostic model building, where local survey data never leaves the legally safe harbors of the medical centers. Methods: We used centralized, local, and federated learning techniques on two healthcare datasets (GLA:D data from the five health regions of Denmark and international SHARE data of 27 countries) to predict two different health outcomes. We compared linear regression, random forest regression, and random forest classification models trained on local data with those trained on the entire data in a centralized and in a federated fashion. Results: In GLA:D data, federated linear regression (R2 0.34, RMSE 18.2) and federated random forest regression (R2 0.34, RMSE 18.3) models outperform their local counterparts (i.e., R2 0.32, RMSE 18.6, R2 0.30, RMSE 18.8) with statistical significance. We also found that centralized models (R2 0.34, RMSE 18.2, R2 0.32, RMSE 18.5, respectively) did not perform significantly better than the federated models. In SHARE, the federated model (AC 0.78, AUROC: 0.71) and centralized model (AC 0.84, AUROC: 0.66) perform significantly better than the local models (AC: 0.74, AUROC: 0.69). Conclusion: Federated learning enables the training of prognostic models from multi-center surveys without compromising privacy and with only minimal or no compromise regarding model performance.

Read more

9/14/2024

Predicting postoperative risks using large language models
Total Score

0

Predicting postoperative risks using large language models

Charles Alba, Bing Xue, Joanna Abraham, Thomas Kannampallil, Chenyang Lu

Clinical notes recorded during a patient's perioperative journey holds immense informational value. Advances in large language models (LLMs) offer opportunities for bridging this gap. Using 84,875 pre-operative notes and its associated surgical cases from 2018 to 2021, we examine the performance of LLMs in predicting six postoperative risks using various fine-tuning strategies. Pretrained LLMs outperformed traditional word embeddings by an absolute AUROC of 38.3% and AUPRC of 33.2%. Self-supervised fine-tuning further improved performance by 3.2% and 1.5%. Incorporating labels into training further increased AUROC by 1.8% and AUPRC by 2%. The highest performance was achieved with a unified foundation model, with improvements of 3.6% for AUROC and 2.6% for AUPRC compared to self-supervision, highlighting the foundational capabilities of LLMs in predicting postoperative risks, which could be potentially beneficial when deployed for perioperative care

Read more

9/4/2024

🔮

Total Score

0

Federated Diabetes Prediction in Canadian Adults Using Real-world Cross-Province Primary Care Data

Guojun Tang, Jason E. Black, Tyler S. Williamson, Steve H. Drew

Integrating Electronic Health Records (EHR) and the application of machine learning present opportunities for enhancing the accuracy and accessibility of data-driven diabetes prediction. In particular, developing data-driven machine learning models can provide early identification of patients with high risk for diabetes, potentially leading to more effective therapeutic strategies and reduced healthcare costs. However, regulation restrictions create barriers to developing centralized predictive models. This paper addresses the challenges by introducing a federated learning approach, which amalgamates predictive models without centralized data storage and processing, thus avoiding privacy issues. This marks the first application of federated learning to predict diabetes using real clinical datasets in Canada extracted from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) without crossprovince patient data sharing. We address class-imbalance issues through downsampling techniques and compare federated learning performance against province-based and centralized models. Experimental results show that the federated MLP model presents a similar or higher performance compared to the model trained with the centralized approach. However, the federated logistic regression model showed inferior performance compared to its centralized peer.

Read more

8/23/2024