A deep learning method for predicting the COVID-19 ICU patient outcome fusing X-rays, respiratory sounds, and ICU parameters

Yunan Wu*, Bruno Machado Rocha, Evangelos Kaimakamis, Grigorios Aris Cheimariotis, Georgios Petmezas, Evangelos Chatzis, Vassilis Kilintzis, Leandros Stefanopoulos, Diogo Pessoa, Alda Marques, Paulo Carvalho, Rui Pedro Paiva, Serafeim Kotoulas, Militsa Bitzani, Aggelos K. Katsaggelos, Nicos Maglaveras

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Assessing the health status of critically ill patients with COVID-19 and predicting their outcome are highly challenging problems and one of the reasons for poor management of ICU resources worldwide. A better pathophysiological understanding of patients’ state evolution in the ICU can enhance effective medical interventions. Therefore, there is a need to monitor and analyze the pulmonary function of a ICU patient with COVID-19 and its impact on cardiovascular and other systems. To achieve this, chest X-rays (CXRs), respiratory sounds and all the routinely monitored parameters, scores and metrics in the COVID-19 ICU were recorded from 171 ICU patients with COVID-19 from June 2020 until December 2021. Features were extracted from respiratory sounds, deep learning analysis was conducted on CXRs, and logistic regression analysis was performed on routine ICU clinical variables. Deep learning pipelines were established to classify patients’ outcomes (survival or death) at two time points (ICU mortality or 90-day mortality) using three input configurations: (a) CXRs, (b) a fusion of CXRs and respiratory sounds features, or (c) a fusion of CXRs, respiratory sounds features, and principal features of the ICU clinical measurements. The performance of the latter approach was promising, achieving, for ICU mortality, an accuracy of 0.761 and an AUC of 0.759, and for 90-day mortality, an accuracy of 0.743 and an AUC of 0.752, while the performance of approaches (a) and (b) was worse. Therefore, using multi-source data and longitudinal COVID-19 ICU data offers a better prediction of the outcome in the ICU, thereby optimizing medical decisions and interventions. Furthermore, we show that adding the adventitious respiratory sounds features significantly increased AUC and accuracy for mortality prediction of ICU patients with COVID-19.

Original languageEnglish (US)
Article number121089
JournalExpert Systems with Applications
Volume235
DOIs
StatePublished - Jan 2024

Funding

This work was partially supported by the Horizon 2020 Framework Programme of the European Union project WELMO (grant agreement number 825572 ), by the FCT - Foundation for Science and Technology, I.P./MCTES through national funds (PIDDAC) , under the projects UIDB/04501/2020 and CISUC - UID/CEC/00326/2020, FCT project Lung@ICU under grant reference DSAIPA/AI/0113/2020 , FCT Ph.D. scholarships SFRH/BD/135686/2018 and DFA/BD/4927/2020 , Fundo Europeu de Desenvolvimento Regional (FEDER) through Programa Operacional Competitividade e Internacionalização (COMPETE) and POCI-01-0145-FEDER-007628—iBiMED .

Keywords

  • COVID-19
  • Chest X-rays
  • Clinical variables
  • Deep learning fusion
  • ICU mortality
  • Respiratory sounds

ASJC Scopus subject areas

  • General Engineering
  • Computer Science Applications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'A deep learning method for predicting the COVID-19 ICU patient outcome fusing X-rays, respiratory sounds, and ICU parameters'. Together they form a unique fingerprint.

Cite this