Deep Imputation-Prediction Networks for Health Risk Prediction using Electronic Health Records

Yuxi Liu, Zhenhao Zhang, Shaowen Qin

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Electronic health records (EHRs) have an inherently high degree of irregularity, including many missing values and varying time intervals, due to variations in patient conditions and treatment needs. This makes successful health risk prediction challenging. EHRs contain longitudinal patient data that records meaningful information associated with a chronological set of clinical observations for each patient. Existing methods focus on modeling variable correlations in patient data with deep neural networks to impute missing values and feed complete data matrices into machine learning models to perform downstream healthcare prediction tasks. However, not enough attention was given to the reliability of the imputed values by these methods. Further, it is likely that the pattern of missing data in EHR contains important information affecting relationships among variables, including time intervals. We propose a novel deep imputation-prediction network to simultaneously perform imputation and prediction tasks with EHR. Our method has the advantages of being able to: 1) learn from the longitudinal patient data in both forward and backward directions, 2) generate both the predicted and imputed values and enhance the reliability of imputed values, and 3) incorporate three common decay functions to capture the variation pattern of input variables in time and adaptively enhances the temporal representation of each pattern with adjustable weights. As well, our method is able to examine the association between input variables to identify critical indicative variables regardless of how long ago the associated event happened. Experimental results on MIMIC-III and eICU datasets demonstrate the effectiveness and superiority of our method for both imputation and prediction, as well as transparency and interpretability, compared to existing state-of-the-art methods.

Original languageEnglish
Title of host publicationIJCNN 2023 - International Joint Conference on Neural Networks, Proceedings
PublisherInstitute of Electrical and Electronics Engineers
Number of pages9
ISBN (Electronic)9781665488679
DOIs
Publication statusPublished - 2 Aug 2023
Event2023 International Joint Conference on Neural Networks, IJCNN 2023 - Gold Coast, Australia
Duration: 18 Jun 202323 Jun 2023

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2023-June

Conference

Conference2023 International Joint Conference on Neural Networks, IJCNN 2023
Country/TerritoryAustralia
CityGold Coast
Period18/06/2323/06/23

Keywords

  • electronic health records
  • health risk prediction
  • Imputation of missing values
  • temporal representation learning

Fingerprint

Dive into the research topics of 'Deep Imputation-Prediction Networks for Health Risk Prediction using Electronic Health Records'. Together they form a unique fingerprint.

Cite this