TY - GEN
T1 - Deep Imputation-Prediction Networks for Health Risk Prediction using Electronic Health Records
AU - Liu, Yuxi
AU - Zhang, Zhenhao
AU - Qin, Shaowen
PY - 2023/8/2
Y1 - 2023/8/2
N2 - Electronic health records (EHRs) have an inherently high degree of irregularity, including many missing values and varying time intervals, due to variations in patient conditions and treatment needs. This makes successful health risk prediction challenging. EHRs contain longitudinal patient data that records meaningful information associated with a chronological set of clinical observations for each patient. Existing methods focus on modeling variable correlations in patient data with deep neural networks to impute missing values and feed complete data matrices into machine learning models to perform downstream healthcare prediction tasks. However, not enough attention was given to the reliability of the imputed values by these methods. Further, it is likely that the pattern of missing data in EHR contains important information affecting relationships among variables, including time intervals. We propose a novel deep imputation-prediction network to simultaneously perform imputation and prediction tasks with EHR. Our method has the advantages of being able to: 1) learn from the longitudinal patient data in both forward and backward directions, 2) generate both the predicted and imputed values and enhance the reliability of imputed values, and 3) incorporate three common decay functions to capture the variation pattern of input variables in time and adaptively enhances the temporal representation of each pattern with adjustable weights. As well, our method is able to examine the association between input variables to identify critical indicative variables regardless of how long ago the associated event happened. Experimental results on MIMIC-III and eICU datasets demonstrate the effectiveness and superiority of our method for both imputation and prediction, as well as transparency and interpretability, compared to existing state-of-the-art methods.
AB - Electronic health records (EHRs) have an inherently high degree of irregularity, including many missing values and varying time intervals, due to variations in patient conditions and treatment needs. This makes successful health risk prediction challenging. EHRs contain longitudinal patient data that records meaningful information associated with a chronological set of clinical observations for each patient. Existing methods focus on modeling variable correlations in patient data with deep neural networks to impute missing values and feed complete data matrices into machine learning models to perform downstream healthcare prediction tasks. However, not enough attention was given to the reliability of the imputed values by these methods. Further, it is likely that the pattern of missing data in EHR contains important information affecting relationships among variables, including time intervals. We propose a novel deep imputation-prediction network to simultaneously perform imputation and prediction tasks with EHR. Our method has the advantages of being able to: 1) learn from the longitudinal patient data in both forward and backward directions, 2) generate both the predicted and imputed values and enhance the reliability of imputed values, and 3) incorporate three common decay functions to capture the variation pattern of input variables in time and adaptively enhances the temporal representation of each pattern with adjustable weights. As well, our method is able to examine the association between input variables to identify critical indicative variables regardless of how long ago the associated event happened. Experimental results on MIMIC-III and eICU datasets demonstrate the effectiveness and superiority of our method for both imputation and prediction, as well as transparency and interpretability, compared to existing state-of-the-art methods.
KW - electronic health records
KW - health risk prediction
KW - Imputation of missing values
KW - temporal representation learning
UR - http://www.scopus.com/inward/record.url?scp=85169574153&partnerID=8YFLogxK
U2 - 10.1109/IJCNN54540.2023.10191793
DO - 10.1109/IJCNN54540.2023.10191793
M3 - Conference contribution
AN - SCOPUS:85169574153
T3 - Proceedings of the International Joint Conference on Neural Networks
BT - IJCNN 2023 - International Joint Conference on Neural Networks, Proceedings
PB - Institute of Electrical and Electronics Engineers
T2 - 2023 International Joint Conference on Neural Networks, IJCNN 2023
Y2 - 18 June 2023 through 23 June 2023
ER -