arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.02258cs.LGcs.AI
收藏

XTSFormer:面向临床应用中不规则时间事件预测的跨时间尺度 Transformer

XTSFormer: Cross-Temporal-Scale Transformer for Irregular-Time Event Prediction in Clinical Applications

University of Florida(佛罗里达大学);Indiana University(印第安纳大学);Regenstrief Institute(雷根斯特里夫研究所)

Tingsong Xiao, Zelin Xu, Wenchong He, Zhengkun Xiao, Yupu Zhang, Zibo Liu, Shigang Chen, My T. Thai, Jiang Bian, Parisa Rashidi, Zhe Jiang

AI总结:

提出 XTSFormer 模型,通过周期感知时间位置编码(FCPE)和分层多尺度时间注意力机制,有效解决临床 EHR 中不规则时间事件的多尺度交互与预测问题,在真实数据集上优于多种基线方法。

摘要:

与不安全护理相关的不良临床事件是美国十大死因之一。基于电子健康记录(EHRs)的临床事件建模与预测在增强患者安全方面发挥着关键作用。一个例子是对事实护理路径进行建模,以表征治疗或护理的常见分步计划。然而,临床事件数据带来了一些独特的挑战,包括连续事件间时间间隔的不规则性、循环的存在、周期性、多尺度事件交互,以及与长事件序列相关的高计算成本。现有的神经时间点过程(TPPs)方法未能有效捕捉事件交互的多尺度特性,而这在许多现实临床应用中很常见。为解决这些问题,我们提出了跨时间尺度 Transformer(XTSFormer),专为不规则时间事件数据设计。该模型包含两个关键组件:一种新颖的基于特征的周期感知时间位置编码(FCPE),能巧妙捕捉时间的周期性;以及一种分层多尺度时间注意力机制,其不同时间尺度由自底向上的聚类方法确定。在多个真实 EHR 数据集上的大量实验表明,我们的 XTSFormer 优于多种基线方法。代码可在 https://github.com/spatialdatasciencegroup/XTSFormer 获取。

英文摘要:

Adverse clinical events related to unsafe care are among the top ten causes of death in the U.S. Accurate modeling and prediction of clinical events from electronic health records (EHRs) play a crucial role in patient safety enhancement. An example is modeling de facto care pathways that characterize common step-by-step plans for treatment or care. However, clinical event data pose several unique challenges, including the irregularity of time intervals between consecutive events, the existence of cycles, periodicity, multi-scale event interactions, and the high computational costs associated with long event sequences. Existing neural temporal point processes (TPPs) methods do not effectively capture the multi-scale nature of event interactions, which is common in many real-world clinical applications. To address these issues, we propose the cross-temporal-scale transformer (XTSFormer), specifically designed for irregularly timed event data. Our model consists of two vital components: a novel Feature-based Cycle-aware Time Positional Encoding (FCPE) that adeptly captures the cyclical nature of time, and a hierarchical multi-scale temporal attention mechanism, where different temporal scales are determined by a bottom-up clustering approach. Extensive experiments on several real-world EHR datasets show that our XTSFormer outperforms multiple baseline methods. The code is available at https://github.com/spatialdatasciencegroup/XTSFormer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑