arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.06209cs.LGcs.AI
收藏

用于非参数生存分析的密度函数自适应 Transformer 建模

Adaptive Transformer Modelling of Density Function for Nonparametric Survival Analysis

Monash University(莫纳什大学);AIM for Health Lab(AIM健康实验室);Monash Centre for Health Research and Implementation(莫纳什健康研究与转化中心)

Xin Zhang, Deval Mehta, Yanan Hu, Chao Zhu, David Darby, Zhen Yu, Daniel Merlo, Melissa Gresle, Anneke Van Der Walt, Helmut Butzkueven, Zongyuan Ge

AI总结:

针对现有生存分析方法分布假设强、删失预测不敏感及动态建模受限等问题,本文提出 UniSurv,利用 Transformer 和 Margin-Mean-Variance 损失学习非参数单峰密度函数。

摘要:

生存分析在经济学、工程学和医疗保健等多个学科中发挥着关键作用。它使研究人员能够分析时不变和时变数据,涵盖客户流失、材料退化以及各种医疗结果等现象。鉴于此类数据的复杂性和异质性,近期研究已表明,深度学习方法可成功用于克服传统统计方法的局限。然而,当前方法通常涉及杂乱的概率密度函数(PDF),在删失预测方面敏感性较低,只能对静态数据集建模,或仅依赖循环神经网络进行动态建模。本文提出一种新颖的生存回归方法,无需任何先验分布假设即可生成高质量的单峰 PDF;该方法通过优化新颖的 Margin-Mean-Variance 损失,并利用 Transformer 处理时间与非时间数据的灵活性,被命名为 UniSurv。在多个数据集上的大量实验表明,与其他方法相比,UniSurv 对删失给予了显著更高的重视。

英文摘要:

Survival analysis holds a crucial role across diverse disciplines, such as economics, engineering and healthcare. It empowers researchers to analyze both time-invariant and time-varying data, encompassing phenomena like customer churn, material degradation and various medical outcomes. Given the complexity and heterogeneity of such data, recent endeavors have demonstrated successful integration of deep learning methodologies to address limitations in conventional statistical approaches. However, current methods typically involve cluttered probability distribution function (PDF), have lower sensitivity in censoring prediction, only model static datasets, or only rely on recurrent neural networks for dynamic modelling. In this paper, we propose a novel survival regression method capable of producing high-quality unimodal PDFs without any prior distribution assumption, by optimizing novel Margin-Mean-Variance loss and leveraging the flexibility of Transformer to handle both temporal and non-temporal data, coined UniSurv. Extensive experiments on several datasets demonstrate that UniSurv places a significantly higher emphasis on censoring compared to other methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑