arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.07706cs.LG
收藏

通过线性结构保持实现密集特征学习:医学数据

Dense Feature Learning via Linear Structure Preservation in Medical Data

Independent Researcher(独立研究者);The Chinese University of Hong Kong(香港中文大学);Columbia University(哥伦比亚大学)

Yuanyun Zhang, Mingxuan Zhang, Siyuan Li, Zihan Wang, Haoran Chen, Wenbo Zhou, Shi Li

AI总结:

本文提出密集特征学习方法,通过线性结构保持提升医学数据表示的稳定性与可解释性,实现更优的下游性能。

摘要:

针对医学数据的深度学习模型通常使用特定任务的目标进行训练,促使表示在少量判别方向上坍缩。虽然对个别预测问题有效,但这种范式未能充分利用临床数据的丰富结构,限制了学习特征的可迁移性、稳定性和可解释性。本文提出密集特征学习,一种以表示为中心的框架,明确塑造医学嵌入的线性结构。我们的方法直接在嵌入矩阵上操作,通过完全基于线性代数性质的目标,鼓励谱平衡、子空间一致性和特征正交性。不依赖标签或生成重建,密集特征学习产生具有更高有效秩、改进的条件数和时间稳定性特征。在纵向EHR数据、临床文本和多模态患者表示上的实验证明,与监督和自监督基线相比,在下游线性性能、鲁棒性和子空间对齐方面有持续改进。这些结果表明,学习跨度临床变异可能与学习预测临床结果同样重要,并将表示几何学定位为医疗AI中的首要目标。

英文摘要:

Deep learning models for medical data are typically trained using task specific objectives that encourage representations to collapse onto a small number of discriminative directions. While effective for individual prediction problems, this paradigm underutilizes the rich structure of clinical data and limits the transferability, stability, and interpretability of learned features. In this work, we propose dense feature learning, a representation centric framework that explicitly shapes the linear structure of medical embeddings. Our approach operates directly on embedding matrices, encouraging spectral balance, subspace consistency, and feature orthogonality through objectives defined entirely in terms of linear algebraic properties. Without relying on labels or generative reconstruction, dense feature learning produces representations with higher effective rank, improved conditioning, and greater stability across time. Empirical evaluations across longitudinal EHR data, clinical text, and multimodal patient representations demonstrate consistent improvements in downstream linear performance, robustness, and subspace alignment compared to supervised and self supervised baselines. These results suggest that learning to span clinical variation may be as important as learning to predict clinical outcomes, and position representation geometry as a first class objective in medical AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑