arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.06549cs.LG
收藏

通过对抗信息分离精炼信息瓶颈

Refining the Information Bottleneck via Adversarial Information Separation

Shandong Key Laboratory of Ubiquitous Intelligent Computing, University of Jinan, Shandong, China(山东智能计算关键实验室,济南大学,山东,中国);Quan Cheng Laboratory, Jinan, China(泉城实验室,中国济南);David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, Canada(大卫·R·切里顿计算机科学学院,滑铁卢大学,加拿大滑铁卢);School of Artificial Intelligence, Shandong Women’s University, Jinan, China(人工智能学院,山东女子大学,中国济南)

Shuai Ning, Zhenpeng Wang, Lin Wang, Bing Chen, Shuangrong Liu, Xu Wu, Jin Zhou, Bo Yang

AI总结:

本文提出AdverISF框架,通过自监督对抗机制和多层分离架构,在无需显式监督的情况下实现更精确的任务相关特征提取,提升数据稀缺场景下的泛化性能。

摘要:

在材料科学等领域,从有限数据中进行泛化尤为关键,因为实验数据集中的任务相关特征往往严重混杂于测量噪声和实验伪影中。标准正则化技术无法精确分离有意义的特征与噪声,而现有对抗适应方法受限于其对显式分离标签的依赖。为解决这一挑战,我们提出了对抗信息分离框架(AdverISF),该框架能够在不需显式监督的情况下隔离任务相关特征与噪声。AdverISF引入了一种自监督对抗机制,以强制任务相关特征与噪声表示之间统计独立。它进一步采用多层分离架构,通过在特征层次中逐步重用噪声信息来恢复被误判为噪声的特征,从而实现更细粒度的特征提取。广泛实验表明,AdverISF在数据稀缺场景中优于现有最先进方法。此外,对真实世界材料设计任务的评估显示,它实现了更优越的泛化性能。

英文摘要:

Generalizing from limited data is particularly critical for models in domains such as material science, where task-relevant features in experimental datasets are often heavily confounded by measurement noise and experimental artifacts. Standard regularization techniques fail to precisely separate meaningful features from noise, while existing adversarial adaptation methods are limited by their reliance on explicit separation labels. To address this challenge, we propose the Adversarial Information Separation Framework (AdverISF), which isolates task-relevant features from noise without requiring explicit supervision. AdverISF introduces a self-supervised adversarial mechanism to enforce statistical independence between task-relevant features and noise representations. It further employs a multi-layer separation architecture that progressively recycles noise information across feature hierarchies to recover features inadvertently discarded as noise, thereby enabling finer-grained feature extraction. Extensive experiments demonstrate that AdverISF outperforms state-of-the-art methods in data-scarce scenarios. In addition, evaluations on real-world material design tasks show that it achieves superior generalization performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑