arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.08046cs.CV
收藏

用 DIFFusion 向人类教授细微差异

Teaching Humans Subtle Differences with DIFFusion

Columbia University(哥伦比亚大学);UC Berkeley(加州大学伯克利分校);California Institute of Technology(加州理工学院)

Mia Chiquier, Orr Avrech, Yossi Gandelsman, Berthy Feng, Katherine Bouman, Carl Vondrick

AI总结:

本文提出 DIFFusion 系统,利用生成模型在保留实例身份的前提下生成类别间的细微反事实变换,并在六个领域验证其能有效帮助人类学习细粒度视觉差异。

摘要:

科学专长通常需要识别细微的视觉差异,而这些差异即使对领域专家来说也难以清楚表述。我们提出一个利用生成模型的系统,可在保留实例身份的同时,自动发现并可视化类别之间的最小判别特征。我们的方法通过在类别之间进行细微、有针对性的变换来生成反事实可视化,即使在数据稀疏、样本不成对且类别边界难以用语言描述的领域也表现良好。在包括黑洞模拟、蝴蝶分类学和医学成像在内的六个领域进行的实验表明,该方法能在训练数据有限的情况下实现准确转换,既突出了既有判别特征,也揭示了可显著改善类别区分的新型细微差别。用户研究证实,我们生成的反事实在教人类正确区分细粒度类别方面显著优于传统方法,展示了生成模型推进视觉学习和科学研究的潜力。

英文摘要:

Scientific expertise often requires recognizing subtle visual differences that remain challenging to articulate even for domain experts. We present a system that leverages generative models to automatically discover and visualize minimal discriminative features between categories while preserving instance identity. Our method generates counterfactual visualizations with subtle, targeted transformations between classes, performing well even in domains where data is sparse, examples are unpaired, and category boundaries resist verbal description. Experiments across six domains, including black hole simulations, butterfly taxonomy, and medical imaging, demonstrate accurate transitions with limited training data, highlighting both established discriminative features and novel subtle distinctions that measurably improved category differentiation. User studies confirm our generated counterfactuals significantly outperform traditional approaches in teaching humans to correctly differentiate between fine-grained classes, showing the potential of generative models to advance visual learning and scientific research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑