arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.04852cs.CVcs.LG
收藏

CAUSAL3D:面向视觉数据因果学习的综合基准

CAUSAL3D: A Comprehensive Benchmark for Causal Learning from Visual Data

Case Western Reserve University(凯斯西储大学)

Disheng Liu, Yiran Qiao, Wuche Liu, Yiren Lu, Yunlai Zhou, Tuo Liang, Yu Yin, Jing Ma

AI总结:

针对视觉因果推理评估基准缺失的问题,本文提出整合表格与图像的综合基准Causal3D,含19个多场景3D数据集,测试发现无先验下复杂因果结构会使前沿方法性能骤降,为CV因果推理与可信AI研究提供关键支撑。

摘要:

真正的智能依赖于发现并利用隐藏因果关系的能力。尽管人工智能与计算机视觉(CV)领域已取得显著进展,但目前仍缺乏用于评估模型从复杂视觉数据中推断潜在因果关系能力的基准。本文提出了\textsc{\textbf{Causal3D}}这一全新的综合基准,它将结构化数据(表格)与对应的视觉表征(图像)相结合,用于评估因果推理能力。Causal3D在系统化框架下设计,包含19个3D场景数据集,覆盖多样的因果关系、视角与背景,可支持不同复杂度场景下的评估。我们评估了多种前沿方法,包括经典因果发现、因果表征学习以及大语言模型/视觉语言模型(LLMs/VLMs)。实验表明,当无先验知识且因果结构更趋复杂时,模型性能会显著下降,凸显出即便是先进方法在复杂因果场景中也面临挑战。Causal3D是推动计算机视觉领域因果推理发展、助力关键领域构建可信AI的重要资源。

英文摘要:

True intelligence hinges on the ability to uncover and leverage hidden causal relations. Despite significant progress in AI and computer vision (CV), there remains a lack of benchmarks for assessing models' abilities to infer latent causality from complex visual data. In this paper, we introduce \textsc{\textbf{Causal3D}}, a novel and comprehensive benchmark that integrates structured data (tables) with corresponding visual representations (images) to evaluate causal reasoning. Designed within a systematic framework, Causal3D comprises 19 3D-scene datasets capturing diverse causal relations, views, and backgrounds, enabling evaluations across scenes of varying complexity. We assess multiple state-of-the-art methods, including classical causal discovery, causal representation learning, and large/vision-language models (LLMs/VLMs). Our experiments show that as causal structures grow more complex without prior knowledge, performance declines significantly, highlighting the challenges even advanced methods face in complex causal scenarios. Causal3D serves as a vital resource for advancing causal reasoning in CV and fostering trustworthy AI in critical domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑