CRAFT:一种用于视觉功能可供性定位的神经符号框架
CRAFT: A Neuro-Symbolic Framework for Visual Functional Affordance Grounding
AI总结:
CRAFT是一个神经符号框架,融合ConceptNet、语言模型与CLIP,通过基于能量的迭代推理实现可解释的视觉功能可供性定位,在无标签多物体场景中同时提升准确率与可解释性。
摘要:
我们提出CRAFT,一个用于可解释可供性定位的神经符号框架,它识别场景中能够支持给定动作(例如“切割”)的物体。CRAFT将来自ConceptNet和语言模型的结构化常识先验与来自CLIP的视觉证据相结合,利用基于能量的推理循环迭代地优化预测。这一过程产生透明的、目标驱动的决策,以定位符号结构和感知结构。在多物体、无标签设置下的实验表明,CRAFT在提高可解释性的同时提升了准确率,朝着鲁棒且可信的场景理解迈出了一步。
英文摘要:
We introduce CRAFT, a neuro-symbolic framework for interpretable affordance grounding, which identifies the objects in a scene that enable a given action (e.g., "cut"). CRAFT integrates structured commonsense priors from ConceptNet and language models with visual evidence from CLIP, using an energy-based reasoning loop to refine predictions iteratively. This process yields transparent, goal-driven decisions to ground symbolic and perceptual structures. Experiments in multi-object, label-free settings demonstrate that CRAFT enhances accuracy while improving interpretability, providing a step toward robust and trustworthy scene understanding.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。