arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.07091cs.CVcs.AI
收藏

以对象为中心的表征、引导注意力与外部记忆在视觉关系泛化中的作用

The role of object-centric representations, guided attention, and external memory on generalizing visual relations

National Center for Artificial Intelligence(国家人工智能中心);University of Bristol(布里斯托尔大学)

Guillermo Puebla, Jeffrey S. Bowers

AI总结:

本研究针对视觉关系泛化问题,在“同-异”判断任务中系统评估了整合槽注意力等机制的深度神经网络,发现无模型能全面泛化该关系,证实抽象视觉推理仍是未解决的挑战。

摘要:

视觉推理是视觉研究的长期目标。过去十年间,多项研究尝试将深度神经网络(DNNs)应用于从图像中学习视觉关系的任务,但在所学关系的泛化性方面效果有限。近年来,为实现从图像中学习抽象关系,DNNs领域涌现出多项创新技术。本研究在最简单的视觉推理任务——判断两个对象是否相同——中,系统评估了一系列整合了slot attention(槽注意力)、循环引导注意力、外部记忆等机制的DNN模型。我们发现,尽管部分模型在将“同-异”关系泛化到特定类型图像时表现优于其他模型,但没有模型能够实现该关系的全面泛化。我们得出结论:抽象视觉推理在很大程度上仍是DNNs尚未解决的挑战。

英文摘要:

Visual reasoning is a long-term goal of vision research. In the last decade, several works have attempted to apply deep neural networks (DNNs) to the task of learning visual relations from images, with modest results in terms of the generalization of the relations learned. In recent years, several innovations in DNNs have been developed in order to enable learning abstract relation from images. In this work, we systematically evaluate a series of DNNs that integrate mechanism such as slot attention, recurrently guided attention, and external memory, in the simplest possible visual reasoning task: deciding whether two objects are the same or different. We found that, although some models performed better than others in generalizing the same-different relation to specific types of images, no model was able to generalize this relation across the board. We conclude that abstract visual reasoning remains largely an unresolved challenge for DNNs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑