arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.07568cs.CL
收藏

基于视觉和语言模态的动作推理研究综述

Reasoning about Actions over Visual and Linguistic Modalities: A Survey

Arizona State University(亚利桑那州立大学)

Shailaja Keyur Sampat, Maitreya Patel, Subhasish Das, Yezhou Yang, Chitta Baral

摘要:

“行动”在人类如何与世界互动并使他们实现预期目标方面发挥着至关重要的作用。因此,人类的大多数常识(CS)知识都围绕着行动。虽然“关于动作和变化的推理”(RAC)在知识表示社区中得到了广泛的研究,但它最近引起了NLP和计算机视觉研究人员的兴趣。本文调查了现有的任务,基准数据集,各种技术和模型,以及它们各自的性能,涉及RAC在视觉和语言领域的进展。最后,我们总结了我们的主要收获,讨论了这一研究领域目前面临的挑战,并概述了未来研究的潜在方向。

英文摘要:

'Actions' play a vital role in how humans interact with the world and enable them to achieve desired goals. As a result, most common sense (CS) knowledge for humans revolves around actions. While 'Reasoning about Actions & Change' (RAC) has been widely studied in the Knowledge Representation community, it has recently piqued the interest of NLP and computer vision researchers. This paper surveys existing tasks, benchmark datasets, various techniques and models, and their respective performance concerning advancements in RAC in the vision and language domain. Towards the end, we summarize our key takeaways, discuss the present challenges facing this research area, and outline potential directions for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑