arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.13296cs.CV
收藏

VQA和视觉推理:最近的数据集,方法和挑战概述

VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges

University of Electronic Science and Technology of China(电子科技大学);Universiti Brunei Darussalam(文莱达鲁萨兰大学)

Rufai Yusuf Zakari, Jim Wilson Owusu, Hailin Wang, Ke Qin, Zaharaddeen Karami Lawal, Yuezhou Dong

摘要:

近年来,人工智能(AI)及其应用引起了人们的极大兴趣。这一成就可以部分归功于人工智能子领域的进步,包括机器学习(ML),计算机视觉(CV)和自然语言处理(NLP)。深度学习是采用人工神经网络概念的机器学习的一个子领域,它使这些领域的增长最为迅速。视觉和语言的融合也因此引发了很多关注。这些任务的创建方式使它们正确地融合了深度学习的概念。在这篇综述论文中,我们提供了一个全面和广泛的审查的最先进的方法,关键模型的设计原则,并讨论现有的数据集,方法,他们的问题制定和评估措施的VQA和视觉推理任务,以了解视觉和语言表示学习。我们还提出了一些潜在的未来路径在这一领域的研究,希望我们的研究可能会产生新的想法和新的方法来处理现有的困难和开发新的应用。

英文摘要:

Artificial Intelligence (AI) and its applications have sparked extraordinary interest in recent years. This achievement can be ascribed in part to advances in AI subfields including Machine Learning (ML), Computer Vision (CV), and Natural Language Processing (NLP). Deep learning, a sub-field of machine learning that employs artificial neural network concepts, has enabled the most rapid growth in these domains. The integration of vision and language has sparked a lot of attention as a result of this. The tasks have been created in such a way that they properly exemplify the concepts of deep learning. In this review paper, we provide a thorough and an extensive review of the state of the arts approaches, key models design principles and discuss existing datasets, methods, their problem formulation and evaluation measures for VQA and Visual reasoning tasks to understand vision and language representation learning. We also present some potential future paths in this field of research, with the hope that our study may generate new ideas and novel approaches to handle existing difficulties and develop new applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑