arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.07035cs.CLcs.CV
收藏

视觉与语言导航的今天与明天:基础模型时代的综述

Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models

Michigan State University(密歇根州立大学);University of Michigan(密歇根大学);UNC Chapel Hill(北卡罗来纳大学教堂山分校);University of Adelaide(阿德莱德大学)

Yue Zhang, Ziqiao Ma, Jialu Li, Yanyuan Qiao, Zun Wang, Joyce Chai, Qi Wu, Mohit Bansal, Parisa Kordjamshidi

AI总结:

本文综述了基础模型时代视觉与语言导航的研究现状,提出具身规划与推理框架,梳理当前方法并展望基础模型在该领域的未来机遇。

摘要:

视觉与语言导航(VLN)近年来受到越来越多的关注,许多方法相继涌现以推动其发展。基础模型的显著成就塑造了VLN研究中的挑战和所提出的方法。在本综述中,我们提供了一种自上而下的回顾,采用面向具身规划与推理的原则性框架,并重点介绍当前利用基础模型应对VLN挑战的方法以及未来的机遇。我们希望深入的讨论能够提供有价值的资源和见解:一方面,标记该领域的进展并探索基础模型在此领域中的机遇和潜在作用;另一方面,将VLN中的不同挑战和解决方案整理给基础模型研究者。

英文摘要:

Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of foundation models have shaped the challenges and proposed methods for VLN research. In this survey, we provide a top-down review that adopts a principled framework for embodied planning and reasoning, and emphasizes the current methods and future opportunities leveraging foundation models to address VLN challenges. We hope our in-depth discussions could provide valuable resources and insights: on one hand, to milestone the progress and explore opportunities and potential roles for foundation models in this field, and on the other, to organize different challenges and solutions in VLN to foundation model researchers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑