arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.03310cs.AIcs.CV
收藏

V-IRL:在现实生活中落地虚拟智能

V-IRL: Grounding Virtual Intelligence in Real Life

The University of Hong Kong(香港大学);New York University(纽约大学)

Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie

AI总结:

V-IRL是一个虚拟但逼真的平台,旨在弥合数字与物理世界的差距,使AI智能体可扩展地与现实世界交互,并作为开发与测试其感知、决策及交互能力的场所。

摘要:

人类居住的地球与创造现代人工智能智能体的数字领域之间存在着感官鸿沟。为了开发能够在现实环境中像人类一样灵活地感知、思考和行动的人工智能智能体,必须弥合数字世界与物理世界之间的现实差距。我们如何在不受到真实硬件和控制所施加限制的情况下,将智能体置于一个与我们居住环境一样丰富多样的环境中?为此,我们引入了V-IRL:一个平台,使智能体能够在虚拟但逼真的环境中可扩展地与真实世界交互。我们的平台既是一个开发能够完成各种实际任务的智能体的游乐场,也是一个用于衡量跨越感知、决策以及与全球真实世界数据交互等能力进展的广阔测试平台。

英文摘要:

There is a sensory gulf between the Earth that humans inhabit and the digital realms in which modern AI agents are created. To develop AI agents that can sense, think, and act as flexibly as humans in real-world settings, it is imperative to bridge the realism gap between the digital and physical worlds. How can we embody agents in an environment as rich and diverse as the one we inhabit, without the constraints imposed by real hardware and control? Towards this end, we introduce V-IRL: a platform that enables agents to scalably interact with the real world in a virtual yet realistic environment. Our platform serves as a playground for developing agents that can accomplish various practical tasks and as a vast testbed for measuring progress in capabilities spanning perception, decision-making, and interaction with real-world data across the entire globe.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑