arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.01886cs.AI
收藏

多模态仿真中的情境基础

Situational Grounding within Multimodal Simulations

Brandeis University(布兰迪斯大学)

James Pustejovsky, Nikhil Krishnaswamy

摘要:

在本文中,我们认为,仿真平台使一种新型的体现空间推理,一个方便的对象和事件语义,使连续定量搜索空间的开放世界,实时环境易于处理的正式模型。我们提供了一些例子,说明语义信息AI系统如何利用游戏引擎提供的精确的数字信息来对对象和事件进行定性推理,促进从数据中学习新概念,并与人类进行通信以改进其模型并展示其理解。我们认为,模拟环境,特别是游戏引擎,汇集了许多不同的“模拟”概念和许多不同的技术,为开发人工智能系统和工具提供了一个高效的平台,以便在机器和人类智能方面进行实验。

英文摘要:

In this paper, we argue that simulation platforms enable a novel type of embodied spatial reasoning, one facilitated by a formal model of object and event semantics that renders the continuous quantitative search space of an open-world, real-time environment tractable. We provide examples for how a semantically-informed AI system can exploit the precise, numerical information provided by a game engine to perform qualitative reasoning about objects and events, facilitate learning novel concepts from data, and communicate with a human to improve its models and demonstrate its understanding. We argue that simulation environments, and game engines in particular, bring together many different notions of "simulation" and many different technologies to provide a highly-effective platform for developing both AI systems and tools to experiment in both machine and human intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑