arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.04813cs.AI
收藏

人在回路的新颖性生成

Human in the Loop Novelty Generation

PacMar Technologies(帕克马尔科技公司);Parallax Advanced Research(视差高级研究院)

Mark Bercasio, Allison Wong, Dustin Dannenhauer

AI总结:

针对AI应对新颖情境的测试框架缺失问题,提出无需领域特定人类指导、基于环境抽象模型的人在回路新颖性生成方法,可生成更大规模新颖性空间,在两个测试领域均能在4小时内完成新颖性全流程开发。

摘要:

开发能应对新颖、意外情况的人工智能方法是一个棘手且尚未解决的难题。推动新颖性适应领域技术发展的一大挑战,是缺乏可用于评估系统在新颖情境下表现的测试框架。Science Birds和Monopoly等领域近期的新颖性生成方法,在搜索过程中利用人类领域专业知识来发现新的新颖性。这类方法在新颖性生成前引入人类指导,生成的新颖性可直接加载到模拟环境中。我们提出了一种新颖性生成新方法,该方法使用环境(包括模拟领域)的抽象模型,无需依赖特定领域的人类指导即可生成新颖性。该方法的核心成果是可生成规模更大、通常是无限的新颖性空间,其代价是需要在生成后引入人类指导来筛选和过滤新颖性。我们介绍了基于开源新颖性生成库的人在回路新颖性生成流程,并在Monopoly和VizDoom两个领域中对基线智能体进行了测试。结果显示,对于Monopoly和VizDoom两个领域,人在回路方法都能让用户在4小时内完成新颖性的开发、实现、测试和修订。

英文摘要:

Developing artificial intelligence approaches to overcome novel, unexpected circumstances is a difficult, unsolved problem. One challenge to advancing the state of the art in novelty accommodation is the availability of testing frameworks for evaluating performance against novel situations. Recent novelty generation approaches in domains such as Science Birds and Monopoly leverage human domain expertise during the search to discover new novelties. Such approaches introduce human guidance before novelty generation occurs and yield novelties that can be directly loaded into a simulated environment. We introduce a new approach to novelty generation that uses abstract models of environments (including simulation domains) that do not require domain-dependent human guidance to generate novelties. A key result is a larger, often infinite space of novelties capable of being generated, with the trade-off being a requirement to involve human guidance to select and filter novelties post generation. We describe our Human-in-the-Loop novelty generation process using our open-source novelty generation library to test baseline agents in two domains: Monopoly and VizDoom. Our results shows the Human-in-the-Loop method enables users to develop, implement, test, and revise novelties within 4 hours for both Monopoly and VizDoom domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑