arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.10430eess.SYcs.AIcs.SEcs.SY
收藏

自治智能体的多Agent系统测试与评估框架

Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents

Virginia Tech(弗吉尼亚理工大学);Purdue University(普渡大学);George Mason University(乔治梅森大学)

Erin Lanus, Ivan Hernandez, Adam Dachowicz, Laura Freeman, Melanie Grande, Andrew Lang, Jitesh H. Panchal, Anthony Patrick, Scott Welch

摘要:

测试和评估是确保工程系统在各种预期和意外条件下按预期运行的必要过程。在这项工作中,我们考虑了为具有嵌入式人工智能的复杂网络物理系统集成开发统一测试和评估框架的独特挑战。我们提出了一个框架,不仅在整个开发生命周期中进行测试和评估,而且随着系统在嘈杂,不断变化和竞争的环境中学习和适应,该框架将继续运行。该框架考虑到了在测试时间和资源有限的同时,在各种层次结构的组成尺度上测试不同系统集成的挑战。一个通用的用例提供了说明性的目的和研究方向出现的结果,探索用例通过框架的建议。

英文摘要:

Test and evaluation is a necessary process for ensuring that engineered systems perform as intended under a variety of conditions, both expected and unexpected. In this work, we consider the unique challenges of developing a unifying test and evaluation framework for complex ensembles of cyber-physical systems with embedded artificial intelligence. We propose a framework that incorporates test and evaluation throughout not only the development life cycle, but continues into operation as the system learns and adapts in a noisy, changing, and contended environment. The framework accounts for the challenges of testing the integration of diverse systems at various hierarchical scales of composition while respecting that testing time and resources are limited. A generic use case is provided for illustrative purposes and research directions emerging as a result of exploring the use case via the framework are suggested.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑