通过延迟机制实现 DareFightingICE 智能体评估的公平性
Achieving Fairness in DareFightingICE Agents Evaluation Through a Delay Mechanism
AI总结:
针对 DareFightingICE 中 gRPC 延迟差异导致 Java 与 Python 智能体性能不公的问题,提出延迟机制,使两类智能体表现相似,实现公平评估。
摘要:
本文提出一种延迟机制,以减轻 gRPC 框架——一个高性能、开源的通用远程过程调用(RPC)框架——中不同编程语言之间的延迟差异对 DareFightingICE(一个格斗游戏研究平台)中智能体性能的影响。研究发现,Java 与 Python 之间的 gRPC 延迟差异能显著影响实时决策。在没有延迟机制的情况下,基于 Java 的智能体由于在 Java 平台上 gRPC 延迟较低而表现优于基于 Python 的智能体。然而,采用所提出的延迟机制后,基于 Java 和基于 Python 的智能体表现出相似的性能,从而实现了对不同编程语言开发的智能体之间的公平比较。因此,这项工作强调了在 DareFightingICE 中开发和评估智能体时考虑 gRPC 延迟的关键重要性,所获得的见解可能扩展到其他基于 gRPC 的应用。
英文摘要:
This paper proposes a delay mechanism to mitigate the impact of latency differences in the gRPC framework--a high-performance, open-source universal remote procedure call (RPC) framework--between different programming languages on the performance of agents in DareFightingICE, a fighting game research platform. The study finds that gRPC latency differences between Java and Python can significantly impact real-time decision-making. Without a delay mechanism, Java-based agents outperform Python-based ones due to lower gRPC latency on the Java platform. However, with the proposed delay mechanism, both Java-based and Python-based agents exhibit similar performance, leading to a fair comparison between agents developed using different programming languages. Thus, this work underscores the crucial importance of considering gRPC latency when developing and evaluating agents in DareFightingICE, and the insights gained could potentially extend to other gRPC-based applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。