arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.03487cs.LG
收藏

ObjectRL:一个面向对象的强化学习代码库

ObjectRL: An Object-Oriented Reinforcement Learning Codebase

Department of Mathematics and Computer Science University of Southern Denmark(数学与计算机科学系 欧洲南部大学)

Gulcin Baykal, Abdullah Akgül, Manuel Haussmann, Bahareh Tasdighi, Nicklas Werge, Yi-Shan Wu, Melih Kandemir

AI总结:

ObjectRL 是一个基于面向对象编程原则的开源深度强化学习代码库,通过清晰的类层次结构和组件化设计降低研究原型开发门槛,提升算法实现、修改与评估的灵活性和效率。

摘要:

ObjectRL 是一个用于深度强化学习(RL)的开源 Python 代码库,旨在以最少的编程工作量进行面向研究的原型开发。与现有代码库不同,ObjectRL 基于面向对象编程(OOP)原则构建,提供了清晰的结构,简化了新算法的实现、修改和评估。ObjectRL 通过将最佳实践组织为明确、清晰分离的组件,使其更易于理解和调整,从而降低了深度 RL 研究的入门门槛。每个算法组件都是一个类,其属性描述关键的 RL 概念,其方法直观地反映它们之间的交互。类层次结构紧密遵循常见的本体关系,支持数据封装、继承和多态,这些都是 OOP 的核心特性。我们通过具有代表性的用例展示了 ObjectRL 设计的效率,突出了其灵活性和对快速原型开发的适用性。文档和源代码可在 https://objectrl.readthedocs.io 和 https://github.com/adinlab/objectrl 获取。

英文摘要:

ObjectRL is an open-source Python codebase for deep reinforcement learning (RL), designed for research-oriented prototyping with minimal programming effort. Unlike existing codebases, ObjectRL is built on Object-Oriented Programming (OOP) principles, providing a clear structure that simplifies the implementation, modification, and evaluation of new algorithms. ObjectRL lowers the entry barrier for deep RL research by organizing best practices into explicit, clearly separated components, making them easier to understand and adapt. Each algorithmic component is a class with attributes that describe key RL concepts and methods that intuitively reflect their interactions. The class hierarchy closely follows common ontological relationships, enabling data encapsulation, inheritance, and polymorphism, which are core features of OOP. We demonstrate the efficiency of ObjectRL's design through representative use cases that highlight its flexibility and suitability for rapid prototyping. The documentation and source code are available at https://objectrl.readthedocs.io and https://github.com/adinlab/objectrl .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑