PufferLib:让强化学习库与环境良好协作
PufferLib: Making Reinforcement Learning Libraries and Environments Play Nice
AI总结:
针对强化学习中环境、模型与库不兼容的问题,PufferLib提供单行环境包装器与快速向量化功能,支持多类库适配从经典基准到复杂模拟器的数十种环境,且开源并配套完整资源。
摘要:
你有一套本应协同工作却互不兼容的环境、模型和强化学习库,PufferLib可让它们顺畅配合。该库提供单行环境包装器,能消除常见兼容性问题,还具备快速向量化功能以加速训练。借助PufferLib,你可使用CleanRL、SB3等熟悉的库,将应用规模从Atari、Procgen等经典基准拓展到NetHack、Neural MMO等复杂模拟器。我们发布了pip包与预构建镜像,包含数十种环境的依赖。所有代码均为MIT许可下的免费开源软件,配套基线、文档及支持服务可访问pufferai.github.io获取。
英文摘要:
You have an environment, a model, and a reinforcement learning library that are designed to work together but don't. PufferLib makes them play nice. The library provides one-line environment wrappers that eliminate common compatibility problems and fast vectorization to accelerate training. With PufferLib, you can use familiar libraries like CleanRL and SB3 to scale from classic benchmarks like Atari and Procgen to complex simulators like NetHack and Neural MMO. We release pip packages and prebuilt images with dependencies for dozens of environments. All of our code is free and open-source software under the MIT license, complete with baselines, documentation, and support at pufferai.github.io.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。