arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.08450cs.LG
收藏

Design-Bench:数据驱动的离线基于模型的优化基准

Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization

CMU(卡内基梅隆大学);UC Berkeley(加州大学伯克利分校)

Brandon Trabucco, Xinyang Geng, Aviral Kumar, Sergey Levine

摘要:

基于黑盒模型的优化(MBO)问题,其目标是找到一个设计输入,最大化一个未知的目标函数,是无处不在的广泛领域,如蛋白质,DNA序列,飞机和机器人的设计。解决基于模型的优化问题通常需要主动查询设计方案上的未知目标函数,这意味着物理构建候选分子,飞行器或机器人,对其进行测试并存储结果。这个过程可能是昂贵和耗时的,人们可能更愿意只使用已经拥有的数据来优化最佳设计。这种设置-称为离线MBO-与更常见的在线技术相比,提出了大量不同的算法挑战。最近的一些工作已经证明了使用大容量深度神经网络的高维优化问题的离线MBO的成功。然而,由于这一新兴领域缺乏标准化基准,因此难以跟踪进展情况。为了解决这个问题,我们提出了设计工作台,一个基准的离线MBO与一个统一的评估协议和参考实现最近的方法。我们的基准测试包括一套多样化和现实的任务,这些任务来自生物学、材料科学和机器人技术中的现实优化问题,这些问题对离线MBO提出了独特的挑战。我们的基准和参考实现发布在www.example.com和www.example.com。

英文摘要:

Black-box model-based optimization (MBO) problems, where the goal is to find a design input that maximizes an unknown objective function, are ubiquitous in a wide range of domains, such as the design of proteins, DNA sequences, aircraft, and robots. Solving model-based optimization problems typically requires actively querying the unknown objective function on design proposals, which means physically building the candidate molecule, aircraft, or robot, testing it, and storing the result. This process can be expensive and time consuming, and one might instead prefer to optimize for the best design using only the data one already has. This setting -- called offline MBO -- poses substantial and different algorithmic challenges than more commonly studied online techniques. A number of recent works have demonstrated success with offline MBO for high-dimensional optimization problems using high-capacity deep neural networks. However, the lack of standardized benchmarks in this emerging field is making progress difficult to track. To address this, we present Design-Bench, a benchmark for offline MBO with a unified evaluation protocol and reference implementations of recent methods. Our benchmark includes a suite of diverse and realistic tasks derived from real-world optimization problems in biology, materials science, and robotics that present distinct challenges for offline MBO. Our benchmark and reference implementations are released at github.com/rail-berkeley/design-bench and github.com/rail-berkeley/design-baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑