arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.02019cs.LG
收藏

从函数到分布建模:一种面向离线优化的 PAC 生成式方法

From Function to Distribution Modeling: A PAC-Generative Approach to Offline Optimization

Texas A&M University(德克萨斯A&M大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)

Qiang Zhang, Ruida Zhou, Yang Shen, Tie Liu

AI总结:

本文研究离线优化问题,提出将优化视为从生成模型中采样的过程,通过重加权技术并利用PAC下界联合学习权重函数与基于分数的生成模型,在标准基准上展现出鲁棒的竞争性能。

摘要:

本文考虑离线优化问题,其中目标函数是未知的,仅有一组“离线”数据样本。尽管近年来涌现了大量将各种机器学习技术应用于离线优化问题的工作,但这些工作大多侧重于学习未知目标函数的代理模型,然后应用现有的优化算法。虽然对未知目标函数进行建模的想法直观且吸引人,但从学习的角度来看,这也使得根据优化目标来调整学习者的目标变得非常困难。与其先学习再优化未知目标函数,本文采取了一种不太直观但更直接的视角,即将优化视为从生成模型中进行采样的过程。为了从离线数据样本中学习有效的生成模型,我们考虑了“重加权”这一标准技术,而我们的主要技术贡献是给出了自然优化目标上的可能近似正确(PAC)下界,这使我们能够联合学习权重函数和基于分数的生成模型。通过使用标准离线优化基准的实证研究,证明了所提方法具有鲁棒的竞争性能。

英文摘要:

This paper considers the problem of offline optimization, where the objective function is unknown except for a collection of ``offline" data examples. While recent years have seen a flurry of work on applying various machine learning techniques to the offline optimization problem, the majority of these work focused on learning a surrogate of the unknown objective function and then applying existing optimization algorithms. While the idea of modeling the unknown objective function is intuitive and appealing, from the learning point of view it also makes it very difficult to tune the objective of the learner according to the objective of optimization. Instead of learning and then optimizing the unknown objective function, in this paper we take on a less intuitive but more direct view that optimization can be thought of as a process of sampling from a generative model. To learn an effective generative model from the offline data examples, we consider the standard technique of ``re-weighting", and our main technical contribution is a probably approximately correct (PAC) lower bound on the natural optimization objective, which allows us to jointly learn a weight function and a score-based generative model. The robustly competitive performance of the proposed approach is demonstrated via empirical studies using the standard offline optimization benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑