Many engineering problems require identifying feasible domains under implicit constraints. One example is finding acceptable car body styling designs based on constraints like aesthetics and functionality. Current active-learning based methods learn feasible domains for bounded input spaces. However, we usually lack prior knowledge about how to set those input variable bounds. Bounds that are too small will fail to cover all feasible domains; while bounds that are too large will waste query budget. To avoid this problem, we introduce Active Expansion Sampling (AES), a method that identifies (possibly disconnected) feasible domains over an unbounded input space. AES progressively expands our knowledge of the input space, and uses successive exploitation and exploration stages to switch between learning the decision boundary and searching for new feasible domains. We show that AES has a misclassification loss guarantee within the explored region, independent of the number of iterations or labeled samples. Thus it can be used for real-time prediction of samples' feasibility within the explored region. We evaluate AES on three test examples and compare AES with two adaptive sampling methods -- the Neighborhood-Voronoi algorithm and the straddle heuristic -- that operate over fixed input variable bounds.
Stable Reinforcement Learning with Unbounded State Space
MIT(麻省理工学院);Cornell University(康奈尔大学)
本文考虑了由调度网络中的经典调度问题所激发的具有无界状态空间的强化学习(RL)问题。传统的策略以及为有限、有界或紧凑状态空间设计的误差度量需要无限样本来为无界状态空间提供任何有意义的性能保证(例如,$\ell_\infty$误差)。也就是说,我们需要一个新的性能度量概念。作为这项工作的主要贡献,在排队系统与控制理论的文献的启发下,我们提出了稳定性的概念“善良”的状态动态下的政策应保持在一个有界区域的高概率。作为概念的证明,我们提出了一个RL政策,使用稀疏采样为基础的Monte Carlo Oracle,并认为它满足稳定性,只要系统动力学下的最优策略尊重李雅普诺夫函数。存在李雅普诺夫函数的假设不是限制性的,因为它等价于任何马尔可夫链的正递归或稳定性,即,如果有任何政策可以稳定系统,那么它必须拥有一个李雅普诺夫函数。而且,我们的政策不利用知识的具体李雅普诺夫函数。为了使我们的方法样本效率,我们提供了一个改进的,样本效率的稀疏采样的蒙特卡罗Oracle与Lipschitz价值函数,可能是在自己的权利感兴趣。此外,我们设计了一个自适应版本的算法,精心构造的统计测试,自动找到正确的调整参数的基础上。
Evaluation of Sampling Strategies and Physics-Informed Kolmogorov--Arnold Networks in Unbounded Domains
Mathematical Applications in Science and Engineering, School of Applied Sciences and Engineering, Universidad EAFIT, Medellín, Colombia(科学与工程数学应用,应用科学与工程学院,埃法伊特大学,梅德林,哥伦比亚);Nature and City, School of Applied Sciences and Engineering, Universidad EAFIT, Medellín, Colombia(自然与城市,应用科学与工程学院,埃法伊特大学,梅德林,哥伦比亚)
High precision PINNs in unbounded domains: application to singularity formulation in PDEs
California Institute of Technology(加州理工学院);Massachusetts Institute of Technology(麻省理工学院);The NSF Institute for Artificial Intelligence and Fundamental Interactions(NSF人工智能与基础相互作用研究所)