解决机器学习、反问题与控制中后续可微性的不连续求根问题
Addressing Discontinuous Root-Finding for Subsequent Differentiability in Machine Learning, Inverse Problems, and Control
AI总结:
本文针对物理碰撞中不连续求根导致的可微性问题,证明碰撞时间导数趋于无穷,通过提升复化解空间并缓和障碍,实现平滑穿越,使标准数值方法适用。
摘要:
许多物理过程在其数学表述中具有固有的不连续性。本文的动机来自于两个刚体或可变形体之间碰撞的具体情况以及该不连续性的内在本质。碰撞的脉冲响应是不连续的,当没有碰撞发生时缺乏任何响应,这给需要可微性的数值方法(这在机器学习、反问题和控制中很典型)带来了困难。我们在理论上和数值上证明,碰撞时间相对于参数的导数在接近分隔碰撞与非碰撞的障碍时会趋于无穷大,并使用提升(lifting)来复化解空间,使得障碍另一侧的解可以直接作为精确值获得。随后,我们缓和(mollify)由无界导数构成的障碍,从而可以平滑且可靠地来回穿越,便于使用标准数值方法。此外,我们展示了标准方法在多种方式下失败,主要是由于对问题数学本质缺乏理解(例如,典型的反向传播利用了许多微分规则,但忽略了洛必达法则)。
英文摘要:
There are many physical processes that have inherent discontinuities in their mathematical formulations. This paper is motivated by the specific case of collisions between two rigid or deformable bodies and the intrinsic nature of that discontinuity. The impulse response to a collision is discontinuous with the lack of any response when no collision occurs, which causes difficulties for numerical approaches that require differentiability which are typical in machine learning, inverse problems, and control. We theoretically and numerically demonstrate that the derivative of the collision time with respect to the parameters becomes infinite as one approaches the barrier separating colliding from not colliding, and use lifting to complexify the solution space so that solutions on the other side of the barrier are directly attainable as precise values. Subsequently, we mollify the barrier posed by the unbounded derivatives, so that one can tunnel back and forth in a smooth and reliable fashion facilitating the use of standard numerical approaches. Moreover, we illustrate that standard approaches fail in numerous ways mostly due to a lack of understanding of the mathematical nature of the problem (e.g. typical backpropagation utilizes many rules of differentiation, but ignores L'Hopital's rule).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。