将增量λ演算演化为前向自动微分模型(AD)
Evolving the Incremental λ Calculus into a Model of Forward Automatic Differentiation (AD)
摘要:
在计算机科学中,形式变换在某种程度上类似于通常的导数,这是令人惊讶的常见现象,其中两个值得注意的例子是正则表达式的导数和类型的导数。这个列表中的一个新成员是增量$λ$ -演算,或ILC,一种“变化理论”,它部署了一种形式化的设备,允许自动生成执行增量计算的有效更新函数。ILC不仅被定义,而且给出了一个正式的机器可理解的定义-伴随着各种属性的机械可验证的证明,特别是包括各种正确性。在这里,我们展示了如何ILC可以突变成传播切线,从而作为一个模型的前向积累模式自动微分。这种突变分几步完成。这些步骤也可以应用到证明中,从而得到该前向AD模型正确性的机器检查证明。
英文摘要:
Formal transformations somehow resembling the usual derivative are surprisingly common in computer science, with two notable examples being derivatives of regular expressions and derivatives of types. A newcomer to this list is the incremental $λ$-calculus, or ILC, a "theory of changes" that deploys a formal apparatus allowing the automatic generation of efficient update functions which perform incremental computation. The ILC is not only defined, but given a formal machine-understandable definition---accompanied by mechanically verifiable proofs of various properties, including in particular correctness of various sorts. Here, we show how the ILC can be mutated into propagating tangents, thus serving as a model of Forward Accumulation Mode Automatic Differentiation. This mutation is done in several steps. These steps can also be applied to the proofs, resulting in machine-checked proofs of the correctness of this model of forward AD.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。