通过线性求解器进行微分
Differentiating Through Linear Solvers
AI总结:
本文实证比较了对线性求解器直接进行自动微分与采用高层修改线性系统方法之间的精度差异,挑战了该领域长期以来的普遍建议。
摘要:
包含线性求解器调用的计算机程序是自动微分领域的一个已知难题。以往的文献建议不要对底层求解器实现进行微分,而是提倡采用高层方法,将导数表示为一个修改后的线性系统,并可通过单独的求解器调用来求解。尽管这一建议广为流传,但我们尚未发现此前有工作对这两种方法的精度进行比较。因此,本文通过实证研究一个简单的问题:如果我们忽略这一普遍认知,直接对线性求解器进行微分,会发生什么?
英文摘要:
Computer programs containing calls to linear solvers are a known challenge for automatic differentiation. Previous publications advise against differentiating through the low-level solver implementation, and instead advocate for high-level approaches that express the derivative in terms of a modified linear system that can be solved with a separate solver call. Despite this ubiquitous advice, we are not aware of prior work comparing the accuracy of both approaches. With this article we thus empirically study a simple question: What happens if we ignore common wisdom, and differentiate through linear solvers?
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。