arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.01889cs.LGcs.AI
收藏

位移稀疏神经最优传输

Displacement-Sparse Neural Optimal Transport

Department of Mathematics, Columbia University(哥伦比亚大学数学系);HKU Musketeers Foundation Institute of Data Science(香港大学 Musketeers 基金会数据科学研究所);HKU-Shanghai Intelligent Computing Research Center(香港大学-上海智能计算研究中心)

Peter Chen, Yue Xie, Qingpeng Zhang

AI总结:

针对神经最优传输求解器高维映射可解释性差的问题,提出带平滑ℓ₀正则化的位移稀疏映射学习方法,并结合输入凸神经网络构建自适应稀疏控制框架,在大规模高维训练中实现精度提升与易用性优化。

摘要:

最优传输(OT)旨在找到一个映射$T$,在最小化代价函数的同时将质量从一个概率测度传输到另一个概率测度。近年来,神经OT求解器在药物扰动等高维生物学应用中得到广泛应用,因为与传统的精确Sinkhorn求解器相比,它们具有更优的计算效率和内存效率。然而,神经OT求解器学习到的过于复杂的高维映射往往存在可解释性差的问题。先前的研究在精确OT求解器的背景下,通过设计弹性代价引入了“位移稀疏映射”来解决这个问题,但该方法无法应用于神经OT场景。在本研究中,我们提出了一种直观且有理论依据的方法,用于在神经OT求解器中学习位移稀疏映射。基于我们的新公式,我们引入了一种新颖的平滑$\boldsymbol{\textit{ℓ}}_0$正则化器,其性能优于先前研究中基于$\boldsymbol{\textit{ℓ}}_1$的替代方案。利用输入凸神经网络的灵活性,我们进一步开发了一个启发式框架,用于自适应控制稀疏强度,这是一种仅能通过神经OT范式实现的方法。我们证明了该自适应框架在大规模高维训练中的必要性,结果表明其不仅提高了精度,还为下游应用提供了实际易用性。

英文摘要:

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such as drug perturbation, due to their superior computational and memory efficiency compared to traditional exact Sinkhorn solvers. However, the overly complex high dimensional maps learned by neural OT solvers often suffer from poor interpretability. Prior work addressed this issue in the context of exact OT solvers by introducing \emph{displacement-sparse maps} via designed elastic cost, but such method failed to be applied to neural OT settings. In this work, we propose an intuitive and theoretically grounded approach to learning \emph{displacement-sparse maps} within neural OT solvers. Building on our new formulation, we introduce a novel smoothed $\ell_0$ regularizer that outperforms the $\ell_1$ based alternative from prior work. Leveraging Input Convex Neural Network's flexibility, we further develop a heuristic framework for adaptively controlling sparsity intensity, an approach uniquely enabled by the neural OT paradigm. We demonstrate the necessity of this adaptive framework in large-scale, high-dimensional training, showing not only improved accuracy but also practical ease of use for downstream applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑