Keras Sig:Keras 3中基于GPU的高效路径签名计算
Keras Sig: Efficient Path Signature Computation on GPU in Keras 3
AI总结:
本研究提出基于Keras 3的高性能路径签名计算库Keras Sig,通过重构计算利用GPU并行性,实现训练时间减少55%、签名计算速度提升5-10倍,降低兼容性问题且在多硬件下性能优异。
摘要:
本文介绍了Keras Sig,这是一款专为深度学习应用设计的高性能Python风格库,用于计算路径签名。Keras Sig完全基于Keras 3构建,可与PyTorch、JAX和TensorFlow等主流深度学习后端无缝集成。受Kidger和Lyons(2021)的研究启发,我们提出了一种新方法,通过重构签名计算流程来利用GPU并行性。这一调整使训练时间减少了55%,直接签名计算速度相比现有方法提升了5到10倍,同时保持了相近的CPU性能。Keras Sig依赖高层张量运算而非底层C++代码,显著减少了深度学习库中常见的版本控制与兼容性问题,且在各类硬件配置下均能提供优异或相当的性能。我们通过大量基准测试证明,该方法可随输入序列长度高效扩展,在不同签名参数下均保持有竞争力的性能,不过在签名维度极大时会受内存限制约束。
英文摘要:
In this paper we introduce Keras Sig a high-performance pythonic library designed to compute path signature for deep learning applications. Entirely built in Keras 3, \textit{Keras Sig} leverages the seamless integration with the mostly used deep learning backends such as PyTorch, JAX and TensorFlow. Inspired by Kidger and Lyons (2021),we proposed a novel approach reshaping signature calculations to leverage GPU parallelism. This adjustment allows us to reduce the training time by 55\% and 5 to 10-fold improvements in direct signature computation compared to existing methods, while maintaining similar CPU performance. Relying on high-level tensor operations instead of low-level C++ code, Keras Sig significantly reduces the versioning and compatibility issues commonly encountered in deep learning libraries, while delivering superior or comparable performance across various hardware configurations. We demonstrate through extensive benchmarking that our approach scales efficiently with the length of input sequences and maintains competitive performance across various signature parameters, though bounded by memory constraints for very large signature dimensions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。