JaxPruner:面向稀疏性研究的简洁库
JaxPruner: A concise library for sparsity research
AI总结:
该研究推出基于JAX的开源剪枝与稀疏训练库JaxPruner,采用统一API、兼容Optax,可低开销实现主流稀疏算法,已在四个代码库验证集成便捷性并提供基准基线。
摘要:
本文介绍了JaxPruner,这是一款基于JAX的开源剪枝与稀疏训练库,用于机器学习研究。JaxPruner旨在通过提供主流剪枝和稀疏训练算法的简洁实现,以极低的内存与延迟开销,加速稀疏神经网络领域的研究。库中实现的算法采用统一API,可与热门优化库Optax无缝协作,进而能轻松集成到现有基于JAX的库中。我们通过在Scenic、t5x、Dopamine和FedJAX四个不同代码库中提供示例,展示了这种集成便捷性,并在主流基准上提供了基线实验结果。
英文摘要:
This paper introduces JaxPruner, an open-source JAX-based pruning and sparse training library for machine learning research. JaxPruner aims to accelerate research on sparse neural networks by providing concise implementations of popular pruning and sparse training algorithms with minimal memory and latency overhead. Algorithms implemented in JaxPruner use a common API and work seamlessly with the popular optimization library Optax, which, in turn, enables easy integration with existing JAX based libraries. We demonstrate this ease of integration by providing examples in four different codebases: Scenic, t5x, Dopamine and FedJAX and provide baseline experiments on popular benchmarks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。