arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.22643cs.DC
收藏

面向深度学习的基于网络的图像加载中的延迟隐藏

Hiding Latencies in Network-Based Image Loading for Deep Learning

Francesco Versaci, Giovanni Busonera

AI总结:

针对深度学习中网络存储延迟致数据停顿、现有加载器网络支持不足等问题,提出将数据存于可扩展NoSQL库并结合乱序增量预取的高吞吐加载策略,经多延迟场景实验验证。

摘要:

近几十年来,GPU的计算能力呈指数级增长,使得当前的深度学习(DL)应用能够以越来越高的吞吐量处理日益庞大的数据量。然而,受物理条件限制,网络和存储延迟无法以相近的速度下降,导致数据停顿,成为深度学习任务的瓶颈。此外,管理海量数据及其相关元数据已被证明颇具挑战,阻碍并降低了数据科学家的工作效率。再者,现有数据加载器的网络支持有限,为实现最佳性能,数据必须存储在靠近GPU的本地文件系统中,这加重了计算节点的存储负担。\n 本文针对深度学习图像应用提出了一种应对这些挑战的策略:将数据和元数据存储在快速、可扩展的NoSQL数据库中;将这些数据库与深度学习框架的前沿加载器相连接;通过我们的乱序增量预取技术,实现高延迟网络下的高吞吐量数据加载。为评估我们的方法,我们展示了实现方案,并通过本地、中等延迟和高延迟(洲际)实验评估了其数据加载能力。

英文摘要:

In the last decades, the computational power of GPUs has grown exponentially, allowing current deep learning (DL) applications to handle increasingly large amounts of data at a progressively higher throughput. However, network and storage latencies cannot decrease at a similar pace due to physical constraints, leading to data stalls, and creating a bottleneck for DL tasks. Additionally, managing vast quantities of data and their associated metadata has proven challenging, hampering and slowing the productivity of data scientists. Moreover, existing data loaders have limited network support, necessitating, for maximum performance, that data be stored on local filesystems close to the GPUs, overloading the storage of computing nodes. In this paper we propose a strategy, aimed at DL image applications, to address these challenges by: storing data and metadata in fast, scalable NoSQL databases; connecting the databases to state-of-the-art loaders for DL frameworks; enabling high-throughput data loading over high-latency networks through our out-of-order, incremental prefetching techniques. To evaluate our approach, we showcase our implementation and assess its data loading capabilities through local, medium and high-latency (intercontinental) experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑