arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.16688cs.SE
收藏

重用深度学习模型:软件工程中的挑战与方向

Reusing Deep Learning Models: Challenges and Directions in Software Engineering

James C. Davis, Purvish Jajal, Wenxin Jiang, Taylor R. Schorlemmer, Nicholas Synovic, George K. Thiruvathukal

AI总结:

本文分析了深度神经网络重用中的技术与工程挑战,总结了概念、适应和部署重用的失败案例,并提出改进方向。

摘要:

深度神经网络(DNNs)在计算机视觉、系统配置和问答系统等多个领域取得了最先进的性能。然而,DNNs的开发成本高昂,包括智力投入(如设计新架构)和计算成本(如训练)。重用DNNs是在公司内部和整个计算行业分摊成本的有前景的方向。然而,与任何新技术一样,重用DNNs面临诸多挑战,包括技术能力的缺失和工程实践的不足。本文描述了当前DNN重用方法中的挑战,总结了重用失败的研究,涵盖概念重用(如基于研究论文重用)、适应重用(如在现有实现基础上重用)和部署重用(如在新设备上直接重用),并概述了改进各类重用的可能进展。

英文摘要:

Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new architectures) and computational costs (e.g., training). Reusing DNNs is a promising direction to amortize costs within a company and across the computing industry. As with any new technology, however, there are many challenges in reusing DNNs. These challenges include both missing technical capabilities and missing engineering practices. This vision paper describes challenges in current approaches to DNN re-use. We summarize studies of re-use failures across the spectrum of re-use techniques, including conceptual (e.g., reusing based on a research paper), adaptation (e.g., re-using by building on an existing implementation), and deployment (e.g., direct re-use on a new device). We outline possible advances that would improve each kind of re-use.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑