深度学习框架中的自我声明假设:一项探索性研究
Self-Claimed Assumptions in Deep Learning Frameworks: An Exploratory Study
摘要:
深度学习(DL)框架已经在许多领域的软件项目中被广泛设计、实现和使用。然而,由于缺乏知识或信息,时间压力,复杂的上下文等,在开发过程中出现了各种不确定性,导致DL框架中的假设。虽然并非所有的假设都对框架是负面的,但不知道某些假设可能会导致严重的问题(例如,系统脆弱性和故障、不一致性以及增加的成本)。作为解决关键问题的第一步,需要探索和理解DL框架中的假设。为此,我们进行了一项探索性研究,使用GitHub上九个流行的DL框架项目的代码评论来了解关于其分布,分类和影响的自我声明假设(SCA)。结果是:(1)3,084个SCA分散在9个DL框架中的1,775个文件中,范围从1,460(TensorFlow)到8(Keras)SCA。(2)SCA的有效性有四种类型:有效SCA、无效SCA、条件SCA和未知SCA,以及基于其内容的四种SCA类型:配置和上下文SCA、设计SCA、张量和变量SCA以及杂项SCA。(3)有效和无效的SCA都可能在特定范围内产生影响(例如,在一个函数中)在DL框架上。在订立《管制计划协议》时,会引致若干技术债项。有源代码编写和决策的基础上SCA。这是第一个在深度学习框架中研究SCA的研究,它有助于研究人员和实践者对所做的假设有一个全面的了解。我们还提供了第一个数据集的SCA在这一领域的进一步研究和实践。
英文摘要:
Deep learning (DL) frameworks have been extensively designed, implemented, and used in software projects across many domains. However, due to the lack of knowledge or information, time pressure, complex context, etc., various uncertainties emerge during the development, leading to assumptions made in DL frameworks. Though not all the assumptions are negative to the frameworks, being unaware of certain assumptions can result in critical problems (e.g., system vulnerability and failures, inconsistencies, and increased cost). As the first step of addressing the critical problems, there is a need to explore and understand the assumptions made in DL frameworks. To this end, we conducted an exploratory study to understand self-claimed assumptions (SCAs) about their distribution, classification, and impacts using code comments from nine popular DL framework projects on GitHub. The results are that: (1) 3,084 SCAs are scattered across 1,775 files in the nine DL frameworks, ranging from 1,460 (TensorFlow) to 8 (Keras) SCAs. (2) There are four types of validity of SCAs: Valid SCA, Invalid SCA, Conditional SCA, and Unknown SCA, and four types of SCAs based on their content: Configuration and Context SCA, Design SCA, Tensor and Variable SCA, and Miscellaneous SCA. (3) Both valid and invalid SCAs may have an impact within a specific scope (e.g., in a function) on the DL frameworks. Certain technical debt is induced when making SCAs. There are source code written and decisions made based on SCAs. This is the first study on investigating SCAs in DL frameworks, which helps researchers and practitioners to get a comprehensive understanding on the assumptions made. We also provide the first dataset of SCAs for further research and practice in this area.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。