可配置系统性能建模中的迁移学习:探索性分析
Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis
摘要:
现代软件系统提供了许多配置选项,这些选项显著地影响它们的非功能属性。为了理解和预测配置选项的效果,已经提出了几种采样和学习策略,尽管通常需要大量的成本来覆盖高维配置空间。最近,迁移学习已被应用于通过跨环境迁移有关性能行为的知识来减少构建性能模型的工作。虽然这一系列研究有望以较低的成本学习更准确的模型,但目前还不清楚迁移学习为什么以及何时适用于性能建模。为了阐明何时应用迁移学习是有益的,我们对四种流行的软件系统进行了实证研究,不同的软件配置和环境条件,如硬件,工作负载和软件版本,以确定可用于迁移学习的关键知识片段。我们的研究结果表明,在小的环境变化(例如,同构工作负载变化),通过对性能模型应用线性变换,我们可以理解目标环境的性能行为,而对于严重的环境变化(例如,剧烈的工作负载变化),我们可以仅传递使采样更有效的知识,例如,通过降低配置空间的维数。
英文摘要:
Modern software systems provide many configuration options which significantly influence their non-functional properties. To understand and predict the effect of configuration options, several sampling and learning strategies have been proposed, albeit often with significant cost to cover the highly dimensional configuration space. Recently, transfer learning has been applied to reduce the effort of constructing performance models by transferring knowledge about performance behavior across environments. While this line of research is promising to learn more accurate models at a lower cost, it is unclear why and when transfer learning works for performance modeling. To shed light on when it is beneficial to apply transfer learning, we conducted an empirical study on four popular software systems, varying software configurations and environmental conditions, such as hardware, workload, and software versions, to identify the key knowledge pieces that can be exploited for transfer learning. Our results show that in small environmental changes (e.g., homogeneous workload change), by applying a linear transformation to the performance model, we can understand the performance behavior of the target environment, while for severe environmental changes (e.g., drastic workload change) we can transfer only knowledge that makes sampling more efficient, e.g., by reducing the dimensionality of the configuration space.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。