arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.11481cs.SE
收藏

如何评价自适应软件系统?

How do we Evaluate Self-adaptive Software Systems?

Ilias Gerostathopoulos, Thomas Vogel, Danny Weyns, Patricia Lago

摘要:

随着自适应系统研究的增加,有必要更好地了解评估研究贡献的方式。这些见解将支持研究人员在为社区开发新知识时更好地比较新发现。然而,到目前为止,还没有一个清晰的概述如何评估自适应系统中进行。为了解决这一差距,我们进行了一项测绘研究。这项研究的重点是在过去十年中发表的实验评估在软件工程的自适应系统的研究的主要地点-自适应和自我管理系统(SEAMS)的软件工程国际研讨会。结果指出,自适应系统的细节需要在实验过程中特别注意,包括管理系统的区别(即,评估的目标)和管理的系统,影响系统行为的不确定性的存在,因此需要在数据分析中考虑,以及管理的系统在实验中重复使用的潜力,而不是复制。最后,我们提供了一组来自我们的研究,可以作为输入,以加强未来的自适应系统实验的建议。

英文摘要:

With the increase of research in self-adaptive systems, there is a need to better understand the way research contributions are evaluated. Such insights will support researchers to better compare new findings when developing new knowledge for the community. However, so far there is no clear overview of how evaluations are performed in self-adaptive systems. To address this gap, we conduct a mapping study. The study focuses on experimental evaluations published in the last decade at the prime venue of research in software engineering for self-adaptive systems -- the International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). Results point out that specifics of self-adaptive systems require special attention in the experimental process, including the distinction of the managing system (i.e., the target of evaluation) and the managed system, the presence of uncertainties that affect the system behavior and hence need to be taken into account in data analysis, and the potential of managed systems to be reused across experiments, beyond replications. To conclude, we offer a set of suggestions derived from our study that can be used as input to enhance future experiments in self-adaptive systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑