利用终身自适应处理基于学习的自适应系统中适应空间漂移问题
Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive Systems using Lifelong Self-Adaptation
AI总结:
本文针对基于学习的自适应系统中适应空间漂移问题,提出引入终身机器学习层的终身自适应方法,通过持续跟踪环境、识别新任务并更新学习模型,以应对适应选项质量变化导致的决策失效或新机会出现,并在DeltaIoT上验证了有效性。
摘要:
近年来,机器学习(ML)已成为支持自适应的一种流行方法。ML已被用于处理自适应中的若干问题,例如在不确定性下维护最新的运行时模型以及可扩展的决策制定。然而,利用ML也带来了固有的挑战。在本文中,我们聚焦于基于学习的自适应系统面临的一个特别重要的挑战:适应空间中的漂移。所谓适应空间,是指自适应系统在给定时间可以从中选择以适应的一组适应选项,其选择依据是这些适应选项的估计质量属性。适应空间的漂移源于不确定性,这些不确定性会影响适应选项的质量属性。这种漂移可能意味着最终没有任何适应选项能够满足初始的适应目标集,从而降低系统质量;或者可能出现新的适应选项,从而能够增强适应目标。在ML中,这种偏移对应于新类别出现,这是目标数据中一种概念漂移类型,常见ML技术难以处理。为了解决这个问题,我们提出了一种新颖的自适应方法,通过引入终身ML层来增强基于学习的自适应系统。我们将这种方法称为终身自适应。终身ML层跟踪系统及其环境,将这些知识与当前任务相关联,基于差异识别新任务,并相应地更新自适应系统的学习模型。人类利益相关者可以参与以支持学习过程并调整学习模型和目标模型。我们提出了终身自适应的通用架构,并将其应用于影响自适应决策制定的适应空间漂移场景。我们使用DeltaIoT示例在一系列场景中验证了该方法。
英文摘要:
Recently, machine learning (ML) has become a popular approach to support self-adaptation. ML has been used to deal with several problems in self-adaptation, such as maintaining an up-to-date runtime model under uncertainty and scalable decision-making. Yet, exploiting ML comes with inherent challenges. In this paper, we focus on a particularly important challenge for learning-based self-adaptive systems: drift in adaptation spaces. With adaptation space we refer to the set of adaptation options a self-adaptive system can select from at a given time to adapt based on the estimated quality properties of the adaptation options. Drift of adaptation spaces originates from uncertainties, affecting the quality properties of the adaptation options. Such drift may imply that eventually no adaptation option can satisfy the initial set of the adaptation goals, deteriorating the quality of the system, or adaptation options may emerge that allow enhancing the adaptation goals. In ML, such shift corresponds to novel class appearance, a type of concept drift in target data that common ML techniques have problems dealing with. To tackle this problem, we present a novel approach to self-adaptation that enhances learning-based self-adaptive systems with a lifelong ML layer. We refer to this approach as lifelong self-adaptation. The lifelong ML layer tracks the system and its environment, associates this knowledge with the current tasks, identifies new tasks based on differences, and updates the learning models of the self-adaptive system accordingly. A human stakeholder may be involved to support the learning process and adjust the learning and goal models. We present a general architecture for lifelong self-adaptation and apply it to the case of drift of adaptation spaces that affects the decision-making in self-adaptation. We validate the approach for a series of scenarios using the DeltaIoT exemplar.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。