arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.11104cs.HC
收藏

RLTIR:基于强化学习树的基于活动的交互式身份识别

RLTIR: Activity-based Interactive Person Identification based on Reinforcement Learning Tree

Qingyang Li, Zhiwen Yu, Lina Yao, Bin Guo

摘要:

身份识别在确保我们日常生活中的安全方面起着重要作用。基于生物特征的(尤其是基于活动的)方法由于其保真度、普遍性和弹性而受到青睐。然而,大多数现有的基于机器学习的方法依赖于传统的工作流程,其中模型通常是一次性训练的,在该过程中终端用户的参与有限,并且忽略了学习过程的动态性质。这使得模型是静态的,不能及时更新,这通常会导致较高的假阳性或假阴性。因此,在实践中,需要一名专家协助提供高质量的观测和对模型输出的解释。结合人类专家的优势和计算机的计算能力来创建一个紧密耦合的增量学习过程以获得更好的性能是有利的。在这项研究中,我们开发了RLTIR,一个基于强化学习的交互式身份识别方法,通过人工指导来调整识别模型。我们首先建立一个基树结构的身份识别模型。在模型中引入专家对模型输出进行反馈。然后,根据在指定的强化学习框架下自动学习的策略来更新模型。据我们所知,这是首次尝试将人类专家知识与身份识别领域的模型学习相结合。实验结果表明,增强的交互式身份识别框架在识别准确性和鲁棒性方面优于基线方法。

英文摘要:

Identity recognition plays an important role in ensuring security in our daily life. Biometric-based (especially activity-based) approaches are favored due to their fidelity, universality, and resilience. However, most existing machine learning-based approaches rely on a traditional workflow where models are usually trained once for all, with limited involvement from end-users in the process and neglecting the dynamic nature of the learning process. This makes the models static and can not be updated in time, which usually leads to high false positive or false negative. Thus, in practice, an expert is desired to assist with providing high-quality observations and interpretation of model outputs. It is expedient to combine both advantages of human experts and the computational capability of computers to create a tight-coupling incremental learning process for better performance. In this study, we develop RLTIR, an interactive identity recognition approach based on reinforcement learning, to adjust the identification model by human guidance. We first build a base tree-structured identity recognition model. And an expert is introduced in the model for giving feedback upon model outputs. Then, the model is updated according to strategies that are automatically learned under a designated reinforcement learning framework. To the best of our knowledge, it is the very first attempt to combine human expert knowledge with model learning in the area of identity recognition. The experimental results show that the reinforced interactive identity recognition framework outperforms baseline methods with regard to recognition accuracy and robustness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑