arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.01280cs.ROcs.AI
收藏

通过情感-语言交互与差异结果训练实现人机相互学习 [预印本]

Human-Robot Mutual Learning through Affective-Linguistic Interaction and Differential Outcomes Training [Pre-Print]

University of Gothenburg(哥德堡大学);CY Cergy Paris University(塞尔吉巴黎大学)

Emilia Heikkinen, Elsa Silvennoinen, Imran Khan, Zakaria Lemhaouri, Laura Cohen, Lola Cañamero, Robert Lowe

AI总结:

本文研究情感-语言交流结合差异结果训练对人机相互学习的影响,发现DOT和探索-利用策略能显著提升人与机器人相互学习的准确率与学习速率,对社交辅助机器人的治疗与教育应用具有启示意义。

摘要:

由于大语言模型近期的成功,现代人工智能在很大程度上侧重于与人类的语言交互,而对人与机器之间非语言形式的交流关注较少。在本文中,我们测试了情感-语言交流与差异结果训练相结合,如何影响人机情境中的相互学习。受儿童-照护者互动机制的启发,我们的人机交互设置包括一个(模拟的)机器人,它试图学习如何最好地传达内部由稳态控制的需求;同时,人类“照护者”试图学习选择正确的物体来满足机器人当前传达的需求。我们研究了以下两方面的影响:i)人类训练类型,以及 ii)机器人强化学习类型,以评估相互学习的最终准确率和学习速率(以机器人获得的平均奖励来衡量)。我们的结果发现,与非差异结果训练(Non-DOT)对照条件相比,差异结果训练(DOT)显著改善了人与机器人之间的相互学习。我们还发现,当机器人使用探索-利用策略选择时,与纯粹的利用策略选择相比,能获得进一步的改进。这些发现对在治疗情境(例如认知干预)和教育应用中利用社交辅助机器人(SAR)具有重要意义。

英文摘要:

Owing to the recent success of Large Language Models, Modern A.I has been much focused on linguistic interactions with humans but less focused on non-linguistic forms of communication between man and machine. In the present paper, we test how affective-linguistic communication, in combination with differential outcomes training, affects mutual learning in a human-robot context. Taking inspiration from child-caregiver dynamics, our human-robot interaction setup consists of a (simulated) robot attempting to learn how best to communicate internal, homeostatically-controlled needs; while a human "caregiver" attempts to learn the correct object to satisfy the robot's present communicated need. We studied the effects of i) human training type, and ii) robot reinforcement learning type, to assess mutual learning terminal accuracy and rate of learning (as measured by the average reward achieved by the robot). Our results find mutual learning between a human and a robot is significantly improved with Differential Outcomes Training (DOT) compared to Non-DOT (control) conditions. We find further improvements when the robot uses an exploration-exploitation policy selection, compared to purely exploitation policy selection. These findings have implications for utilizing socially assistive robots (SAR) in therapeutic contexts, e.g. for cognitive interventions, and educational applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑