arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.13307cs.AI
收藏

灵巧家庭对人类行为的潜在影响:一种强化学习方法

Potential Impacts of Smart Homes on Human Behavior: A Reinforcement Learning Approach

Royal Military College of Canada(加拿大皇家军事学院)

Shashi Suman, Ali Etemad, Francois Rivest

摘要:

我们的目标是调查灵巧家庭对人类行为的潜在影响。为此,我们模拟了一系列能够在基于强化学习的灵巧家庭内执行各种活动的人类模型。然后,我们调查的可能性,人类的行为被改变的结果,灵巧家庭和人类模型相互适应。我们设计了一个基于分层强化学习的半马尔可夫决策过程人工任务交错模型,该模型学习做出继续或离开活动的决策。然后,我们将我们的人类模型集成到基于Q学习的灵巧家庭中。我们表明,一个灵巧家庭训练的通用人类模型是能够预测和学习的热偏好的人类模型的内在奖励类似的通用模型。分层人体模型学习完成每个活动,并设置最佳的热设置,以获得最大的舒适度。利用灵巧家庭,针对人体模型减少了改变热设置所需的时间步长的数量。有趣的是,我们观察到,人类模型奖励结构的微小变化可能会导致相反的行为,表现为活动之间的意外切换,这表明由于灵巧家庭的存在,人类行为发生了变化。

英文摘要:

We aim to investigate the potential impacts of smart homes on human behavior. To this end, we simulate a series of human models capable of performing various activities inside a reinforcement learning-based smart home. We then investigate the possibility of human behavior being altered as a result of the smart home and the human model adapting to one-another. We design a semi-Markov decision process human task interleaving model based on hierarchical reinforcement learning that learns to make decisions to either pursue or leave an activity. We then integrate our human model in the smart home which is based on Q-learning. We show that a smart home trained on a generic human model is able to anticipate and learn the thermal preferences of human models with intrinsic rewards similar to the generic model. The hierarchical human model learns to complete each activity and set optimal thermal settings for maximum comfort. With the smart home, the number of time steps required to change the thermal settings are reduced for the human models. Interestingly, we observe that small variations in the human model reward structures can lead to the opposite behavior in the form of unexpected switching between activities which signals changes in human behavior due to the presence of the smart home.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑