Emotions have a major interactive role in defining how humans interact with their environment by encoding their perception to external events and accordingly, influencing their cognition and decision-making process. Therefore, increasing attention has been directed toward integrating human affective states into system design in order to optimize the quality of task performance. In this work, we seize on the significant correlation between emotions and behavioral performance that is reported in several psychological studies and develop an online closed-loop design framework for Human-Robot Interaction (HRI). The proposed approach monitors the behavioral performance based on the levels of Pleasure, Arousal, and Dominance (PAD) states for the human operator and when required, applies an external stimulus which is selected to induce an improvement in performance. The framework is implemented on an HRI task involving a human operator teleoperating an articulated robotic manipulator. Our statistical analysis shows a significant decrease in pleasure, arousal, and dominance states as the behavioral performance deteriorates $(p < 0.05)$. Our closed-loop experiment that uses an audio stimulus to improve emotional state shows a significant improvement in the behavioral performance of certain subjects.
Understanding the Rising Human-AI Affective Bonding: Conceptualization and HAABI Scale Development
Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University(北京师范大学心理学院)
Modeling User Preferences via Brain-Computer Interfacing
University of Luxembourg(卢森堡大学);INIT, Universitat Jaume I(豪梅一世大学 INIT 机构);Opole University of Technology(奥波莱工业大学);University of Copenhagen(哥本哈根大学);LUT University(拉彭兰塔-拉赫蒂工业大学)
ArtCognition: A Multimodal AI Framework for Affective State Sensing from Visual and Kinematic Drawing Cues
Department of Electrical and Computer Engineering, University of Tehran(电信工程系,德黑兰理工大学);Tehran Institute for Advanced Studies, Khatam University(德黑兰高级研究院,凯塔姆大学);Department of Psychology, Allameh Tabataba’i University(心理学系,阿勒梅·塔巴塔比大学)
Toward a Realistic Encoding Model of Auditory Affective Understanding in the Brain
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新研究院);Key laboratory of Mathematics, Informatics and Behavioral Semantics, Beihang University(北京航空航天大学数学、信息学与行为语义重点实验室);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University(北京未来区块链与隐私计算先进创新中心);Zhongguancun Laboratory, Beijing(中关村实验室);State Key Laboratory of Complex & Critical Software Environment, Beihang University(北京航空航天大学复杂与关键软件环境国家重点实验室);Institute of Trustworthy Artificial Intelligence, Zhejiang Normal University(浙江师范大学可信人工智能研究院);Institute of Medical Artificial Intelligence, Binzhou Medical University(滨州医学院医学人工智能研究院);Beijing Academy of Blockchain and Edge Computing, Beijing(北京区块链与边缘计算研究院)
Bridging the behavior-neural gap: A multimodal AI reveals the brain's geometry of emotion more accurately than human self-reports
State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(脑认知与脑启发智能技术重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);School of Future Technology, University of Chinese Academy of Sciences(未来技术学院,中国科学院大学);State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University(认知神经科学与学习国家重点实验室,北京师范大学)