arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.06310cs.RO
收藏

仿人赛博化身“Yui”的逼真头部单元及其操作界面开发

Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar `Yui' and Its Operation Interface

Tokyo Denki University(东京电机大学);The University of Electro-Communications(电气通信大学)

Mizuki Nakajima, Kaoruko Shinkawa, Yoshihiro Nakata

AI总结:

本研究开发了配备28自由度类人头部单元的赛博化身“Yui”及其沉浸式操作界面,通过眼动和面部追踪实现凝视与表情同步,并验证了其在遥操作中的情感传递与存在感增强效果。

摘要:

在化身介导的通信背景下,面对面交流者通过化身感知操作者的存在感和情感至关重要。尽管已开发出外观和动作类似人类的仿生机器人来传达存在感,但很少有研究优先考虑使用仿生机器人作为化身来深化操作者和交流者双方的沟通体验。针对这一空白,我们引入了“Cybernetic Avatar ‘Yui’”,其配备具有28个自由度的类人头部单元,能够表达凝视、面部情感和与语音相关的嘴部动作。通过头戴式显示器(HMD)中的眼动追踪单元和Yui双眼的自由度,操作者可以自然地控制化身的凝视方向。此外,Yui耳内嵌入的麦克风使操作者能够三维听取周围声音,从而仅凭听觉信息就能辨别呼叫的方向。HMD的面部追踪单元将化身的面部动作与操作者的面部动作同步。这种沉浸式界面结合Yui的类人外观,实现了实时情感传递和交流,增强了双方的存在感。我们的实验展示了Yui的面部表情能力,并通过遥操作试验验证了系统的有效性,表明化身技术的潜在进步。

英文摘要:

In the context of avatar-mediated communication, it is crucial for the face-to-face interlocutor to sense the operator's presence and emotions via the avatar. Although androids resembling humans have been developed to convey presence through appearance and movement, few studies have prioritized deepening the communication experience for both operator and interlocutor using android robot as an avatar. Addressing this gap, we introduce the ``Cybernetic Avatar `Yui','' featuring a human-like head unit with 28 degrees of freedom, capable of expressing gaze, facial emotions, and speech-related mouth movements. Through an eye-tracking unit in a Head-Mounted Display (HMD) and degrees of freedom on both eyes of Yui, operators can control the avatar's gaze naturally. Additionally, microphones embedded in Yui's ears allow operators to hear surrounding sounds in three dimensions, enabling them to discern the direction of calls based solely on auditory information. An HMD's face-tracking unit synchronizes the avatar's facial movements with those of the operator. This immersive interface, coupled with Yui's human-like appearance, enables real-time emotion transmission and communication, enhancing the sense of presence for both parties. Our experiments demonstrate Yui's facial expression capabilities, and validate the system's efficacy through teleoperation trials, suggesting potential advancements in avatar technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑