arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.03944cs.ROcs.SYeess.SY
收藏

叙事性图形用户界面与通过眼动实现的辅助机器人直观控制

Diegetic Graphical User Interfaces and Intuitive Control of Assistive Robots via Eye-gaze

Bristol Robotics Laboratory(布里斯托机器人实验室);University of the West of England (UWE)(西英格兰大学);Mondragon Unibertsitatea - Faculty of Engineering(蒙德拉贡大学工程学院)

Emanuel Nunez Sardinha, Marcela Munera, Nancy Zook, David Western, Virginia Ruiz Garate

AI总结:

提出一种基于叙事性图形用户界面的眼动控制方法,通过将带有基准标记的交互按钮直接嵌入环境和机器人本体,实现了3自由度机械臂的直观无屏幕控制,实验证明其具备高可用性和低认知负荷。

摘要:

四肢瘫痪和类似瘫痪形式的个体由于缺乏自主性而在身心上遭受痛苦。为了帮助恢复部分自主性,辅助机械臂已被证明能够提高生活独立性。然而,瘫痪用户对这些设备的控制提出了独特的挑战条件。在本文中,我们提出了叙事性图形用户界面的使用,这是一种应用于机器人的眼动控制界面的新颖、直观且计算成本低廉的方法。通过使用与基准标记配对的符号,可以在现实世界中定义用户可通过眼动触发的交互式按钮,并且这些按钮可以轻松嵌入到环境中。我们应用该系统来驾驶一个3自由度机械臂进行精确的拾取与放置任务。界面直接放置在机器人上,以实现直观和直接的交互,消除了在外部屏幕、菜单和机器人之间进行上下文切换的需要。经过校准和短暂的适应期,来自不同背景、年龄和视力条件的21名参与者完成了Yale-CMU-Berkeley (YCB) Block Pick and Place Protocol以对系统进行基准测试,在最高16.00分中取得了13.71分的平均分。报告显示系统具有良好的可用性和用户体验(System Usability Score为75.36),同时实现了较低的任务工作负荷测量值(NASA-TLX为44.76)。结果表明,用户可以通过最少的练习和较小的认知负荷来使用多个界面元素执行操作。据我们所知,这是第一个易于重新配置的无屏幕系统,能够完全通过眼动实现机器人控制以进行笛卡尔机器人控制,而无需眼部或面部手势。

英文摘要:

Individuals with tetraplegia and similar forms of paralysis suffer physically and emotionally due to a lack of autonomy. To help regain part of this autonomy, assistive robotic arms have been shown to increase living independence. However, users with paralysis pose unique challenging conditions for the control of these devices. In this article, we present the use of Diegetic Graphical User Interfaces, a novel, intuitive, and computationally inexpensive approach for gaze-controlled interfaces applied to robots. By using symbols paired with fiducial markers, interactive buttons can be defined in the real world which the user can trigger via gaze, and which can be embedded easily into the environment. We apply this system to pilot a 3-degree-of-freedom robotic arm for precision pick-and-place tasks. The interface is placed directly on the robot to allow intuitive and direct interaction, eliminating the need for context-switching between external screens, menus, and the robot. After calibration and a brief habituation period, twenty-one participants from multiple backgrounds, ages and eye-sight conditions completed the Yale-CMU-Berkeley (YCB) Block Pick and Place Protocol to benchmark the system, achieving a mean score of 13.71 out of the maximum 16.00 points. Good usability and user experience were reported (System Usability Score of 75.36) while achieving a low task workload measure (NASA-TLX of 44.76). Results show that users can employ multiple interface elements to perform actions with minimal practice and with a small cognitive load. To our knowledge, this is the first easily reconfigurable screenless system that enables robot control entirely via gaze for Cartesian robot control without the need for eye or face gestures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑