桌面组织:多通道输入对空间关系学习的影响
Desk Organization: Effect of Multimodal Inputs on Spatial Relational Learning
摘要:
为了让机器人在三维世界中工作并与人类互动,学习周围物体之间的空间关系是必要的。关于世界状态的推理需要来自许多不同感官模态的输入,包括视觉($V$)和触觉($H$)。我们研究的问题,办公桌的组织:学习人类如何空间定位不同的物体在平面上根据组织的“偏好”。我们通过研究人类如何定位物体从视觉和触觉方式接收到的多个功能来模拟这个问题。然而,组织习惯在结构和坚持方面都因人而异。为了处理用户的组织偏好,我们添加了一个额外的模态,“效用"($U$),它通知特定的人对给定对象的感知有用性。模型被训练为泛化(针对许多不同的人)或定制(每人)。我们使用两种类型的模型:随机森林,它专注于精确的多任务分类,和马尔可夫逻辑网络,它提供了一个易于解释的洞察组织习惯。这些模型被应用于合成数据和人类研究数据,前者在使用固定组织约束时被证明是可学习的,后者在随机森林上达到了90%以上的准确率。在所有$\{H, U, V\}$模式的组合中,$UV$和$HUV$对组织的信息量最大。在后续的研究中,我们衡量了参与者的偏好的办公桌组织的广义随机森林组织与随机模型。平均而言,参与者对随机森林模型的评分为4.15(5分制李克特量表),而随机模型为1.84
英文摘要:
For robots to operate in a three dimensional world and interact with humans, learning spatial relationships among objects in the surrounding is necessary. Reasoning about the state of the world requires inputs from many different sensory modalities including vision ($V$) and haptics ($H$). We examine the problem of desk organization: learning how humans spatially position different objects on a planar surface according to organizational ''preference''. We model this problem by examining how humans position objects given multiple features received from vision and haptic modalities. However, organizational habits vary greatly between people both in structure and adherence. To deal with user organizational preferences, we add an additional modality, ''utility'' ($U$), which informs on a particular human's perceived usefulness of a given object. Models were trained as generalized (over many different people) or tailored (per person). We use two types of models: random forests, which focus on precise multi-task classification, and Markov logic networks, which provide an easily interpretable insight into organizational habits. The models were applied to both synthetic data, which proved to be learnable when using fixed organizational constraints, and human-study data, on which the random forest achieved over 90% accuracy. Over all combinations of $\{H, U, V\}$ modalities, $UV$ and $HUV$ were the most informative for organization. In a follow-up study, we gauged participants preference of desk organizations by a generalized random forest organization vs. by a random model. On average, participants rated the random forest models as 4.15 on a 5-point Likert scale compared to 1.84 for the random model
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。