基于全卷积网络的液体感知与推理
Perceiving and Reasoning About Liquids Using Fully Convolutional Networks
摘要:
液体是人类环境中许多常见操作任务的重要组成部分。如果我们希望机器人能够完成这些类型的任务,它们必须能够以智能的方式与液体互动。在本文中,我们研究机器人感知和推理液体的方法。也就是说,机器人会问这样的问题:在视觉数据流中,什么是液体?我怎么能用它来推断液体可能存在的地方呢?我们收集了两个数据集来评估这些问题,一个使用真实的液体模拟器,另一个使用我们的机器人。我们使用完全的卷积神经网络来学习检测和跟踪浇注序列中的液体。我们的研究结果表明,这些网络能够感知和推理液体,并且整合时间信息对于很好地执行这些任务很重要。
英文摘要:
Liquids are an important part of many common manipulation tasks in human environments. If we wish to have robots that can accomplish these types of tasks, they must be able to interact with liquids in an intelligent manner. In this paper, we investigate ways for robots to perceive and reason about liquids. That is, a robot asks the questions What in the visual data stream is liquid? and How can I use that to infer all the potential places where liquid might be? We collected two datasets to evaluate these questions, one using a realistic liquid simulator and another on our robot. We used fully convolutional neural networks to learn to detect and track liquids across pouring sequences. Our results show that these networks are able to perceive and reason about liquids, and that integrating temporal information is important to performing such tasks well.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。