对话对象搜索
Dialogue Object Search
摘要：
我们设想机器人可以与人类无缝协作和沟通。这些机器人在与人类互动时，必须决定说什么和如何行动。为此，我们引入了一个新的任务，对话对象搜索：机器人的任务是在人类环境中搜索目标对象（例如叉子）（例如，厨房），同时与具有关于目标位置的附加但不精确的知识的远程人进行“视频通话”。也就是说，机器人与人类进行基于语音的对话，同时共享来自其安装的摄像头的图像。从数据汇集、算法和系统开发到评估，这一任务在多个层面上都具有挑战性。尽管存在这些挑战，但我们认为这样的任务阻碍了实现更智能和协作机器人的道路。在这个扩展的摘要中，我们激励和介绍了对话对象搜索任务，并分析了从试点研究中收集的例子。然后，我们讨论我们的下一步，并总结了我们希望收到反馈的几个挑战。
英文摘要：
We envision robots that can collaborate and communicate seamlessly with humans. It is necessary for such robots to decide both what to say and how to act, while interacting with humans. To this end, we introduce a new task, dialogue object search: A robot is tasked to search for a target object (e.g. fork) in a human environment (e.g., kitchen), while engaging in a "video call" with a remote human who has additional but inexact knowledge about the target's location. That is, the robot conducts speech-based dialogue with the human, while sharing the image from its mounted camera. This task is challenging at multiple levels, from data collection, algorithm and system development,to evaluation. Despite these challenges, we believe such a task blocks the path towards more intelligent and collaborative robots. In this extended abstract, we motivate and introduce the dialogue object search task and analyze examples collected from a pilot study. We then discuss our next steps and conclude with several challenges on which we hope to receive feedback.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
