arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.09841cs.CVcs.RO

Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation

Facebook AI Research(Facebook人工智能研究院);University of California, Berkeley(加州大学伯克利分校);Georgia Institute of Technology(佐治亚理工学院)

Medhini Narasimhan, Erik Wijmans, Xinlei Chen, Trevor Darrell, Dhruv Batra, Devi Parikh, Amanpreet Singh

英文摘要:

We introduce a learning-based approach for room navigation using semantic maps. Our proposed architecture learns to predict top-down belief maps of regions that lie beyond the agent's field of view while modeling architectural and stylistic regularities in houses. First, we train a model to generate amodal semantic top-down maps indicating beliefs of location, size, and shape of rooms by learning the underlying architectural patterns in houses. Next, we use these maps to predict a point that lies in the target room and train a policy to navigate to the point. We empirically demonstrate that by predicting semantic maps, the model learns common correlations found in houses and generalizes to novel environments. We also demonstrate that reducing the task of room navigation to point navigation improves the performance further.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑