利用人类背景学习3D场景中的物体排列
Learning Object Arrangements in 3D Scenes using Human Context
摘要:
我们考虑在3D场景中学习对象安排的问题。这里的关键思想是学习对象如何根据它们的启示、易用性和可达性与人类姿势相关联。与对象-对象关系建模相反,人-对象关系建模在对象数量上线性缩放。我们根据3D空间特征设计了适当的密度函数来捕捉这一点。我们使用Dirichlet过程混合模型的变体来学习场景中人类姿势的分布,该模型允许在相同的对象类型中共享密度函数参数。然后我们可以根据这些有意义的人类姿势来推断房间中物体的排列。在我们对20个不同房间共47个物体的广泛实验中,我们的算法预测了正确的位置,平均误差为1.6米。在安排五个真实场景时,它获得了4.3/5的分数,而最佳基线方法为3.7。
英文摘要:
We consider the problem of learning object arrangements in a 3D scene. The key idea here is to learn how objects relate to human poses based on their affordances, ease of use and reachability. In contrast to modeling object-object relationships, modeling human-object relationships scales linearly in the number of objects. We design appropriate density functions based on 3D spatial features to capture this. We learn the distribution of human poses in a scene using a variant of the Dirichlet process mixture model that allows sharing of the density function parameters across the same object types. Then we can reason about arrangements of the objects in the room based on these meaningful human poses. In our extensive experiments on 20 different rooms with a total of 47 objects, our algorithm predicted correct placements with an average error of 1.6 meters from ground truth. In arranging five real scenes, it received a score of 4.3/5 compared to 3.7 for the best baseline method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。