arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2503.02916cs.CVcs.RO

单目相机自身运动下的人体定位

Monocular Person Localization under Camera Ego-motion

Shenzhen Key Laboratory of Robotics and Computer Vision, Southern University of Science and Technology (SUSTech)(机器人与计算机视觉实验室,南方科技大学);Department of Electronic and Electrical Engineering, SUSTech(电子与电气工程系,南方科技大学)

Yu Zhan, Hanjing Ye, Hong Zhang

AI总结:

本研究提出了一种基于四点模型的单目相机自身运动下的人体定位方法,通过优化联合估计相机姿态和人体三维位置,提升了定位准确性并应用于机器人系统。

摘要:

从移动单目相机中定位一个人对于人机交互(HRI)至关重要。为了从二维图像估计三维人类位置,现有方法要么依赖于固定相机的几何假设,要么使用在包含少量相机自身运动的数据集上训练的位置回归模型。这些方法在严重的相机自身运动下容易失效,导致人体定位不准确。我们将人体定位视为姿态估计问题的一部分。通过用四点模型表示人类,我们的方法通过优化联合估计二维相机姿态和人体的三维位置。在公共数据集和真实机器人实验上的评估表明,我们的方法在人体定位准确性上优于基线方法。我们的方法进一步被实现为一个人跟随系统,并部署在敏捷四足机器人上。

英文摘要:

Localizing a person from a moving monocular camera is critical for Human-Robot Interaction (HRI). To estimate the 3D human position from a 2D image, existing methods either depend on the geometric assumption of a fixed camera or use a position regression model trained on datasets containing little camera ego-motion. These methods are vulnerable to severe camera ego-motion, resulting in inaccurate person localization. We consider person localization as a part of a pose estimation problem. By representing a human with a four-point model, our method jointly estimates the 2D camera attitude and the person's 3D location through optimization. Evaluations on both public datasets and real robot experiments demonstrate our method outperforms baselines in person localization accuracy. Our method is further implemented into a person-following system and deployed on an agile quadruped robot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑