arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.03064cs.CVcs.AI
收藏

JRDB-Pose3D: 一个多人群3D人体姿态和形状估计数据集用于机器人

JRDB-Pose3D: A Multi-person 3D Human Pose and Shape Estimation Dataset for Robotics

Monash University(莫纳什大学);Sharif University(沙里夫大学)

Sandika Biswas, Kian Izadpanah, Hamid Rezatofighi

AI总结:

JRDB-Pose3D数据集通过移动机器人平台捕捉多人群的室内外环境,提供丰富的3D人体姿态和形状注释,用于机器人感知和人机交互等应用。

摘要:

现实世界场景本质上是拥挤的。因此,估计所有 nearby 人类的3D姿态、跟踪其随时间变化的运动,并在社会和环境背景下理解其活动,对于许多应用,如自动驾驶、机器人感知、机器人导航和人机交互至关重要。然而,大多数现有的3D人体姿态估计数据集主要专注于单人场景或是在受控的实验室环境中收集,这限制了它们在现实世界应用中的相关性。为了弥合这一差距,我们引入了JRDB-Pose3D,它通过移动机器人平台捕捉多人群的室内外环境。JRDB-Pose3D为这些复杂和动态的场景提供了丰富的3D人体姿态注释,包括基于SMPL的姿态注释,具有一致的身体形状参数和每个个体随时间变化的跟踪ID。JRDB-Pose3D平均包含每帧5-10个人的3D姿态,某些场景中同时有高达35个个体。所提出的数据集提出了独特的挑战,包括频繁的遮挡、截断的身体和超出画面的身体部分,这紧密反映了现实世界环境。此外,JRDB-Pose3D继承了JRDB数据集的所有可用注释,如2D姿态、关于社交群体的信息、活动和互动、完整的场景语义掩码,具有一致的人和物体级别的跟踪,以及每个个体的详细注释,如年龄、性别和种族,使其成为适用于广泛下游感知和以人为中心的理解任务的综合数据集。

英文摘要:

Real-world scenes are inherently crowded. Hence, estimating 3D poses of all nearby humans, tracking their movements over time, and understanding their activities within social and environmental contexts are essential for many applications, such as autonomous driving, robot perception, robot navigation, and human-robot interaction. However, most existing 3D human pose estimation datasets primarily focus on single-person scenes or are collected in controlled laboratory environments, which restricts their relevance to real-world applications. To bridge this gap, we introduce JRDB-Pose3D, which captures multi-human indoor and outdoor environments from a mobile robotic platform. JRDB-Pose3D provides rich 3D human pose annotations for such complex and dynamic scenes, including SMPL-based pose annotations with consistent body-shape parameters and track IDs for each individual over time. JRDB-Pose3D contains, on average, 5-10 human poses per frame, with some scenes featuring up to 35 individuals simultaneously. The proposed dataset presents unique challenges, including frequent occlusions, truncated bodies, and out-of-frame body parts, which closely reflect real-world environments. Moreover, JRDB-Pose3D inherits all available annotations from the JRDB dataset, such as 2D pose, information about social grouping, activities, and interactions, full-scene semantic masks with consistent human- and object-level tracking, and detailed annotations for each individual, such as age, gender, and race, making it a holistic dataset for a wide range of downstream perception and human-centric understanding tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑