Aria日常活动数据集
Aria Everyday Activities Dataset
AI总结:
本文提出Aria日常活动数据集,记录143个多地点第一人称日常活动序列,提供多模态传感器与机器感知数据,并展示其在神经场景重建和提示式分割等研究中的应用。
摘要:
我们提出了Aria日常活动(AEA)数据集,这是一个使用Project Aria眼镜记录的第一人称多模态开放数据集。AEA包含由多位佩戴者在五个地理上不同的室内地点记录的143个日常活动序列。每条记录都包含通过Project Aria眼镜记录的多模态传感器数据。此外,AEA还提供机器感知数据,包括高频全局对齐的3D轨迹、场景点云、逐帧3D眼动注视向量以及时间对齐的语音转录。在本文中,我们展示了该数据集支持的几个示例性研究应用,包括神经场景重建和提示式分割。AEA是一个开源数据集,可以从https://www.projectaria.com/datasets/aea/下载。我们还提供了开源实现以及在Project Aria Tools https://github.com/facebookresearch/projectaria_tools中使用该数据集的示例。
英文摘要:
We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from https://www.projectaria.com/datasets/aea/. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools https://github.com/facebookresearch/projectaria_tools.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。