Headset：部分遮挡下的情感感知多模态数据集
Headset: Human emotion awareness under partial occlusions multimodal dataset
AI总结：
本文提出了一个多模态数据库HEADSET，包含部分遮挡下的体积数据，用于支持扩展现实应用中的面部表情分类、HMD移除和点云重建等任务。
摘要：
人类交互的体积表示是沉浸式媒体制作和电信应用发展中的基础领域之一。特别是在扩展现实（XR）应用快速发展的背景下，这种体积数据已被证明是未来XR发展的关键技术。在这项工作中，我们提出了一个新的多模态数据库，以帮助推进沉浸式技术的发展。我们提出的数据库提供了符合伦理且多样化的体积数据，特别是27名参与者在说话时展示摆出的面部表情和细微的身体动作，以及11名佩戴头戴式显示器（HMDs）的参与者。录制系统由一个体积捕获（VoCap）工作室组成，包括31个同步模块，配备62个RGB相机和31个深度相机。除了纹理网格、点云和多视角RGB-D数据外，我们还使用一台Lytro Illum相机同时提供光场（LF）数据。最后，我们还提供了关于面部表情分类、HMDs移除和点云重建任务的数据集应用评估。该数据集可帮助评估和测试各种XR算法，包括但不限于面部表情识别与重建、面部重演和体积视频。HEADSET及其所有相关的原始数据和许可协议将公开用于研究目的。
英文摘要：
The volumetric representation of human interactions is one of the fundamental domains in the development of immersive media productions and telecommunication applications. Particularly in the context of the rapid advancement of Extended Reality (XR) applications, this volumetric data has proven to be an essential technology for future XR elaboration. In this work, we present a new multimodal database to help advance the development of immersive technologies. Our proposed database provides ethically compliant and diverse volumetric data, in particular 27 participants displaying posed facial expressions and subtle body movements while speaking, plus 11 participants wearing head-mounted displays (HMDs). The recording system consists of a volumetric capture (VoCap) studio, including 31 synchronized modules with 62 RGB cameras and 31 depth cameras. In addition to textured meshes, point clouds, and multi-view RGB-D data, we use one Lytro Illum camera for providing light field (LF) data simultaneously. Finally, we also provide an evaluation of our dataset employment with regard to the tasks of facial expression classification, HMDs removal, and point cloud reconstruction. The dataset can be helpful in the evaluation and performance testing of various XR algorithms, including but not limited to facial expression recognition and reconstruction, facial reenactment, and volumetric video. HEADSET and its all associated raw data and license agreement will be publicly available for research purposes.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
