姿态泼洒：一种用于量化动物姿态和外观的3D高斯泼洒模型
Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance
AI总结：
Pose Splatter通过3D高斯泼洒和形状雕刻技术，无需标注和优化即可准确建模动物姿态和外观，提升大规模行为分析能力。
摘要：
准确且可扩展地量化动物姿态和外观对于研究行为至关重要。当前的3D姿态估计技术，如关键点和网格基技术，常常面临挑战，包括表示细节有限、标注要求繁重以及每帧优化成本高。这些限制阻碍了对细微运动的研究，并可能使大规模分析变得不切实际。我们提出了Pose Splatter，一种新颖的框架，利用形状雕刻和3D高斯泼洒来建模实验室动物的完整姿态和外观，无需事先了解动物几何形状、每帧优化或手动标注。我们还提出了一种旋转不变的视觉嵌入技术，用于编码姿态和外观，设计为可以作为3D关键点数据在下游行为分析中的插件替代品。在小鼠、大鼠和斑马鸡的数据集上的实验表明，Pose Splatter能够学习准确的3D动物几何形状。值得注意的是，Pose Splatter能够表示姿态的细微变化，其在人类评估中提供了优于现有技术的更优低维姿态嵌入，并能泛化到未见过的数据。通过消除标注和每帧优化的瓶颈，Pose Splatter使分析大规模、长期行为成为可能，以高分辨率映射基因型、神经活动和行为。
英文摘要：
Accurate and scalable quantification of animal pose and appearance is crucial for studying behavior. Current 3D pose estimation techniques, such as keypoint- and mesh-based techniques, often face challenges including limited representational detail, labor-intensive annotation requirements, and expensive per-frame optimization. These limitations hinder the study of subtle movements and can make large-scale analyses impractical. We propose Pose Splatter, a novel framework leveraging shape carving and 3D Gaussian splatting to model the complete pose and appearance of laboratory animals without prior knowledge of animal geometry, per-frame optimization, or manual annotations. We also propose a rotation-invariant visual embedding technique for encoding pose and appearance, designed to be a plug-in replacement for 3D keypoint data in downstream behavioral analyses. Experiments on datasets of mice, rats, and zebra finches show Pose Splatter learns accurate 3D animal geometries. Notably, Pose Splatter represents subtle variations in pose, provides better low-dimensional pose embeddings over state-of-the-art as evaluated by humans, and generalizes to unseen data. By eliminating annotation and per-frame optimization bottlenecks, Pose Splatter enables analysis of large-scale, longitudinal behavior needed to map genotype, neural activity, and behavior at high resolutions.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
