SyncSpace：用于混合现实中空间重塑的布局条件3D高斯溅射
SyncSpace: Layout-Conditioned 3D Gaussian Splatting for Space Reskinning in Mixed Reality
浏览论文内容
中文总结 AI 辅助
SyncSpace系统通过深度感应提取3D边界框，经生成世界模型生成高斯溅射场景，再用粗到精算法与物理空间对齐，实现空间重塑，可展示手部跟踪吞噬交互及同一空间重塑为多风格世界。
中文摘要 AI 辅助
我们提出了SyncSpace，一个在生成的3DGS世界与物理空间之间实现空间对齐和视觉一致性的系统。首先通过深度感应扫描空间以提取3D边界框，将其渲染为仅布局的全景图并作为几何先验输入生成世界模型，生成高斯溅射场景，其中对象无需逐个控制即可重新语义化以适应目标风格。然后用粗到精的配准算法将生成的场景与物理空间对齐，自动配准不收敛时可通过捏合手势手动优化。我们展示了手部跟踪的吞噬交互，即虚拟世界上升取代物理空间，并展示了一个空间重塑为多个风格不同但布局保留的世界。
英文摘要
We present SyncSpace, a system that achieves both spatial alignment and visual consistency between a generated 3DGS world and physical space. We first scan the space via depth sensing to extract 3D bounding boxes, which we render into a layout-only panorama and feed as a geometric prior to a generative world model, producing a Gaussian splat scene in which objects are re-semantized to fit a target style without per-object control. We then align the generated scene to physical space with a coarse-to-fine registration algorithm, refined manually via pinch gestures when automatic registration does not converge. We demonstrate a hand-tracked engulfment interaction in which the virtual world rises to replace the physical space, and show a single space reskinned into multiple stylistically distinct worlds with its layout preserved.
