RIS辅助的3D球面泼溅用于基于检测Transformer的物体组成可视化
RIS-Assisted 3D Spherical Splatting for Object Composition Visualization using Detection Transformers
AI总结:
本文提出一种PWE驱动的RF三维物体重建框架,结合RIS场合成与检测Transformer,从RF特征中推断物体几何与材料参数,仿真总体准确率达79.35%。
摘要:
对沉浸式且具备结构感知能力的多媒体体验的追求,增强了人们对超越可见光限制重建物体的感知模态的兴趣。传统光学流程在遮挡或低光照条件下性能下降,这促使人们采用射频(RF)感知,其电磁波可穿透材料并同时编码几何与组成信息。然而,不受控制的多径传播限制了重建精度。可编程无线环境(PWEs)的最新进展通过可重构智能表面(RISs)实现传播的软件定义操控,从而提供可控的照明分集,缓解了这一局限。基于此能力,本工作引入了一个PWE驱动的RF框架,利用材料感知的球面基元进行三维物体重建。所提方法将RIS支持的场合成与检测Transformer(DETR)相结合,直接从提取的RF特征中推断空间和材料参数。仿真结果证实了该框架逼近物体几何形状并对材料组成进行分类的能力,总体准确率达到79.35%,标志着向可编程且物理可靠的基于RF的三维物体组成可视化迈出了初步一步。
英文摘要:
The pursuit of immersive and structurally aware multimedia experiences has intensified interest in sensing modalities that reconstruct objects beyond the limits of visible light. Conventional optical pipelines degrade under occlusion or low illumination, motivating the use of radio-frequency (RF) sensing, whose electromagnetic waves penetrate materials and encode both geometric and compositional information. Yet, uncontrolled multipath propagation restricts reconstruction accuracy. Recent advances in Programmable Wireless Environments (PWEs) mitigate this limitation by enabling software-defined manipulation of propagation through Reconfigurable Intelligent Surfaces (RISs), thereby providing controllable illumination diversity. Building on this capability, this work introduces a PWE-driven RF framework for three-dimensional object reconstruction using material-aware spherical primitives. The proposed approach combines RIS-enabled field synthesis with a Detection Transformer (DETR) that infers spatial and material parameters directly from extracted RF features. Simulation results confirm the framework's ability to approximate object geometries and classify material composition with an overall accuracy of 79.35%, marking an initial step toward programmable and physically grounded RF-based 3D object composition visualization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。