发表机构
Singapore University of Technology and Design; Inha University(新加坡科技设计大学; 仁荷大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
提出VLM引导的电磁数字孪生在线校准框架,通过材料分类和路径规划,在20米内实现高精度电导率校准,优于随机方法。
AI 中文摘要
电磁(EM)数字孪生为移动机器人提供无线环境感知能力,但其依赖于随环境变化的材料电导率。在线校准面临初始化敏感性和测量行进成本问题。我们演示了一个使用Unitree G1机器人和NVIDIA Sionna的视觉-语言模型(VLM)引导框架,包含两次VLM调用:材料分类通过ITU-R P.2040将可见材料映射到电导率先验,用于Sionna对累积接收信号强度(RSS)测量进行梯度下降;路径规划利用残余RSS校准误差和图像覆盖在线选择下一个测量位置。在真实室内场景中,该框架在20米行进内实现了归一化平均绝对电导率误差为$1.74\ imes10^{-4}$;随机初始化从不收敛,而随机路径点需要超过两倍的行进距离。
英文摘要
An electromagnetic (EM) digital twin gives mobile robots wireless situational awareness but depends on material conductivities that change with the environment. Online calibration faces initialization sensitivity and measurement travel costs. We demonstrate a vision-language model (VLM)-guided framework using a Unitree G1 robot and NVIDIA Sionna, with two VLM calls: material classification maps visible materials through ITU-R P.2040 to conductivity priors for Sionna's gradient descent on accumulated received signal strength (RSS) measurements; waypoint planning selects the next measurement location online using residual RSS calibration error and image coverage. In a real indoor scenario, the framework achieves a normalized mean absolute conductivity error of $1.74\times10^{-4}$ within 20 m of travel; random initialization never converges, while random waypoints require over twice the travel.