Quantization-Aware Collaborative Inference for Large Embodied AI Models
量化感知的协作推理用于大体型具身AI模型
机构 * Department of Information Science and Engineering, KTH Royal Institute of Technology(信息科学与工程系,皇家理工学院) ; Research Institute for Digital Future, Khalifa University(数字未来研究院,哈利法大学) ; Department of Electrical and Computer Engineering, Princeton University(电气与计算机工程系,普林斯顿大学)
专题命中 机器人数据与评测 :embodied AI(title,abstract);embodied agent(abstract);分类 cs.LG
AI总结 本文提出了一种量化感知的协作推理方法,通过联合优化量化位宽和计算频率,以在资源受限的具身AI系统中平衡推理质量、延迟和能耗。