Simulators are powerful tools for reasoning about a robot's interactions with its environment. However, when simulations diverge from reality, that reasoning becomes less useful. In this paper, we show how to close the loop between liquid simulation and real-time perception. We use observations of liquids to correct errors when tracking the liquid's state in a simulator. Our results show that closed-loop simulation is an effective way to prevent large divergence between the simulated and real liquid states. As a direct consequence of this, our method can enable reasoning about liquids that would otherwise be infeasible due to large divergences, such as reasoning about occluded liquid.
AutoLayout: Closed-Loop Layout Synthesis via Slow-Fast Collaborative Reasoning
Sun Yat-sen University, China(中山大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Peng Cheng Laboratory(鹏城实验室);Guangdong Key Laboratory of Big Data Analysis and Processing(广东大数据分析与处理重点实验室)
Vision-Language Model-based Physical Reasoning for Robot Liquid Perception
Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院);School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院)
ReasonPlan: Unified Scene Prediction and Decision Reasoning for Closed-loop Autonomous Driving
SKL-MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所SKL-MAIS部门,北京);School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学人工智能学院,北京);EACON, Fujian, China(福建EACON机构,中国);School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China(北京科技大学自动化与电气工程学院)
A Closed-Loop Perception, Decision-Making and Reasoning Mechanism for Human-Like Navigation
Zhejiang University(浙江大学);Netease Fuxi Robot Department(网易伏羲机器人部);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhejiang University of Technology(浙江工业大学);University of Shanghai for Science and Technology(上海理工大学)
CL-CoTNav: Closed-Loop Hierarchical Chain-of-Thought for Zero-Shot Object-Goal Navigation with Vision-Language Models
School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与宇航工程学院);Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (ASTAR)(新加坡科技研究局信息通信研究院);School of Science and Engineering, the Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院);Shanghai AI Laboratory(上海人工智能实验室)
MedVLA: A Hierarchical Vision-Language-Action Framework for Closed-Loop Precision Medical Robot Manipulation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Zhejiang Gongshang University(浙江工商大学)
LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Horizon Robotics(地平线机器人)