GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Tsinghua University(清华大学);Zhejiang University(浙江大学);Beihang University(北京航空航天大学);Carnegie Mellon University(卡内基梅隆大学);The University of Hong Kong(香港大学)
Vision-language-action (VLA) policies have advanced language-conditioned robotic manipulation by transferring semantic priors from pretrained vision-language models to action generation. However, standard action-imitation learning often lacks sufficient modeling of explicit 3D spatial information, dense geometric supervision, and future environment evolution, all critical for precise robotic interaction. To address this, we propose \textbf{GaussianDream}, a feed-forward 3D Gaussian world-model plug-in. Specifically, we introduce learnable GaussianDream Queries in the encoder, enabling the model to capture current-frame 3D spatial structure and short-horizon future evolution. During training, the latent GaussianDream prefix is processed by a static reconstruction head and a future prediction head to produce current 3D Gaussian scene states and future Gaussian evolution states. The current branch is supervised by RGB rendering and depth, while the future branch uses future RGB, depth, and pseudo 3D scene-flow signals. During inference, GaussianDream discards all auxiliary heads and retains only the learned prefix to condition action generation, without test-time Gaussian reconstruction or future prediction. Experimental results demonstrate that GaussianDream achieves state-of-the-art performance across multiple robotic manipulation benchmarks, reaching \textbf{98.4\%} on LIBERO, \textbf{54.8\%} on RoboCasa Human-50, and \textbf{50.0\%} on real-robot tasks. Compared with existing 3D-enhanced VLA methods, GaussianDream achieves strong accuracy while providing higher inference efficiency than video-based world-model approaches.
GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulation
Tuojing Intelligence(拓境智能);University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Nanyang Technological University(南洋理工大学);Beihang University(北京航空航天大学);Carnegie Mellon University(卡内基梅隆大学);The University of Hong Kong(香港大学)
Dexterous Soft Hands Linearize Feedback-Control for In-Hand Manipulation
Robotics and Biology Laboratory, Technische Universität Berlin(柏林工业大学机器人与生物实验室);Science of Intelligence, Research Cluster of Excellence, Berlin(柏林卓越研究集群智能科学)
Integrating and Evaluating Visuo-tactile Sensing with Haptic Feedback for Teleoperated Robot Manipulation
Technische Universität Darmstadt(达姆施塔特工业大学);German Research Center for AI (DFKI)(德国人工智能研究中心);Hessian Centre for Artificial Intelligence (Hessian.AI)(黑森州人工智能中心);Centre for Cognitive Science (CogSci)(认知科学中心);Nagoya University(名古屋大学)
Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstruction
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学)
LaGEA: Language Guided Embodied Agents for Robotic Manipulation
Department of Robotics;Mechatronics Engineering, University of Dhaka, Bangladesh;Center for Computational \& Data Sciences, Independent University, Bangladesh
Grasping in the Dark: Zero-Shot Object Grasping Using Tactile Feedback
Perception and Robotics Group, University of Maryland, College Park(马里兰大学帕克分校感知与机器人小组);University of Maryland, College Park(马里兰大学帕克分校);University of Maryland(马里兰大学)
Cross-Modal Visuo-Tactile Representation Learning with Action Chunking Transformers for Contact-Rich Manipulation
Guangdong Institute of Intelligence Science and Technology(广东智能科学与技术研究院);Innovation and Research and Development Department, BoardWare Information System Company Ltd.(创新与研发部,BoardWare信息系统有限公司);School of Artificial Intelligence, Nanjing Agricultural University(人工智能学院,南京农业大学);School of Computing, National University of Singapore(计算机学院,新加坡国立大学);School of Electronic Engineering and Automation, Guilin University of Electronic Technology(电子工程与自动化学院,桂林电子科技大学)
FingerEye: Learning Dexterous Manipulation with Continuous Vision-Tactile Sensing
National University of Singapore(新加坡国立大学);RoboScience(机器人科学);Huazhong University of Science and Technology(华中科技大学);South China University of Technology(华南理工大学)
KineDex: Learning Tactile-Informed Visuomotor Policies via Kinesthetic Teaching for Dexterous Manipulation
Tongji University(同济大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);University of Hong Kong(香港大学);Shanghai Qi Zhi Institute(上海启智研究院);Shanghai AI Lab(上海人工智能实验室)
ProxiDex: Learning Dynamics-Guided Proximity Policy for Dexterous Manipulation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Xinjiang University(新疆大学);Beijing Zhongke Huiling Robot Technology Co., LTD.(北京中科慧灵机器人技术有限公司)