机器人 / 具身智能

Motion Prompting: Controlling Video Generation with Motion Trajectories

Daniel Geng, Charles Herrmann, Junhwa Hur, Forrester Cole, Serena Zhang, Tobias Pfaff, Tatiana Lopez-Guevara, Carl Doersch, Yusuf Aytar, Michael Rubinstein, Chen Sun, Oliver Wang, Andrew Owens, Deqing Sun

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments CVPR 2025 camera ready. Project page: https://motion-prompting.github.io/

Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models

Ilias Stogiannidis, Steven McDonagh, Sotirios A. Tsaftaris

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

Comments 8 main pages, 4 pages Appendix, 5 figures

EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgery

Guankun Wang, Long Bai, Junyi Wang, Kun Yuan, Zhen Li, Tianxu Jiang, Xiting He, Jinlin Wu, Zhen Chen, Zhen Lei, Hongbin Liu, Jiazheng Wang, Fan Zhang, Nicolas Padoy, Nassir Navab, Hongliang Ren

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videos

Lorenzo Mur-Labadia, Josechu Guerrero, Ruben Martinez-Cantin

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Chameleon: Fast-slow Neuro-symbolic Lane Topology Extraction

Zongzheng Zhang, Xinrun Li, Sizhe Zou, Guoxuan Chi, Siqi Li, Xuchong Qiu, Guoliang Wang, Guantian Zheng, Leichen Wang, Hang Zhao, Hao Zhao

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments ICRA 2025, Project Page: https://github.com/XR-Lee/neural-symbolic

SSNet: Saliency Prior and State Space Model-based Network for Salient Object Detection in RGB-D Images

Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Towards Robust Algorithms for Surgical Phase Recognition via Digital Twin Representation

Hao Ding, Yuqian Zhang, Wenzheng Cheng, Xinyu Wang, Xu Lian, Chenhao Yu, Hongchao Shu, Ji Woong Kim, Axel Krieger, Mathias Unberath

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

ARCON: Advancing Auto-Regressive Continuation for Driving Videos

Ruibo Ming, Jingwei Wu, Zhewei Huang, Zhuoxuan Ju, Jianming HU, Lihui Peng, Shuchang Zhou

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Noumenal Labs White Paper: How To Build A Brain

Maxwell J. D. Ramstead, Candice Pattisapu, Jason Fox, Jeff Beck

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

ElasticTok: Adaptive Tokenization for Image and Video

Wilson Yan, Volodymyr Mnih, Aleksandra Faust, Matei Zaharia, Pieter Abbeel, Hao Liu

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Predicting 3D representations for Dynamic Scenes

Di Qi, Tong Yang, Beining Wang, Xiangyu Zhang, Wenqiang Zhang

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Zero-Shot Scene Understanding for Automatic Target Recognition Using Large Vision-Language Models

Yasiru Ranasinghe, Vibashan VS, James Uplinger, Celso De Melo, Vishal M. Patel

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

How GPT learns layer by layer

Jason Du, Kelly Hong, Alishba Imran, Erfan Jahanparast, Mehdi Khfifi, Kaichun Qiao

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

A new solution and concrete implementation steps for Artificial General Intelligence

Yongcong Chen, Ting Zeng, Xingyue Chen

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments 25 pages, 2 figures, 1 table

MinkSORT: A 3D deep feature extractor using sparse convolutions to improve 3D multi-object tracking in greenhouse tomato plants

David Rapado-Rincon, Eldert J. van Henten, Gert Kootstra

专题命中 具身推理 ：world model(abstract)；分类 cs.RO

Challenges Faced by Large Language Models in Solving Multi-Agent Flocking

Peihan Li, Vishnu Menon, Bhavanaraj Gudiguntla, Daniel Ting, Lifeng Zhou

专题命中 具身推理 ：robotics(abstract)；分类 cs.AI

GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency

Dongyue Lu, Lingdong Kong, Tianxin Huang, Gim Hee Lee

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments 22 pages, 8 figures, 12 tables; Project Page at https://dylanorange.github.io/projects/geal

Towards Robust and Fair Vision Learning in Open-World Environments

Thanh-Dat Truong

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments PhD Dissertation

Event fields: Capturing light fields at high speed, resolution, and dynamic range

Ziyuan Qu, Zihao Zou, Vivek Boominathan, Praneeth Chakravarthula, Adithya Pediredla

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Query-Efficient Planning with Language Models

Gonzalo Gonzalez-Pumariega, Wayne Chen, Kushal Kedia, Sanjiban Choudhury

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Comments 11 pages (not including references or appendix); 13 figures (9 main paper, 4 appendix); (v1) preprint

Monitoring Latent World States in Language Models with Propositional Probes

Jiahai Feng, Stuart Russell, Jacob Steinhardt

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving

Zehuan Wu, Jingcheng Ni, Xiaodong Wang, Yuxin Guo, Rui Chen, Lewei Lu, Jifeng Dai, Yuwen Xiong

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

ROOT: VLM based System for Indoor Scene Understanding and Beyond

Yonghui Wang, Shi-Yong Chen, Zhenxing Zhou, Siyi Li, Haoran Li, Wengang Zhou, Houqiang Li

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

Reducing Label Dependency for Underwater Scene Understanding: A Survey of Datasets, Techniques and Applications

Scarlett Raine, Frederic Maire, Niko Suenderhauf, Tobias Fischer

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments 70 pages, 20 figures

$SE(3)$ Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation

Yinshuang Xu, Dian Chen, Katherine Liu, Sergey Zakharov, Rares Ambrus, Kostas Daniilidis, Vitor Guizilini

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Accepted at NeurIPS 2024

Symbolic Graph Inference for Compound Scene Understanding

FNU Aryan, Simon Stepputtis, Sarthak Bhagat, Joseph Campbell, Kwonjoon Lee, Hossein Nourkhiz Mahjoub, Katia Sycara

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors

Chenyang Ma, Kai Lu, Ta-Ying Cheng, Niki Trigoni, Andrew Markham

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments NeurIPS 2024; Project Page: https://dannymcy.github.io/zeroshot_task_hallucination/

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence

Anna Dawid, Yann LeCun

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments 23 pages + 1-page appendix, 11 figures. These notes follow the content of three lectures given by Yann LeCun during the Les Houches Summer School on Statistical Physics and Machine Learning in 2022. Feedback and comments are most welcome!

Journal ref J. Stat. Mech. (2024) 104011

Surgical Scene Segmentation by Transformer With Asymmetric Feature Enhancement

Cheng Yuan, Yutong Ban

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Looking Inward: Language Models Can Learn About Themselves by Introspection

Felix J Binder, James Chua, Tomek Korbak, Henry Sleight, John Hughes, Robert Long, Ethan Perez, Miles Turpin, Owain Evans

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Comments 15 pages, 9 figures