大模型推理能力

A little less conversation, a little more action, please: Investigating the physical common-sense of LLMs in a 3D embodied environment

Matteo G. Mecattaf, Ben Slater, Marko Tešić, Jonathan Prunty, Konstantinos Voudouris, Lucy G. Cheke

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 25 pages, 4 figures; v2: Added AFMR Acknowledgment

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct

Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Minzheng Wang, Pengpeng Zeng, Lianli Gao, Heng Tao Shen, Yunshui Li, Xiaobo Xia, Fei Huang, Jingkuan Song, Yongbin Li

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.CL

SocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms

Shashank Rao Marpally, Pranav Goyal, Harold Soh

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 7 pages, 5 figures

Learning Semantic Traversability with Egocentric Video and Automated Annotation Strategy

Yunho Kim, Jeong Hyun Lee, Choongin Lee, Juhyeok Mun, Donghoon Youm, Jeongsoo Park, Jemin Hwangbo

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments Accepted to IEEE Robotics and Automation Letters (RA-L) 2024, First two authors contributed equally

Journal ref IEEE Robotics and Automation Letters (Volume: 9, Issue: 11, November 2024)

PhotoBot: Reference-Guided Interactive Photography via Natural Language

Oliver Limoyo, Jimmy Li, Dmitriy Rivkin, Jonathan Kelly, Gregory Dudek

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments In Proceedings of the IEEE/RSJ International Conference on Intelligent Robotics and Systems (IROS'24), Abu Dhabi, UAE, Oct. 14-18, 2024

MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design

Jingyuan Qi, Zian Jia, Minqian Liu, Wangzhi Zhan, Junkai Zhang, Xiaofei Wen, Jingru Gan, Jianpeng Chen, Qin Liu, Mingyu Derek Ma, Bangzheng Li, Haohui Wang, Adithya Kulkarni, Muhao Chen, Dawei Zhou, Ling Li, Wei Wang, Lifu Huang

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction

Chen Bao, Jiarui Xu, Xiaolong Wang, Abhinav Gupta, Homanga Bharadhwaj

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.LG

Comments Preprint. Under Review

GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMs

Xinli Xu, Wenhang Ge, Dicong Qiu, ZhiFei Chen, Dongyu Yan, Zhuoyun Liu, Haoyu Zhao, Hanfeng Zhao, Shunsi Zhang, Junwei Liang, Ying-Cong Chen

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 17 pages, 17 figures

MUSES: 3D-Controllable Image Generation via Multi-Modal Agent Collaboration

Yanbo Ding, Shaobin Zhuang, Kunchang Li, Zhengrong Yue, Yu Qiao, Yali Wang

专题命中 视觉空间推理 ：planning(abstract)；分类 cs.AI

Comments AAAI 2025

Geo-LLaVA: A Large Multi-Modal Model for Solving Geometry Math Problems with Meta In-Context Learning

Shihao Xu, Yiyang Luo, Wei Shi

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

TANGO: Training-free Embodied AI Agents for Open-world Tasks

Filippo Ziliotto, Tommaso Campari, Luciano Serafini, Lamberto Ballan

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

A dual contrastive framework

Yuan Sun, Zhao Zhang, Jorge Ortiz

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Feudal Networks for Visual Navigation

Faith Johnson, Bryan Bo Cao, Ashwin Ashok, Shubham Jain, Kristin Dana

专题命中 视觉空间推理 ：planning(abstract)；分类 cs.LG

From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video Understanding

Heqing Zou, Tianze Luo, Guiyang Xie, Victor, Zhang, Fengmao Lv, Guangcong Wang, Junyang Chen, Zhuochen Wang, Hansheng Zhang, Huaijian Zhang

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 11 pages

Can Large Language Models Reason about the Region Connection Calculus?

Anthony G Cohn, Robert E Blackwell

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.CL

Comments 13 pages. arXiv admin note: text overlap with arXiv:2309.15577

Time is on my sight: scene graph filtering for dynamic environment perception in an LLM-driven robot

Simone Colombani, Luca Brini, Dimitri Ognibene, Giuseppe Boccignone

专题命中 视觉空间推理 ：planning(abstract)；分类 cs.AI

Development of CODO: A Comprehensive Tool for COVID-19 Data Representation, Analysis, and Visualization

Biswanath Dutta, Debanjali Bain

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 15 pages, 4 figures, journal

Journal ref Journal of Information and Knowledge, Vol. 61, no. 5, pp. 245-253 (2024)

Controllable Navigation Instruction Generation with Chain of Thought Prompting

Xianghao Kong, Jinyu Chen, Wenguan Wang, Hang Su, Xiaolin Hu, Yi Yang, Si Liu

专题命中 视觉空间推理 ：chain-of-thought(abstract)；分类 cs.AI

Comments ECCV 2024

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Aditya Sharma, Aman Dalmia, Mehran Kazemi, Amal Zouaq, Christopher J. Pal

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.CL

Character-aware audio-visual subtitling in context

Jaesung Huh, Andrew Zisserman

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.LG

Comments ACCV 2024

FlexGen: Flexible Multi-View Generation from Text and Image Inputs

Xinli Xu, Wenhang Ge, Jiantao Lin, Jiawei Feng, Lie Xu, HanFeng Zhao, Shunsi Zhang, Ying-Cong Chen

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments 16 pages, 13 figures

HAMMR: HierArchical MultiModal React agents for generic VQA

Lluis Castrejon, Thomas Mensink, Howard Zhou, Vittorio Ferrari, Andre Araujo, Jasper Uijlings

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.LG

Context-Conditional Navigation with a Learning-Based Terrain- and Robot-Aware Dynamics Model

Suresh Guttikonda, Jan Achterhold, Haolong Li, Joschka Boedecker, Joerg Stueckler

专题命中 视觉空间推理 ：planning(abstract)；分类 cs.LG

Comments ©2023 IEEE. Accepted for publication in European Conference on Mobile Robots (ECMR), 2023. Version including corrections (see p. 8)

Constructive Apraxia: An Unexpected Limit of Instructible Vision-Language Models and Analog for Human Cognitive Disorders

David Noever, Samantha E. Miller Noever

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling

William Yicheng Zhu, Keren Ye, Junjie Ke, Jiahui Yu, Leonidas Guibas, Peyman Milanfar, Feng Yang

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Comments Accepted at ECCV 2024. Contact: zhuwilliam[at]google[dot]com. GitHub: https://github.com/google-research/google-research/tree/master/attribute_with_prefixlm

Navigation in a simplified Urban Flow through Deep Reinforcement Learning

Federica Tonti, Jean Rabault, Ricardo Vinuesa

专题命中 视觉空间推理 ：planning(abstract)；分类 cs.AI

Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments

Zhiyuan Li, Yanfeng Lu, Yao Mu, Hong Qiao

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

Robot Utility Models: General Policies for Zero-Shot Deployment in New Environments

Haritheja Etukuru, Norihito Naka, Zijin Hu, Seungjae Lee, Julian Mehu, Aaron Edsinger, Chris Paxton, Soumith Chintala, Lerrel Pinto, Nur Muhammad Mahi Shafiullah

专题命中 视觉空间推理 ：verifier(abstract)；分类 cs.LG

Comments Project website https://robotutilitymodels.com

ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching

Niklas Funk, Julen Urain, Joao Carvalho, Vignesh Prasad, Georgia Chalvatzaki, Jan Peters

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI

SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systems

Wenxiao Zhang, Xiangrui Kong, Thomas Braunl, Jin B. Hong

专题命中 视觉空间推理 ：reasoning(abstract)；分类 cs.AI