视觉大模型 / VLM - arXivDaily 专题

2501.13042 2025-02-26 cs.CL 50%

Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning

Bohao Yang, Yingji Zhang, Dong Liu, André Freitas, Chenghua Lin

机构 * The University of Manchester（曼彻斯特大学）； Tencent Timi Studio（腾讯天美工作室）； Idiap Research Institute（Idiap研究所）

专题命中视觉推理：multimodal large language model(abstract)

2403.13187 2025-01-28 cs.NE 50%

Evolutionary Optimization of Model Merging Recipes

Takuya Akiba, Makoto Shing, Yujin Tang, Qi Sun, David Ha

专题命中视觉推理：VLM(abstract)

Comments Authors' submitted version before final edits. Published in Nature Machine Intelligence on January 27, 2025: https://www.nature.com/articles/s42256-024-00975-8

Journal ref Nat Mach Intell (2025)

2312.14620 2025-01-09 cs.LO cs.CC 50%

Structure-Guided Automated Reasoning

Max Bannach, Markus Hecher

专题命中视觉推理：grounding(abstract)

2411.05212 2024-11-11 cs.RO 50%

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

Jinxuan Xu, Shiyu Jin, Yutian Lei, Yuqian Zhang, Liangjun Zhang

专题命中视觉推理：VLM(abstract)

Comments Accepted to IROS 2024

2404.03622 2024-10-24 cs.CL 50%

Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models

Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei

专题命中视觉推理：multimodal large language model(abstract)

Comments 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

2403.02246 2024-10-23 cs.CL 50%

PHAnToM: Persona-based Prompting Has An Effect on Theory-of-Mind Reasoning in Large Language Models

Fiona Anting Tan, Gerard Christopher Yeo, Kokil Jaidka, Fanyou Wu, Weijie Xu, Vinija Jain, Aman Chadha, Yang Liu, See-Kiong Ng

专题命中视觉推理：grounding(abstract)

Comments 8 pages

2410.07494 2024-10-11 cs.RO 50%

G$^{2}$TR: Generalized Grounded Temporal Reasoning for Robot Instruction Following by Combining Large Pre-trained Models

Riya Arora, Niveditha Narendranath, Aman Tambi, Sandeep S. Zachariah, Souvik Chakraborty, Rohan Paul

专题命中视觉推理：grounding(abstract)

2410.06555 2024-10-10 cs.CL 50%

ING-VP: MLLMs cannot Play Easy Vision-based Games Yet

Haoran Zhang, Hangyu Guo, Shuyue Guo, Meng Cao, Wenhao Huang, Jiaheng Liu, Ge Zhang

专题命中视觉推理：multimodal large language model(abstract)

Comments 49 pages, 12 figures

2409.06638 2024-09-11 cs.IR 50%

Critical Features Tracking on Triangulated Irregular Networks by a Scale-Space Method

Haoan Feng, Yunting Song, Leila De Floriani

专题命中视觉推理：visual reasoning(abstract)

Comments 13pages, ACM SIGSPATIAL 2024

2209.07662 2024-08-14 cs.CL 50%

NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoning

Nathaniel Weir, Peter Clark, Benjamin Van Durme

专题命中视觉推理：grounding(abstract)

Comments Published at IJCAI 2024

2407.03615 2024-07-08 cs.CL 50%

Visualizing Dialogues: Enhancing Image Selection through Dialogue Understanding with Large Language Models

Chang-Sheng Kao, Yun-Nung Chen

专题命中视觉推理：vision language model(abstract)

2407.01863 2024-07-03 cs.CL 50%

VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs

Qiucheng Wu, Handong Zhao, Michael Saxon, Trung Bui, William Yang Wang, Yang Zhang, Shiyu Chang

专题命中视觉推理：vision language model(abstract)

2405.02794 2024-06-06 cs.RO 50%

Octopi: Object Property Reasoning with Large Tactile-Language Models

Samson Yu, Kelvin Lin, Anxing Xiao, Jiafei Duan, Harold Soh

专题命中视觉推理：vision-language model(abstract)

Comments Accepted at Robotics: Science and Systems (R:SS 2024)

2403.06935 2024-06-05 cs.CL 50%

Naming, Describing, and Quantifying Visual Objects in Humans and LLMs

Alberto Testoni, Juell Sprott, Sandro Pezzelle

专题命中视觉推理：LLaVA(abstract)

Comments Accepted to ACL 2024 (main conference)

2404.14604 2024-04-29 cs.CL 50%

Describe-then-Reason: Improving Multimodal Mathematical Reasoning through Visual Comprehension Training

Mengzhao Jia, Zhihan Zhang, Wenhao Yu, Fangkai Jiao, Meng Jiang

专题命中视觉推理：multimodal large language model(abstract)

2402.01246 2024-04-15 cs.RO cs.SY eess.SY 50%

LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving

Daocheng Fu, Wenjie Lei, Licheng Wen, Pinlong Cai, Song Mao, Min Dou, Botian Shi, Yu Qiao

专题命中视觉推理：multimodal large language model(abstract)

Comments Accepted by 35th IEEE Intelligent Vehicles Symposium (IV 2024)

2403.11513 2024-03-19 cs.RO 50%

Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation

Joonhyung Lee, Sangbeom Park, Yongin Kwon, Jemin Lee, Minwook Ahn, Sungjoon Choi

专题命中视觉推理：visual reasoning(abstract)

Comments 8 pages

2311.09862 2024-03-15 cs.CL cs.SI 50%

Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models

Debarati Das, Ishaan Gupta, Jaideep Srivastava, Dongyeop Kang

专题命中视觉推理：vision-language model(abstract)

2304.02313 2024-03-05 cs.CL 50%

Personality-aware Human-centric Multimodal Reasoning: A New Task, Dataset and Baselines

Yaochen Zhu, Xiangqing Shen, Rui Xia

专题命中视觉推理：multimodal large language model(abstract)

2402.15654 2024-02-27 cs.CL 50%

Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics

Sadaf Ghaffari, Nikhil Krishnaswamy

专题命中视觉推理：vision-language model(abstract)

Comments 10 pages, 10 figures, Proceedings of AAAI Spring Symposium: Empowering Machine Learning and Large Language Models with Domain and Commonsense Knowledge (MAKE). AAAI (2024)

2402.13584 2024-02-22 cs.CL 50%

WinoViz: Probing Visual Properties of Objects Under Different States

Woojeong Jin, Tejas Srinivasan, Jesse Thomason, Xiang Ren

专题命中视觉推理：vision-language model(abstract)

Comments Preprint

2305.10790 2024-02-21 eess.AS cs.SD 50%

Listen, Think, and Understand

Yuan Gong, Hongyin Luo, Alexander H. Liu, Leonid Karlinsky, James Glass

专题命中视觉推理：multimodal large language model(abstract)

Comments Accepted at ICLR 2024. Code, dataset, and models are available at https://github.com/YuanGongND/ltu. The interactive demo is at https://huggingface.co/spaces/yuangongfdu/ltu

2309.09182 2024-01-12 cs.RO 50%

Optimal Scene Graph Planning with Large Language Model Guidance

Zhirui Dai, Arash Asgharivaskasi, Thai Duong, Shusen Lin, Maria-Elizabeth Tzes, George Pappas, Nikolay Atanasov

专题命中视觉推理：grounding(abstract)

1704.04882 2023-11-03 cs.LO cs.CC math.CT math.LO 50%

Monoidal computer III: A coalgebraic view of computability and complexity

Dusko Pavlovic, Muzamil Yahia

专题命中视觉推理：visual reasoning(abstract)

Comments 34 pages, 24 figures; in this version: added the Appendix

Journal ref Lecture Notes in Computer Science, vol 11202, Springer 2018, pp. 167-189

2310.09036 2023-10-16 cs.CL cs.MM 50%

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

Xiaocui Yang, Wenfang Wu, Shi Feng, Ming Wang, Daling Wang, Yang Li, Qi Sun, Yifei Zhang, Xiaoming Fu, Soujanya Poria

专题命中视觉推理：multimodal large language model(abstract)

Comments Underview

2305.04530 2023-05-09 cs.CL 50%

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

Yunxin Li, Baotian Hu, Xinyu Chen, Yuxin Ding, Lin Ma, Min Zhang

专题命中视觉推理：vision-language model(abstract)

Comments Accepted to ACL 2023 Main Conference

2305.02265 2023-05-08 cs.CL 50%

A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text

Yunxin Li, Baotian Hu, Yuxin Ding, Lin Ma, Min Zhang

专题命中视觉推理：vision-language model(abstract)

Comments Accepted to ACL 2023 Main Conference

2212.08195 2022-12-19 cs.CL 50%

Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Engines

Andrew Lee, David Wu, Emily Dinan, Mike Lewis

专题命中视觉推理：grounding(abstract)

2205.14288 2022-05-31 cs.CL 50%

Few-shot Subgoal Planning with Language Models

Lajanugen Logeswaran, Yao Fu, Moontae Lee, Honglak Lee

专题命中视觉推理：visual reasoning(abstract)

Comments NAACL 2022

2107.05833 2021-07-14 cs.CL 50%

Enforcing Consistency in Weakly Supervised Semantic Parsing

Nitish Gupta, Sameer Singh, Matt Gardner

专题命中视觉推理：visual reasoning(abstract)

Comments Published in ACL 2021

1. 视觉推理 4536 篇

Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning

Evolutionary Optimization of Model Merging Recipes

Structure-Guided Automated Reasoning

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models

PHAnToM: Persona-based Prompting Has An Effect on Theory-of-Mind Reasoning in Large Language Models

G$^{2}$TR: Generalized Grounded Temporal Reasoning for Robot Instruction Following by Combining Large Pre-trained Models

ING-VP: MLLMs cannot Play Easy Vision-based Games Yet

Critical Features Tracking on Triangulated Irregular Networks by a Scale-Space Method

NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable Reasoning

Visualizing Dialogues: Enhancing Image Selection through Dialogue Understanding with Large Language Models

VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs

Octopi: Object Property Reasoning with Large Tactile-Language Models

Naming, Describing, and Quantifying Visual Objects in Humans and LLMs

Describe-then-Reason: Improving Multimodal Mathematical Reasoning through Visual Comprehension Training

LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Driving

Visual Preference Inference: An Image Sequence-Based Preference Reasoning in Tabletop Object Manipulation

Which Modality should I use -- Text, Motif, or Image? : Understanding Graphs with Large Language Models

Personality-aware Human-centric Multimodal Reasoning: A New Task, Dataset and Baselines

Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics

WinoViz: Probing Visual Properties of Objects Under Different States

Listen, Think, and Understand

Optimal Scene Graph Planning with Large Language Model Guidance

Monoidal computer III: A coalgebraic view of computability and complexity

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text

Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Engines

Few-shot Subgoal Planning with Language Models

Enforcing Consistency in Weakly Supervised Semantic Parsing