视觉大模型 / VLM

Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions

Pu Jian, Donglei Yu, Wen Yang, Shuo Ren, Jiajun Zhang

专题命中 视觉问答 ：vision-language model(title)；visual language model(abstract)；visual question answering(abstract)；分类 cs.CV

Comments ACL2025 Main (SAC Highlight Award)

When Safe Unimodal Inputs Collide: Optimizing Reasoning Chains for Cross-Modal Safety in Multimodal Large Language Models

Wei Cai, Shujuan Liu, Jian Zhao, Ziyan Shi, Yusheng Zhao, Yuchen Yuan, Tianle Zhang, Chi Zhang, Xuelong Li

专题命中 视觉推理 ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.AI

STRIVE: Structured Representation Integrating VLM Reasoning for Efficient Object Navigation

Haokun Zhu, Zongtai Li, Zhixuan Liu, Wenshan Wang, Ji Zhang, Jonathan Francis, Jean Oh

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Bosch Center for AI（博世人工智能中心） 纠错

专题命中 视觉推理 ：VLM(title,abstract)；vision-language model(abstract)

Comments We remove OSG and CogNav from Table. 1 for a fair comparison

3D Aware Region Prompted Vision Language Model

An-Chieh Cheng, Yang Fu, Yukang Chen, Zhijian Liu, Xiaolong Li, Subhashree Radhakrishnan, Song Han, Yao Lu, Jan Kautz, Pavlo Molchanov, Hongxu Yin, Xiaolong Wang, Sifei Liu

机构 * MIT（麻省理工学院） ； NVIDIA（英伟达） 纠错

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments Project Website: https://www.anjiecheng.me/sr3d

Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder

Qifei Jia, Yu Liu, Yajie Chai, Xintong Yao, Qiming Lu, Yasen Zhang, Runyu Shi, Ying Huang, Guoquan Zhang

机构 * Xiaomi Corporation Beijing, China（小米公司北京） 纠错

专题命中 视觉推理 ：MLLM(title,abstract)；分类 cs.CV

ByDeWay: Boost Your multimodal LLM with DEpth prompting in a Training-Free Way

Rajarshi Roy, Devleena Das, Ankesh Banerjee, Arjya Bhattacharjee, Kousik Dasgupta, Subarna Tripathi

机构 * Kalyani Government Engineering College（卡利尼政府工程学院） ； Intel Labs（英特尔实验室） 纠错

专题命中 视觉推理 ：vision-language model(abstract)；grounding(abstract)；multimodal large language model(abstract)；分类 cs.CV

PATIMT-Bench: A Multi-Scenario Benchmark for Position-Aware Text Image Machine Translation in Large Vision-Language Models

Wanru Zhuang, Wenbo Li, Zhibin Lan, Xu Han, Peng Li, Jinsong Su

机构 * School of Informatics, Xiamen University, China（厦门大学信息学院） ； Tsinghua, Beijing, China（清华大学） ； Shanghai Artificial Intelligence Laboratory, China（上海人工智能实验室） 纠错

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；grounding(abstract)；分类 cs.CV、cs.AI

Beyond Artificial Misalignment: Detecting and Grounding Semantic-Coordinated Multimodal Manipulations

Jinjie Shen, Yaxiong Wang, Lechao Cheng, Nan Pu, Zhun Zhong

机构 * Hefei University of Technology（合肥工业大学） ； University of Trento（特伦托大学） 纠错

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

VARCO-VISION-2.0 Technical Report

Young-rok Cha, Jeongho Ju, SunYoung Park, Jong-Hyeon Lee, Younghyun Yu, Youngjune Kim

机构 * NC AI 纠错

专题命中 视觉定位与Grounding ：VLM(abstract,comments)；vision-language model(abstract)；grounding(abstract)；分类 cs.CV

Comments 19 pages, 1 figure, 14 tables. Technical report for VARCO-VISION-2.0, a Korean-English bilingual VLM in 14B and 1.7B variants. Key features: multi-image understanding, OCR with text localization, improved Korean capabilities

Simulating Clinical AI Assistance using Multimodal LLMs: A Case Study in Diabetic Retinopathy

Nadim Barakat, William Lotter

机构 * Dana-Farber Cancer Institute & Tufts University School of Medicine（达纳-法伯癌症研究所及塔夫茨大学医学院） ； Dana-Farber Cancer Institute Brigham and Women’s Hospital & Harvard Medical School（达纳-法伯癌症研究所布里特妇女医院及哈佛医学院） 纠错

专题命中 视觉定位与Grounding ：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

Visual Contextual Attack: Jailbreaking MLLMs with Image-Driven Context Injection

Ziqi Miao, Yi Ding, Lijun Li, Jing Shao

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Purdue University（普渡大学） 纠错

专题命中 视觉定位与Grounding ：grounding(abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted to EMNLP 2025 (Main). 17 pages, 7 figures

Benchmarking and Improving LVLMs on Event Extraction from Multimedia Documents

Fuyu Xing, Zimu Wang, Wei Wang, Haiyang Zhang

机构 * School of Advanced Technology, Xi’an Jiaotong-Liverpool University（先进技术学院，西安交通大学利物浦大学） 纠错

专题命中 视觉定位与Grounding ：vision-language model(abstract)；grounding(abstract)

Comments Accepted at INLG 2025. Camera-ready version

ResidualViT for Efficient Temporally Dense Video Encoding

Mattia Soldan, Fabian Caba Heilbron, Bernard Ghanem, Josef Sivic, Bryan Russell

机构 * KAUST（科威特科学与技术王国（KAUST）） ； CIIRC CTU（布拉格技术大学智能信息与计算研究中心（CIIRC CTU）） ； Adobe Research（Adobe研究） 纠错

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentation

Luca Barsellotti, Lorenzo Bianchi, Nicola Messina, Fabio Carrara, Marcella Cornia, Lorenzo Baraldi, Fabrizio Falchi, Rita Cucchiara

机构 * University of Modena and Reggio Emilia（摩德纳和雷吉奥艾米利亚大学） ； ISTI-CNR（意大利国家研究委员会ISTI） ； University of Pisa（比萨大学） 纠错

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments ICCV 2025

Image Realness Assessment and Localization with Multimodal Features

Lovish Kaushik, Agnij Biswas, Somdyuti Paul

机构 * Indian Institute of Technology, Kharagpur（印度理工学院，克哈拉格普） 纠错

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Instance-Level Data-Use Auditing of Visual ML Models

Zonghao Huang, Neil Zhenqiang Gong, Michael K. Reiter

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.LG

ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement

Ali Salamatian, Amirhossein Abaskohi, Wan-Cyuan Fan, Mir Rayat Imtiaz Hossain, Leonid Sigal, Giuseppe Carenini

专题命中 文档图表理解 ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments EMNLP 2025

ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigation

Zekai Zhang, Weiye Zhu, Hewei Pan, Xiangchen Wang, Rongtao Xu, Xing Sun, Feng Zheng

机构 * Southern University of Science and Technology, China（南方科技大学，中国） ； Spatialtemporal AI, China（时空AI，中国） ； MBZUAI, UAE（MBZUAI，阿联酋） ； Tencent Youtu Lab（腾讯优图实验室） 纠错

专题命中 GUI与屏幕智能体 ：MLLM(abstract)；分类 cs.CV、cs.AI

An integrated process for design and control of lunar robotics using AI and simulation

Daniel Lindmark, Jonas Andersson, Kenneth Bodin, Tora Bodin, Hugo Börjesson, Fredrik Nordfeldth, Martin Servin

机构 * Ume \ University, Ume , Sweden 纠错

专题命中 GUI与屏幕智能体 ：vision-language model(abstract)；分类 cs.AI

Comments 14 pages, 6 figures

Sign Language: Towards Sign Understanding for Robot Autonomy

Ayush Agrawal, Joel Loo, Nicky Zimmerman, David Hsu

机构 * Smart Systems Institute, National University of Singapore（新加坡国立大学智能系统研究所） ； Northeastern University（东北大学） 纠错

专题命中 GUI与屏幕智能体 ：vision-language model(abstract)

Comments This work has been submitted to the IEEE for possible publication

Evaluating Robustness of Vision-Language Models Under Noisy Conditions

Purushoth, Alireza

机构 * University of Nevada Reno（内华达大学拉斯维加斯分校） 纠错

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；LLaVA(abstract)；visual question answering(abstract)；分类 cs.CV

Evaluating the Robustness of Open-Source Vision-Language Models to Domain Shift in Object Captioning

Federico Tavella, Amber Drinkwater, Angelo Cangelosi

机构 * Centre for Robotic Autonomy in Demanding and Long-lasting Environments（机器人自主性在恶劣和持久环境中的研究中心） ； Centre for Robotics and AI（机器人与人工智能中心） ； University of Manchester（曼彻斯特大学） ； Amentum Clean Energy Ltd（Amentum清洁能源有限公司） 纠错

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI、cs.LG

Defense-to-Attack: Bypassing Weak Defenses Enables Stronger Jailbreaks in Vision-Language Models

Yunhan Zhao, Xiang Zheng, Xingjun Ma

机构 * Fudan University（复旦大学） ； City University of Hong Kong（香港城市大学） 纠错

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments This work has been submitted to the IEEE for possible publication

Adversarial Prompt Distillation for Vision-Language Models

Lin Luo, Xin Wang, Bojia Zi, Shihao Zhao, Xingjun Ma, Yu-Gang Jiang

机构 * Shanghai Key Lab of Intell. Info. Processing, School of CS, Fudan University（上海智能信息处理实验室，计算机科学学院，复旦大学） ； The Chinese University of Hong Kong, Shatin, Hong Kong（香港中文大学，沙田，香港） ； The University of Hong Kong, Pokfulam, Hong Kong（香港大学，薄扶林，香港） 纠错

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments This work has been submitted to the IEEE for possible publication

Phi: Preference Hijacking in Multi-modal Large Language Models at Inference Time

Yifan Lan, Yuanpu Cao, Weitong Zhang, Lu Lin, Jinghui Chen

机构 * The Pennsylvania State University（宾夕法尼亚州立大学） ； The University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校） 纠错

专题命中 幻觉与鲁棒性 ：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.LG

Empowering LLMs with Parameterized Skills for Adversarial Long-Horizon Planning

Sijia Cui, Shuai Xu, Aiyao He, Yanna Wang, Bo Xu

机构 * 1 Institute of Automation, Chinese Academy of Sciences, Beijing, China ； 2 School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China ； 3 Nanjing Artificial Intelligence Research of IA, Nanjing, China ； 4 University of Chinese Academy of Sciences,Nanjing, Nanjing, China ； 5 Nanjing University of Information Science \& Technology, Nanjing, China 纠错

专题命中 幻觉与鲁棒性 ：grounding(abstract)

Comments Accepted to IJCNN 2025

Contrastive Learning with Enhanced Abstract Representations using Grouped Loss of Abstract Semantic Supervision

Omri Suissa, Muhiim Ali, Shengmai Chen, Yinuo Cai, Shekhar Pradhan

专题命中 VLM训练与架构 ：VLM(abstract)

MEJO: MLLM-Engaged Surgical Triplet Recognition via Inter- and Intra-Task Joint Optimization

Yiyi Zhang, Yuchen Yuan, Ying Zheng, Jialun Pei, Jinpeng Li, Zheng Li, Pheng-Ann Heng

专题命中 其他VLM ：MLLM(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

Cross-Image Contrastive Decoding: Precise, Lossless Suppression of Language Priors in Large Vision-Language Models

Jianfei Zhao, Feng Zhang, Xin Sun, Lingxing Kong, Zhixing Tan, Chong Feng

机构 * School of Computer Science and Technology, Beijing Institute of Technology（计算机科学与技术学院，北京理工大学） ； Zhongguancun Academy（中关村学院） ； Southeast Academy of Information Technology, Beijing Institute of Technology（信息技术东南学院，北京理工大学） ； Tsinghua University（清华大学） 纠错

专题命中 其他VLM ：vision-language model(title,abstract)；分类 cs.CV

Comments Under Review