视觉大模型 / VLM

Demystifying the Potential of ChatGPT-4 Vision for Construction Progress Monitoring

Ahmet Bahaddin Ersoz

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Journal ref 8th International Project and Construction Management Conference (IPCMC2024)

Exploring Scalability of Self-Training for Open-Vocabulary Temporal Action Localization

Jeongseok Hyun, Su Ho Han, Hyolim Kang, Joon-Young Lee, Seon Joo Kim

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to WACV 2025

Just a Few Glances: Open-Set Visual Perception with Image Prompt Paradigm

Jinrong Zhang, Penghui Wang, Chunxiao Liu, Wei Liu, Dian Jin, Qiong Zhang, Erli Meng, Zhengnan Hu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments Accepted by AAAI2025

SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentation

Yi-Chia Chen, Wei-Hua Li, Cheng Sun, Yu-Chiang Frank Wang, Chu-Song Chen

专题命中 视觉定位与Grounding ：MLLM(abstract)；分类 cs.CV、cs.AI

Comments ECCV 2024

VLMs meet UDA: Boosting Transferability of Open Vocabulary Segmentation with Unsupervised Domain Adaptation

Roberto Alcover-Couso, Marcos Escudero-Viñolo, Juan C. SanMiguel, Jesus Bescos

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Adaptive Resolution Residual Networks -- Generalizing Across Resolutions Easily and Efficiently

Léa Demeule, Mahtab Sandhu, Glen Berseth

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Uncertainty-aware retinal layer segmentation in OCT through probabilistic signed distance functions

Mohammad Mohaiminul Islam, Coen de Vente, Bart Liefers, Caroline Klaver, Erik J Bekkers, Clara I. Sánchez

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Anatomically-Grounded Fact Checking of Automated Chest X-ray Reports

R. Mahmood, K. C. L. Wong, D. M. Reyes, N. D'Souza, L. Shi, J. Wu, P. Kaviani, M. Kalra, G. Wang, P. Yan, T. Syeda-Mahmood

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos

Zhimin Shao, Jialang Xu, Danail Stoyanov, Evangelos B. Mazomenos, Yueming Jin

专题命中 视觉定位与Grounding ：visual reasoning(abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 4 figures

Journal ref IEEE Robotics and Automation Letters, vol. 9, no. 12, pp. 11513-11520, Dec. 2024

TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Ability

Shimin Chen, Xiaohan Lan, Yitian Yuan, Zequn Jie, Lin Ma

专题命中 视觉定位与Grounding ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Multimodal Autoregressive Pre-training of Large Vision Encoders

Enrico Fini, Mustafa Shukor, Xiujun Li, Philipp Dufter, Michal Klein, David Haldimann, Sai Aitharaju, Victor Guilherme Turrisi da Costa, Louis Béthune, Zhe Gan, Alexander T Toshev, Marcin Eichner, Moin Nabi, Yinfei Yang, Joshua M. Susskind, Alaaeldin El-Nouby

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments https://github.com/apple/ml-aim

Is this Generated Person Existed in Real-world? Fine-grained Detecting and Calibrating Abnormal Human-body

Zeqing Wang, Qingyang Ma, Wentao Wan, Haojie Li, Keze Wang, Yonghong Tian

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV、cs.AI

Comments 16 pages, 14 figures

TFG: Unified Training-Free Guidance for Diffusion Models

Haotian Ye, Haowei Lin, Jiaqi Han, Minkai Xu, Sheng Liu, Yitao Liang, Jianzhu Ma, James Zou, Stefano Ermon

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

ObjectNLQ @ Ego4D Episodic Memory Challenge 2024

Yisen Feng, Haoyu Zhang, Yuquan Xie, Zaijing Li, Meng Liu, Liqiang Nie

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments The solution for the Natural Language Query track and Goal Step track at CVPR EgoVis Workshop 2024

Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators

Claire Wonjeong Jo, Miki Wesołowska, Magdalena Wojcieszak

专题命中 视觉定位与Grounding ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Knowledge Graphs of Driving Scenes to Empower the Emerging Capabilities of Neurosymbolic AI

Ruwan Wickramarachchi, Cory Henson, Amit Sheth

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 8 pages

'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue

Rena Gao, Xuetong Wu, Siwen Luo, Caren Han, Feng Liu

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.AI、cs.LG

Comments 16 pages, 5 figures

Improving Apple Object Detection with Occlusion-Enhanced Distillation

Liang Geng

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Global-Local Medical SAM Adaptor Based on Full Adaption

Meng Wang, Yarong Feng, Yongwei Tang, Tian Zhang, Yuxin Liang, Chao Lv

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV、cs.AI

Neuro-symbolic Learning Yielding Logical Constraints

Zenan Li, Yunpeng Huang, Zhaoyu Li, Yuan Yao, Jingwei Xu, Taolue Chen, Xiaoxing Ma, Jian Lu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Published as a conference paper at NeurIPS 2023, and code is available at [this url](https://github.com/Lizn-zn/Nesy-Programming)

G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training

Che Liu, Cheng Ouyang, Sibo Cheng, Anand Shah, Wenjia Bai, Rossella Arcucci

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Accepted by NeurIPS2024

IntersectionZoo: Eco-driving for Benchmarking Multi-Agent Contextual Reinforcement Learning

Vindula Jayawardana, Baptiste Freydt, Ao Qu, Cameron Hickert, Zhongxia Yan, Cathy Wu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments In review

Including Facial Expressions in Contextual Embeddings for Sign Language Generation

Carla Viegas, Mert İnan, Lorna Quandt, Malihe Alikhani

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI

Sijie Cheng, Kechen Fang, Yangyang Yu, Sicheng Zhou, Bohao Li, Ye Tian, Tingguang Li, Lei Han, Yang Liu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

TV-SAM: Increasing Zero-Shot Segmentation Performance on Multimodal Medical Images Using GPT-4 Generated Descriptive Prompts Without Human Annotation

Zekun Jiang, Dongjie Cheng, Ziyuan Qin, Jun Gao, Qicheng Lao, Abdullaev Bakhrom Ismoilovich, Urazboev Gayrat, Yuldashov Elyorbek, Bekchanov Habibullo, Defu Tang, LinJing Wei, Kang Li, Le Zhang

专题命中 视觉定位与Grounding ：vision language model(abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 5 figures, 4 tables, accepted by BDMA Journal

Policy Improvement using Language Feedback Models

Victor Zhong, Dipendra Misra, Xingdi Yuan, Marc-Alexandre Côté

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2024

Griffon: Spelling out All Object Locations at Any Granularity with Large Language Models

Yufei Zhan, Yousong Zhu, Zhiyang Chen, Fan Yang, Ming Tang, Jinqiao Wang

专题命中 视觉定位与Grounding ：vision language model(abstract)；分类 cs.CV、cs.AI

Comments ECCV2024, Github: https://github.com/jefferyZhan/Griffon

PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation

Tianyuan Zhang, Hong-Xing Yu, Rundi Wu, Brandon Y. Feng, Changxi Zheng, Noah Snavely, Jiajun Wu, William T. Freeman

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments Project website at: https://physdreamer.github.io/ Appear on ECCV 2024

Unveiling the Invisible: Captioning Videos with Metaphors

Abisek Rajakumar Kalarani, Pushpak Bhattacharyya, Sumit Shekhar

专题命中 视觉定位与Grounding ：LLaVA(abstract)；分类 cs.CV、cs.AI

CableInspect-AD: An Expert-Annotated Anomaly Detection Dataset

Akshatha Arodi, Margaux Luck, Jean-Luc Bedwani, Aldo Zaimi, Ge Li, Nicolas Pouliot, Julien Beaudry, Gaétan Marceau Caron

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments 35 pages, to appear at NeurIPS 2024