多模态大模型

VisNumBench: Evaluating Number Sense of Multimodal Large Language Models

Tengjin Weng, Jingyi Wang, Wenhao Jiang, Zhong Ming

机构 * College of Computer Science and Software Engineering, Shenzhen University（深圳大学计算机科学与软件工程学院） ； Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)（广东省人工智能与数字经济发展实验室） ； Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际 Graduate School） ； Shenzhen Technology University（深圳技术大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments accepted by ICCV 2025

Moravec's Paradox: Towards an Auditory Turing Test

David Noever, Forrest McKee

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.AI、eess.AS

A Novel Dataset for Flood Detection Robust to Seasonal Changes in Satellite Imagery

Youngsun Jang, Dongyoun Kim, Chulwoo Pack, Kwanghee Won

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, 2 figures. Presented at ACM RACS 2024 (Pompei, Italy, Nov 5-8, 2024)

FinMarBa: A Market-Informed Dataset for Financial Sentiment Classification

Baptiste Lefort, Eric Benhamou, Beatrice Guez, Jean-Jacques Ohana, Ethan Setrouk, Alban Etienne

机构 * Ai For Alpha ； Centrale Supélec ； Paris Dauphine PSL（巴黎-法兰西大学） 纠错

专题命中 多模态评测 ：cross-modal(abstract)；分类 cs.CL

Comments 8 pages

FinGAIA: A Chinese Benchmark for AI Agents in Real-World Financial Domain

Lingfeng Zeng, Fangqi Lou, Zixuan Wang, Jiajie Xu, Jinyi Niu, Mengping Li, Yifan Dong, Qi Qi, Wei Zhang, Ziwei Yang, Jun Han, Ruilun Feng, Ruiqi Hu, Lejie Zhang, Zhengbo Feng, Yicheng Ren, Xin Guo, Zhaowei Liu, Dongpo Cheng, Weige Cai, Liwen Zhang

专题命中 多模态评测 ：cross-modal(abstract)；分类 cs.CL

LidaRefer: Context-aware Outdoor 3D Visual Grounding for Autonomous Driving

Yeong-Seung Baek, Heung-Seon Oh

机构 * School of Computer Science and Engineering（计算机科学与工程学院） 纠错

专题命中 多模态评测 ：cross-modal(abstract)；分类 cs.CV

Comments 18 pages, 5 figures

Planning for Cooler Cities: A Multimodal AI Framework for Predicting and Mitigating Urban Heat Stress through Urban Landscape Transformation

Shengao Yi, Xiaojiang Li, Wei Tu, Tianhong Zhao

机构 * Department of City and Regional Planning, University of Pennsylvania（城市与区域规划系，宾夕法尼亚大学） ； Guangdong Key Laboratory for Urban Informatics, Guangdong-Hong Kong-Macao Joint Laboratory for Smart Cities（广东城市信息关键实验室、粤港澳大湾区智慧城市联合实验室） ； Shenzhen Key Laboratory of Spatial Information Smart Sensing（深圳空间信息智能感知关键实验室） ； Department of Urban Informatics, School of Architecture and Urban Planning, Shenzhen University（城市信息系，深圳大学） ； College of Big Data and Internet, Shenzhen Technology University（大数据与互联网学院，深圳科技大学） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Phi-Ground Tech Report: Advancing Perception in GUI Grounding

Miaosen Zhang, Ziqiang Xu, Jialiang Zhu, Qi Dai, Kai Qiu, Yifan Yang, Chong Luo, Tianyi Chen, Justin Wagle, Tim Franklin, Baining Guo

机构 * Microsoft（微软） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV、cs.AI、cs.MM

AGA: An adaptive group alignment framework for structured medical cross-modal representation learning

Wei Li, Xun Gong, Jiao Li, Xiaobin Sun

机构 * School of Computing and Artificial Intelligence（计算机与人工智能学院） ； Southwest Jiaotong University（西南交通大学） ； Department of Gastroenterology（消化内科部） ； The Third People’s Hospital of Chengdu（成都第三人民医院） 纠错

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；image-text(abstract)；分类 cs.CV、cs.AI

LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks

Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen

机构 * Tianjin University of Technology（天津理工大学） ； Hainan University（海南大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV、cs.AI

Comments This paper has been accepted by ACM MM 2025

Hybrid CNN-Mamba Enhancement Network for Robust Multimodal Sentiment Analysis

Xiang Li, Xianfu Cheng, Xiaoming Zhang, Zhoujun Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.MM

PatchTraj: Unified Time-Frequency Representation Learning via Dynamic Patches for Trajectory Prediction

Yanghong Liu, Xingping Dong, Ming Li, Weixing Zhang, Yidong Lou

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Dual-Stream Global-Local Feature Collaborative Representation Network for Scene Classification of Mining Area

Shuqi Fan, Haoyi Wang, Xianju Li

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to IJCNN 2025

VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning

Ruifeng Yuan, Chenghao Xiao, Sicong Leng, Jianyu Wang, Long Li, Weiwen Xu, Hou Pong Chan, Deli Zhao, Tingyang Xu, Zhongyu Wei, Hao Zhang, Yu Rong

机构 * DAMO Academy, Alibaba Group（达摩院，阿里巴巴集团） ； Hupan Lab（虎盘实验室） ； Fudan University（复旦大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments 21 pages, 5 figures, 6 tables. Work in progress

Quadratic Programming-Based Posture Manipulation and Thrust-vectoring for Agile Dynamic Walking on Narrow Pathways

Chenghao Wang, Eric Sihite, Kaushik Venkatesh Krishnamurthy, Shreyansh Pitroda, Adarsh Salagame, Alireza Ramezani, Morteza Gharib

机构 * Department of Electrical and Computer Engineering, Northeastern University（电子与计算机工程系，东北大学） ； Department of Aerospace Engineering, California Institute of Technology（航空航天工程系，加州理工学院） 纠错

专题命中 其他多模态 ：multi-modal(abstract)

A Foundation Model for Material Fracture Prediction

Agnese Marcato, Aleksandra Pachalieva, Ryley G. Hill, Kai Gao, Xiaoyu Wang, Esteban Rougier, Zhou Lei, Vinamra Agrawal, Janel Chua, Qinjun Kang, Jeffrey D. Hyman, Abigail Hunter, Nathan DeBardeleben, Earl Lawrence, Hari Viswanathan, Daniel O'Malley, Javier E. Santos

机构 * Energy and Natural Resources Security Group, EES-16, Earth and Environmental Sciences Division, Los Alamos National Laboratory（能源与自然资源安全组，EES-16，地球与环境科学部，洛斯阿拉莫斯国家实验室） ； National Security Earth Science Group, EES-17, Earth and Environmental Sciences Division, Los Alamos National Laboratory（国家安全地球科学组，EES-17，地球与环境科学部，洛斯阿拉莫斯国家实验室） ； Materials and Physical Data Group, XCP-5, X Computational Physics Division, Los Alamos National Laboratory（材料与物理数据组，XCP-5，X计算物理部，洛斯阿拉莫斯国家实验室） ； High Performance Computing Design Group, HPC-DES, High Performance Computing Division, Los Alamos National Laboratory（高性能计算设计组，HPC-DES，高性能计算部，洛斯阿拉莫斯国家实验室） ； Statistical Sciences Group, CCS-6, Computer, Computational and Statistical Sciences Division, Los Alamos National Laboratory（统计科学组，CCS-6，计算机、计算与统计科学部，洛斯阿拉莫斯国家实验室） 纠错

专题命中 其他多模态 ：multimodal(abstract)