Can LLMs Reason Over Non-Text Modalities in a Training-Free Manner? A Case Study with In-Context Representation Learning
LLMs能否在无训练模式下推理非文本模态?一种基于上下文表示学习的案例研究
机构 * College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院) ; AI-X, Interdisciplinary Graduate Programme, Nanyang Technological University(南洋理工大学人工智能交叉研究生项目) ; Lee Kong Chian School of Medicine, Nanyang Technological University(南洋理工大学李科钦医学院) ; Centre of AI in Medicine (C-AIM), Nanyang Technological University(南洋理工大学医学人工智能中心) ; University of Toronto(多伦多大学) ; Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院布里洛妇女医院) ; Massachusetts Institute of Technology(麻省理工学院)
AI总结 本文提出ICRL框架,使LLMs在无训练情况下利用非文本模态表示,通过少量学习实现多模态推理,为适应性泛化提供新方向。
Comments NeurIPS 2025