Looping Back to Move Forward: Recursive Transformers for Efficient and Flexible Large Multimodal Models
循环回溯以前进:递归变换器用于高效灵活的大型多模态模型
Ruihan Xu, Yuting Gao, Lan Wang, Jianing Li, Weihao Chen, Qingpei Guo, Ming Yang, Shiliang Zhang
机构
*
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学)
;
AntGroup(蚂蚁集团)
专题命中
图文多模态
:multimodal(title,abstract);分类 cs.AI
AI总结
RecursiveVLM通过递归细化机制提升多模态模型效率,实现参数复用和性能提升。
CommentsThis is a primary contribution in the Recursive Vision-Language Models
SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense
SHIELD:通过偏差和脆弱性防御抑制LVLM编码器中的幻觉
Yiyang Huang, Liang Shi, Yitian Zhang, Yi Xu, Yun Fu
机构
*
Department of Electrical and Computer Engineering, Northeastern University(电气与计算机工程系,东北大学)
;
Khoury College of Computer Science, Northeastern University(计算机科学学院,东北大学)
机构
*
Department of Electrical and Computer Engineering, Seoul National University(首尔国立大学电子与计算机工程系)
;
Amazon(亚马逊)
;
Samsung Research(三星研究院)
;
School of Computer Science and Engineering, Soongsil University(顺天大学计算机科学与工程学院)
;
IPAI, AIIS, ASRI, INMC, and ISRC, Seoul National University(首尔国立大学IPAI、AIIS、ASRI、INMC和ISRC)
Towards Training-free Multimodal Hate Localisation with Large Language Models
无需训练的多模态仇恨定位与大型语言模型
Yueming Sun, Long Yang, Jianbo Jiao, Zeyu Fu
机构
*
Hybrid Intelligence Lab, University of Durham(杜伦大学混合智能实验室)
;
Multimodal Intelligence Lab, University of Exeter(埃克塞特大学多模态智能实验室)
;
The MIx Group University of Birmingham(伯明翰大学MIx集团)
机构
*
School of Computer Science & Technology, Beijing Institute of Technology(计算机科学与技术学院,北京理工大学)
;
School of Computing, National University of Singapore(计算学院,新加坡国立大学)
TwinWeaver: An LLM-Based Foundation Model Framework for Pan-Cancer Digital Twins
TwinWeaver: 一种基于大语言模型的跨癌症数字双胞胎基础模型框架
Nikita Makarov, Maria Bordukova, Lena Voith von Voithenberg, Estrella Pivel-Villanueva, Sabrina Mielke, Jonathan Wickes, Hanchen Wang, Mingyu Derek Ma, Keunwoo Choi, Kyunghyun Cho, Stephen Ra, Raul Rodriguez-Esteban, Fabian Schmich, Michael Menden
机构
*
Computational Sciences Center of Excellence, Roche, Penzberg, Germany(罗氏计算科学卓越中心)
;
Computational Health Center, Helmholtz Munich, Munich, Germany(海德堡慕尼黑计算健康中心)
;
Department of Biology, Ludwig Maximilian University of Munich, Munich, Germany(慕尼黑路易斯·马克西米利安大学生物学系)
;
Early Development Oncology, Roche Innovation Center Zurich, Roche, Schlieren, Switzerland(罗氏苏黎世创新中心早期肿瘤学)
;
Computational Sciences Center of Excellence, Genentech, New York City, USA(基因泰克计算科学卓越中心)
;
Computational Sciences Center of Excellence, Genentech, South San Francisco, USA(基因泰克计算科学卓越中心)
;
Center for Data Science, New York University, New York City, USA(纽约大学数据科学中心)
;
Department of Computer Science, Stanford University, Stanford, CA, USA(斯坦福大学计算机科学系)
;
Computational Sciences Center of Excellence, Roche, Basel, Switzerland(罗氏巴塞尔计算科学卓越中心)
;
Department of Biochemistry(生物化学系)
;
Biotechnology Institute, The University of Melbourne, Melbourne, Australia(墨尔本大学生物技术研究所)
MEVER: Multi-Modal and Explainable Claim Verification with Graph-based Evidence Retrieval
MEVER:基于图的证据检索的多模态和可解释性声明验证
Delvin Ce Zhang, Suhan Cui, Zhelin Chu, Xianren Zhang, Dongwon Lee
机构
*
University of Sheffield(谢菲尔德大学)
;
University of Science and Technology Beijing(北京科技大学)
;
University of California San Diego(加州大学圣地亚哥分校)
;
The Pennsylvania State University(宾夕法尼亚州立大学)
机构
*
College of Computer Science, Sichuan University, Chengdu, China(四川大学计算机学院)
;
National Key Laboratory of Fundamental Algorithms and Models for Engineering Simulation, Sichuan University, China(四川省工程仿真基础算法与模型国家重点实验室)
机构
*
University of Science and Technology of China(中国科学技术大学)
;
State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室)
;
Peking University(北京大学)
;
Tsinghua University(清华大学)
;
University of California, Los Angeles(加州大学洛杉矶分校)
OmniMER: Auxiliary-Enhanced LLM Adaptation for Indonesian Multimodal Emotion Recognition
OmniMER: 增辅增强的LLM适应用于印度尼西亚多模态情感识别
Xueming Yan, Boyan Xu, Yaochu Jin, Lixian Xiao, Wenlong Ye, Runyang Cai, Zeqi Zheng, Jingfa Liu, Aimin Yang, Yongduan Song
机构
*
School of Information Science and Technology, Guangdong University of Foreign Studies(广东外语外贸大学信息科学与技术学院)
;
School of Computer Science, Guangdong University of Technology(广东工业大学计算机学院)
;
Faculty of Asian Languages and Cultures, Guangdong University of Foreign Studies(广东外语外贸大学亚洲语言文化学院)
;
School of Engineering, Westlake University(西湖大学工程学院)
;
School of Computer Science and Intelligence Education, Lingnan Normal University(岭南师范学院计算机科学与智能教育学院)
;
School of Automation, Chongqing University(重庆大学自动化学院)