Component-Level Lesioning of Language Models Reveals Clinically Aligned Aphasia Phenotypes
语言模型组件级损伤揭示临床对齐的失语症表型
Yifan Wang, Jichen Zheng, Jingyuan Sun, Yunhao Zhang, Chunyu Ye, Jixing Li, Chengqing Zong, Shaonan Wang
机构
*
Department of Computer Science, The University of Manchester, UK(曼彻斯特大学计算机科学系)
;
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, CAS, Beijing, China(多模态人工智能系统国家重点实验室,中国科学院自动化研究所,北京)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学人工智能学院,北京)
;
Department of Linguistics and Translation, City University of Hong Kong, Hong Kong(香港城市大学语言学与翻译系)
;
Department of Language Science and Technology, Hong Kong Polytechnic University, Hong Kong(香港理工大学语言科学与技术系)
机构
*
New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
Kling Team, Kuaishou Technology(快手科技 Kling 团队)
;
Peking University(北京大学)
;
Nanjing University(南京大学)
Do Images Speak Louder than Words? Investigating the Effect of Textual Misinformation in VLMs
图像胜过言语吗?探讨文本误导在VLMs中的影响
Chi Zhang, Wenxuan Ding, Jiale Liu, Mingrui Wu, Qingyun Wu, Ray Mooney
机构
*
The University of Texas at Austin(德克萨斯大学奥斯汀分校)
;
Pennsylvania State University(宾夕法尼亚州立大学)
;
New York University(纽约大学)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
AG2ai, Inc.(AG2ai公司)
机构
*
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation of Chinese Academy of Sciences(中国科学院自动化研究所 multimodal 人工智能系统国家重点实验室)
;
Chemical Defense Institute, Academy of Military Sciences(军事科学院化学防御研究院)
;
Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation of Chinese Academy of Sciences(中国科学院自动化研究所 复杂系统认知与决策智能重点实验室)
机构
*
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(人工智能安全国家重点实验室,计算技术研究所,中国科学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Baidu Inc(百度公司)
机构
*
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所)
;
School of Information and Electronic Engineering, Shandong Technology and Business University(山东科技职业大学信息与电子工程学院)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
PeopleAl, Inc.(PeopleAl公司)
;
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院)
;
Terminal Technology Department, Alipay, Ant Group(蚂蚁集团支付宝终端技术部)