Probabilistic Attribution For Large Language Models
Argonne Leadership Computing Facility(阿贡领导计算设施);Argonne National Laboratory(阿贡国家实验室);Mathematics and Computer Science Division(数学与计算机科学 division);Department of Computer Science(计算机科学系)
Shilpika Shilpika, Carlo Graziani, Bethany Lusch, Venkatram Vishwanath, Michael E. Papka
The generative nature of Large Language Models (LLMs) is reflected in the conditional probabilities they compute to sample each response token given the previous tokens. These probabilities encode the distributional structure that the model learns in training and exploits in inference. In this work, we use these probabilities to situate LLMs within the mathematical theory of stochastic processes. We use this framework to design a model-agnostic probabilistic token attribution measure, using Bayes rule to invert the next-token log-probabilities so as to capture the models internal representation of the distribution over token sequences. The representation is independent of the models computational structure. This representation yields the conditional probability of the response given the prompt, and of the response given the prompt with a token marginalized away. Our attribution score is the log of the ratio of these probabilities. We further compute the entropies of a single prompts token distributions, conditioned on the remaining context. The interplay between entropy and attribution score sheds light on LLM behavior. We evaluate 8 models across 7 prompts and investigate anomalies, token sensitivity, response stability, model stability, and training convergence, thereby improving interpretability and guiding users to focus on uncertain or unstable parts of the generation.
Department of Computer & Information Science & Engineering, University of Florida(佛罗里达大学计算机与信息科学与工程系);School of Computer Science, University of Oklahoma(俄克拉荷马大学计算机科学学院);Department of Electrical Engineering and Computer Science, United States Military Academy(美国军事学院电子工程与计算机科学系)
Bi-directional Bias Attribution: Debiasing Large Language Models without Modifying Prompts
School of Informatics, Xiamen University, China(厦门大学信息学院);vivo AI Lab, China(vivo AI实验室);Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan (Xiamen University), Ministry of Culture and Tourism, China(福建省和台湾非物质文化遗产数字化保护与智能处理重点实验室(厦门大学),文化部,中国)
A Monosemantic Attribution Framework for Stable Interpretability in Clinical Neuroscience Transformer-Based Language Models
Department of Computer Science and Technology(计算机科学与技术系);Cancer Research UK(癌症研究英国公司);Cambridge Institute(剑桥研究所);University of Cambridge(剑桥大学);United Kingdom(英国);DIMES(迪梅斯);University of Calabria(卡拉布里亚大学);Italy(意大利);Department of Computer Automatic and Management Engineering (DIAG)(计算机自动与管理工程系);Sapienza Università di Roma(罗马大学萨皮恩扎);Department of Psychiatry(精神病学系);School of Computing(计算学院);University of Kent(肯特大学);Department of Psychology(心理学系)
Source-Aware Training Enables Knowledge Attribution in Language Models
University of Michigan(密歇根大学);Allen Institute for AI(艾伦人工智能研究所);Carnegie Mellon University(卡内基梅隆大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Explanations of Large Language Models Explain Language Representations in the Brain
Iran University of Science and Technology(伊朗科学技术大学);University of Tehran(德黑兰大学);Institute for Research in Fundamental Sciences(基础科学研究所);Khatam University(哈塔姆大学)
Explaining Pre-Trained Language Models with Attribution Scores: An Analysis in Low-Resource Settings
Bosch Center for Artificial Intelligence(博世人工智能中心);University of Stuttgart(斯图加特大学);Hochschule der Medien(媒体大学);Technical University of Darmstadt(达姆施塔特工业大学)
Can Large Language Models Identify Meaningful Touchpoints in Conversion Attribution?
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);Taobao & Tmall Group of Alibaba(阿里巴巴淘宝天猫集团)
Diagnosing Failures in Large Language Models' Answers: Integrating Error Attribution into Evaluation Framework
Tencent(腾讯);Tsinghua University(清华大学);University of the Chinese Academy of Sciences(中国科学院大学);Huazhong University of Science and Technology(华中科技大学);Guangdong University of Foreign Studies(广东外语外贸大学);Southeast University(东南大学)
Evidence Recomposition and Predictive Context Residualization for Visual Attribution in Multimodal Large Language Models
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Zhongguancun Academy(中关村学院);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学);Department of Mechanical Engineering, Imperial College London(伦敦帝国理工学院机械工程系)
Source Attribution for Large Language Model-Generated Data
School of Computing(计算机学院);National University of Singapore(新加坡国立大学);Institute for Infocomm Research(信息通信研究院);Agency for Science, Technology and Research(新加坡科技研究局)