We introduce SelfCite, a novel self-supervised approach that aligns LLMs to generate high-quality, fine-grained, sentence-level citations for the statements in their generated responses. Instead of only relying on costly and labor-intensive annotations, SelfCite leverages a reward signal provided by the LLM itself through context ablation: If a citation is necessary, removing the cited text from the context should prevent the same response; if sufficient, retaining the cited text alone should preserve the same response. This reward can guide the inference-time best-of-N sampling strategy to improve citation quality significantly, as well as be used in preference optimization to directly fine-tune the models for generating better citations. The effectiveness of SelfCite is demonstrated by increasing citation F1 up to 5.3 points on the LongBench-Cite benchmark across five long-form question answering tasks. The source code is available at https://github.com/facebookresearch/SelfCite
Deliberative Alignment is Deep, but Uncertainty Remains: Inference time safety improvement in reasoning via attribution of unsafe behavior to base model
Explanations of Large Language Models Explain Language Representations in the Brain
Iran University of Science and Technology(伊朗科学技术大学);University of Tehran(德黑兰大学);Institute for Research in Fundamental Sciences(基础科学研究所);Khatam University(哈塔姆大学)
SafeSeek: Universal Attribution of Safety Circuits in Language Models
University of Science;United Arab Emirates University;Nanyang Technological University;Zayed University;Intelligent Science \& Technology Academy of CASIC
Department of Computer & Information Science & Engineering, University of Florida(佛罗里达大学计算机与信息科学与工程系);School of Computer Science, University of Oklahoma(俄克拉荷马大学计算机科学学院);Department of Electrical Engineering and Computer Science, United States Military Academy(美国军事学院电子工程与计算机科学系)
A Monosemantic Attribution Framework for Stable Interpretability in Clinical Neuroscience Transformer-Based Language Models
Department of Computer Science and Technology(计算机科学与技术系);Cancer Research UK(癌症研究英国公司);Cambridge Institute(剑桥研究所);University of Cambridge(剑桥大学);United Kingdom(英国);DIMES(迪梅斯);University of Calabria(卡拉布里亚大学);Italy(意大利);Department of Computer Automatic and Management Engineering (DIAG)(计算机自动与管理工程系);Sapienza Università di Roma(罗马大学萨皮恩扎);Department of Psychiatry(精神病学系);School of Computing(计算学院);University of Kent(肯特大学);Department of Psychology(心理学系)
Truthful or Fabricated? Using Causal Attribution to Mitigate Reward Hacking in Explanations
Institute for Logic, Language and Computation (ILLC), University of Amsterdam(逻辑、语言与计算研究所(ILLC),阿姆斯特丹大学);Institute for Language, Cognition and Computation (ILCC), University of Edinburgh(语言、认知与计算研究所(ILCC),爱丁堡大学)
Automated scoring of the Ambiguous Intentions Hostility Questionnaire using fine-tuned large language models
University of California, Los Angeles(加州大学洛杉矶分校);University of Texas at Tyler(德克萨斯大学泰勒分校);JFK Johnson Rehabilitation Institute(肯尼迪约翰逊康复研究所);University of Chicago(芝加哥大学)
Inducing language models to assert their own consciousness restores human beliefs and values
Google(谷歌);University of Chicago(芝加哥大学);University of London(伦敦大学);University of Washington(华盛顿大学);Northwestern University(西北大学);Santa Fe Institute(圣达菲研究所)
The Invisible Editorial Layer: Formalizing Undisclosed Inference-Time Steering, Probability Placement, and the Attribution Problem in Deployed Language Models
Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Computer Science and Technology, Donghua University(东华大学计算机科学与技术学院)
From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulness
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Saarland Informatics Campus(萨尔兰信息学园区);Centre for European Research in Trusted AI (CERTAIN)(欧洲可信人工智能研究中心(CERTAIN));Technische Universität Berlin(柏林工业大学);IBM Research(IBM研究院);University of Copenhagen(哥本哈根大学);University of Groningen(格罗宁根大学)
G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment
NLP 2 CT Lab, Department of Computer and Information Science, University of Macau(NLP 2 CT实验室,计算机与信息科学系,澳门大学);Faculty of Arts and Humanities, University of Macau(人文学院,澳门大学)
Backdoor Attribution: Elucidating and Controlling Backdoor in Language Models
University of Science and Technology of China(中国科学技术大学);Nanyang Technological University(南洋理工大学);United Arab Emirates University(阿拉伯联合酋长国大学);University of California San Diego(加州大学圣地亚哥分校);Abel AI;National University of Singapore(新加坡国立大学);Squirrel Ai Learning
Cross-linguistic disagreement as a conflict of semantic alignment norms in multilingual AI~Linguistic Diversity as a Problem for Philosophy, Cognitive Science, and AI~
Japan Advanced Institute of Science and Technology(日本先进科学技术学院);Victoria University of Wellington(惠灵顿维多利亚大学);Macquarie University(麦考瑞大学);Nanzan University(南山大学);Kyoto University(京都大学)
The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
University of Oxford(牛津大学);University of Pennsylvania(宾夕法尼亚大学);Bocconi University(博科尼大学);ML Commons;Contextual AI;Factored AI;UCL(伦敦大学学院);Cohere;MetaAI;New York University(纽约大学);AWS AI Labs(亚马逊云科技AI实验室);Meedan
DFAMS: Dynamic-flow guided Federated Alignment based Multi-prototype Search
National Engineering Research Center for Software Engineering, Peking University(软件工程国家工程研究中心,北京大学);School of Computer Science, Peking University(北京大学计算机学院);Key Laboratory of High Confidence Software Technologies, Ministry of Education(教育部高性能软件技术重点实验室);Peking University Information Technology Institute (Tianjin Binhai)(北京大学信息科学技术研究院(天津滨海))
Taming Actor-Observer Asymmetry in Agents via Dialectical Alignment
National University of Singapore(国立新加坡大学);Sichuan University(四川大学);University of Minnesota Twin Cities(明尼苏达大学双城分校);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳分校);University of Oxford(牛津大学)
Tracing Stereotypes from Representation to Output in Multilingual LLMs
Saarland University(萨尔大学);Queen’s University Belfast(贝尔法斯特女王大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));University of Technology Nuremberg(纽伦堡工业大学)
ProvenanceGuard: Source-Aware Factuality Verification for MCP-Based LLM Agents
Multiverse Computing;Parque Cientifico y Tecnológico de Gipuzkoa(吉普斯夸科技园);Centre for Social Innovation(社会创新中心);Donostia International Physics Center(多诺斯蒂亚国际物理中心);Ikerbasque Foundation for Science(伊克尔巴斯克科学基金会)