Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets
The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全全国重点实验室);Hangzhou HighTech Zone (Binjiang) Blockchain and Data Security Research Institute(杭州高新区(滨江)区块链与数据安全研究院)
Yuchen Yang, Wenze Lin, Enhao Huang, Zhixuan Chu, Hongbin Zhou, Lan Tao, Yiming Li, Zhan Qin, Kui Ren
Large Language Models (LLMs) have seen remarkable advancements, achieving state-of-the-art results in diverse applications. Fine-tuning, an important step for adapting LLMs to specific downstream tasks, typically involves further training on corresponding datasets. However, a fundamental discrepancy exists between current fine-tuning datasets and the token-level optimization mechanism of LLMs: most datasets are designed at the sentence-level, which introduces token-level noise, causing negative influence to final performance. In this paper, we propose XTF, an explainable token-level noise filtering framework. XTF decomposes the complex and subtle contributions of token-level data to the fine-tuning process into three distinct and explicit attributes (reasoning importance, knowledge novelty, and task relevance), which can be assessed using scoring methods, and then masks the gradients of selected noisy tokens accordingly to optimize the performance of fine-tuned LLMs. We conduct extensive experiments on three representative downstream tasks (math, code and medicine) across 7 mainstream LLMs. The results demonstrate that XTF can significantly improve downstream performance by up to 13.7% compared to regular fine-tuning. Our work highlights the importance of token-level dataset optimization, and demonstrates the potential of strategies based on attribute decomposition for explaining complex training mechanisms.
Unlocking Full Efficiency of Token Filtering in Large Language Model Training
Shanghai University of Finance and Economics(上海财经大学);Hong Kong University of Science and Technology(香港科技大学);University of Science and Technology of China(中国科学技术大学);Southeast University(东南大学)
Explainable Collaborative Problem Solving Diagnosis with BERT using SHAP and its Implications for Teacher Adoption
UCL Knowledge Lab, Institute of Education, University College London, UK(伦敦大学学院教育学院知识实验室);UCL Centre for Artificial Intelligence, Department of Computer Science, University College London, UK(伦敦大学学院人工智能中心)
Are Rationales Necessary and Sufficient? Tuning LLMs for Explainable Misinformation Detection
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Tongyi Lab, Alibaba Group(阿里云实验室);School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
WaveFilter: Enhancing the Long-Context Capability of Diffusion LLMs via Wavelet-Guided KV Cache Filtering
Nanjing University of Science and Technology(南京理工大学);Alibaba Group(阿里巴巴集团);Huzhou Normal University(湖州师范学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes
Ukrainian Catholic University(乌克兰天主教大学);Johannes Gutenberg University Mainz(美因茨约翰内斯·古滕贝格大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Centre for European Research in Trusted AI (CERTAIN)(欧洲可信人工智能研究中心)
ESTR-CoT: Towards Explainable and Accurate Event Stream based Scene Text Recognition with Chain-of-Thought Reasoning
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);School of Electronic and Information Engineering, Anhui University(安徽大学电子与信息学院);Beijing Institute of Technology(北京理工大学);Harbin Institute of Technology(哈尔滨工业大学);Peng Cheng Laboratory(鹏城实验室)
Tsinghua University(清华大学);BNRist;OPPO AI Center(OPPO人工智能中心);Peking University(北京大学);Hangzhou Zhuoxi Institute of Brain and Intelligence(杭州智行脑科学与人工智能研究所)
DEX-AR: A Dynamic Explainability Method for Autoregressive Vision-Language Models
Tuebingen AI Center University of Tuebingen(图宾根人工智能中心图宾根大学);MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);MIT-IBM Watson AI Lab(麻省理工-IBM沃森人工智能实验室);IBM Research(IBM研究院)
G-Refer: Graph Retrieval-Augmented Large Language Model for Explainable Recommendation
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Chinese University of Hong Kong(香港中文大学);Monash University(莫纳什大学);Huawei Technologies Co., Ltd.(华为技术有限公司)
NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院通用人工智能国家重点实验室);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院)
X-MuTeST: A Multilingual Benchmark for Explainable Hate Speech Detection and A Novel LLM-consulted Explanation Framework
Indian Institute of Technology Indore(印度理工学院Indore);Indian Institute of Information Technology Dharwad(印度信息科技学院Dharwad);Arizona State University(亚利桑那州立大学);Indian Institute of Technology Mandi(印度理工学院Mandi)